Aug 16 22:20:37 user nova-compute[72773]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 16 22:20:40 user nova-compute[72773]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72773) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72773) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72773) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 16 22:20:40 user nova-compute[72773]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:20:40 user nova-compute[72773]: INFO nova.virt.driver [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 16 22:20:40 user nova-compute[72773]: INFO nova.compute.provider_config [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] Acquiring lock "singleton_lock" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] Acquired lock "singleton_lock" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] Releasing lock "singleton_lock" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] Full set of CONF: {{(pid=72773) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] ******************************************************************************** {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] Configuration options gathered from: {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] ================================================================================ {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] allow_resize_to_same_host      = True {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] arq_binding_timeout            = 300 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] backdoor_port                  = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] backdoor_socket                = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] block_device_allocate_retries  = 300 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] block_device_allocate_retries_interval = 5 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cert                           = self.pem {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] compute_monitors               = [] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] config_dir                     = [] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] config_drive_format            = iso9660 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] config_source                  = [] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] console_host                   = user {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] control_exchange               = nova {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cpu_allocation_ratio           = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] daemon                         = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] debug                          = True {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] default_access_ip_network_name = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] default_availability_zone      = nova {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] default_ephemeral_format       = ext4 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] default_schedule_zone          = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] disk_allocation_ratio          = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] enable_new_services            = True {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] enabled_apis                   = ['osapi_compute'] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] enabled_ssl_apis               = [] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] flat_injected                  = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] force_config_drive             = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] force_raw_images               = True {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] graceful_shutdown_timeout      = 5 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] heal_instance_info_cache_interval = 60 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] host                           = user {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] instance_build_timeout         = 0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] instance_delete_interval       = 300 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] instance_format                = [instance: %(uuid)s]  {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] instance_name_template         = instance-%08x {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] instance_usage_audit           = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] instance_usage_audit_period    = month {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] internal_service_availability_zone = internal {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] key                            = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] live_migration_retry_count     = 30 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] log_config_append              = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] log_dir                        = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] log_file                       = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] log_options                    = True {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] log_rotate_interval            = 1 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] log_rotate_interval_type       = days {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] log_rotation_type              = none {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] long_rpc_timeout               = 1800 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] max_concurrent_builds          = 10 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] max_concurrent_live_migrations = 1 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] max_concurrent_snapshots       = 5 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] max_local_block_devices        = 3 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] max_logfile_count              = 30 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] max_logfile_size_mb            = 200 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] maximum_instance_delete_attempts = 5 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] metadata_listen                = 0.0.0.0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] metadata_listen_port           = 8775 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] metadata_workers               = 3 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] migrate_max_retries            = -1 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] mkisofs_cmd                    = genisoimage {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] my_ip                          = 10.0.0.210 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] network_allocate_retries       = 0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] osapi_compute_listen_port      = 8774 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] osapi_compute_unique_server_name_scope =  {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] osapi_compute_workers          = 3 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] password_length                = 12 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] periodic_enable                = True {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] periodic_fuzzy_delay           = 60 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] pointer_model                  = ps2mouse {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] preallocate_images             = none {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] publish_errors                 = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] pybasedir                      = /opt/stack/nova {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] ram_allocation_ratio           = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] rate_limit_burst               = 0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] rate_limit_except_level        = CRITICAL {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] rate_limit_interval            = 0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] reboot_timeout                 = 0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] reclaim_instance_interval      = 0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] record                         = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] reimage_timeout_per_gb         = 60 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] report_interval                = 120 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] rescue_timeout                 = 0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] reserved_host_cpus             = 0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] reserved_host_disk_mb          = 0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] reserved_host_memory_mb        = 512 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] reserved_huge_pages            = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] resize_confirm_window          = 0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] resize_fs_using_block_device   = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] resume_guests_state_on_host_boot = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] rpc_response_timeout           = 60 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] run_external_periodic_tasks    = True {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] running_deleted_instance_action = reap {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] running_deleted_instance_poll_interval = 1800 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] running_deleted_instance_timeout = 0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] scheduler_instance_sync_interval = 120 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] service_down_time              = 720 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] servicegroup_driver            = db {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] shelved_offload_time           = 0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] shelved_poll_interval          = 3600 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] shutdown_timeout               = 0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] source_is_ipv6                 = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] ssl_only                       = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] state_path                     = /opt/stack/data/nova {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] sync_power_state_interval      = 600 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] sync_power_state_pool_size     = 1000 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] syslog_log_facility            = LOG_USER {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] tempdir                        = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] timeout_nbd                    = 10 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] transport_url                  = **** {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] update_resources_interval      = 0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] use_cow_images                 = True {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] use_eventlog                   = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] use_journal                    = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] use_json                       = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] use_rootwrap_daemon            = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] use_stderr                     = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] use_syslog                     = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vcpu_pin_set                   = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vif_plugging_is_fatal          = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vif_plugging_timeout           = 0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] virt_mkfs                      = [] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] volume_usage_poll_interval     = 0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] watch_log_file                 = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] web                            = /usr/share/spice-html5 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_concurrency.disable_process_locking = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api.auth_strategy              = keystone {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api.compute_link_prefix        = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api.dhcp_domain                = novalocal {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api.enable_instance_password   = True {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api.glance_link_prefix         = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api.instance_list_per_project_cells = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api.list_records_by_skipping_down_cells = True {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api.local_metadata_per_cell    = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api.max_limit                  = 1000 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api.metadata_cache_expiration  = 15 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api.neutron_default_tenant_id  = default {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api.use_forwarded_for          = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api.use_neutron_default_nets   = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api.vendordata_dynamic_targets = [] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api.vendordata_jsonfile_path   = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cache.backend                  = dogpile.cache.memcached {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cache.backend_argument         = **** {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cache.config_prefix            = cache.oslo {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cache.dead_timeout             = 60.0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cache.debug_cache_backend      = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cache.enable_retry_client      = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cache.enable_socket_keepalive  = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cache.enabled                  = True {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cache.expiration_time          = 600 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cache.hashclient_retry_attempts = 2 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cache.memcache_dead_retry      = 300 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cache.memcache_password        =  {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cache.memcache_pool_maxsize    = 10 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cache.memcache_sasl_enabled    = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cache.memcache_username        =  {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cache.proxies                  = [] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cache.retry_attempts           = 2 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cache.retry_delay              = 0.0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cache.socket_keepalive_count   = 1 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cache.socket_keepalive_idle    = 1 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cache.socket_keepalive_interval = 1 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cache.tls_allowed_ciphers      = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cache.tls_cafile               = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cache.tls_certfile             = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cache.tls_enabled              = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cache.tls_keyfile              = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cinder.auth_section            = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cinder.auth_type               = password {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cinder.cafile                  = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cinder.certfile                = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cinder.collect_timing          = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cinder.cross_az_attach         = True {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cinder.debug                   = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cinder.endpoint_template       = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cinder.http_retries            = 3 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cinder.insecure                = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cinder.keyfile                 = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cinder.os_region_name          = RegionOne {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cinder.split_loggers           = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cinder.timeout                 = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] compute.cpu_dedicated_set      = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] compute.cpu_shared_set         = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] compute.image_type_exclude_list = [] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] compute.max_concurrent_disk_ops = 0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] compute.max_disk_devices_to_attach = -1 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] compute.resource_provider_association_refresh = 300 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] compute.shutdown_retry_interval = 10 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] conductor.workers              = 3 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] console.allowed_origins        = [] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] console.ssl_ciphers            = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] console.ssl_minimum_version    = default {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] consoleauth.token_ttl          = 600 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cyborg.cafile                  = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cyborg.certfile                = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cyborg.collect_timing          = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cyborg.connect_retries         = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cyborg.connect_retry_delay     = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cyborg.endpoint_override       = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cyborg.insecure                = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cyborg.keyfile                 = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cyborg.max_version             = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cyborg.min_version             = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cyborg.region_name             = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cyborg.service_name            = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cyborg.service_type            = accelerator {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cyborg.split_loggers           = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cyborg.status_code_retries     = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cyborg.status_code_retry_delay = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cyborg.timeout                 = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] cyborg.version                 = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] database.backend               = sqlalchemy {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] database.connection            = **** {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] database.connection_debug      = 0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] database.connection_parameters =  {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] database.connection_recycle_time = 3600 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] database.connection_trace      = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] database.db_inc_retry_interval = True {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] database.db_max_retries        = 20 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] database.db_max_retry_interval = 10 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] database.db_retry_interval     = 1 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] database.max_overflow          = 50 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] database.max_pool_size         = 5 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] database.max_retries           = 10 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] database.mysql_enable_ndb      = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] database.mysql_wsrep_sync_wait = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] database.pool_timeout          = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] database.retry_interval        = 10 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] database.slave_connection      = **** {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] database.sqlite_synchronous    = True {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api_database.backend           = sqlalchemy {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api_database.connection        = **** {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api_database.connection_debug  = 0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api_database.connection_parameters =  {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api_database.connection_recycle_time = 3600 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api_database.connection_trace  = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api_database.db_inc_retry_interval = True {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api_database.db_max_retries    = 20 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api_database.db_max_retry_interval = 10 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api_database.db_retry_interval = 1 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api_database.max_overflow      = 50 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api_database.max_pool_size     = 5 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api_database.max_retries       = 10 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api_database.mysql_enable_ndb  = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api_database.pool_timeout      = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api_database.retry_interval    = 10 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api_database.slave_connection  = **** {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] api_database.sqlite_synchronous = True {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] devices.enabled_mdev_types     = [] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] ephemeral_storage_encryption.enabled = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] glance.api_servers             = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] glance.cafile                  = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] glance.certfile                = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] glance.collect_timing          = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] glance.connect_retries         = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] glance.connect_retry_delay     = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] glance.debug                   = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] glance.default_trusted_certificate_ids = [] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] glance.enable_certificate_validation = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] glance.enable_rbd_download     = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] glance.endpoint_override       = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] glance.insecure                = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] glance.keyfile                 = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] glance.max_version             = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] glance.min_version             = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] glance.num_retries             = 3 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] glance.rbd_ceph_conf           =  {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] glance.rbd_connect_timeout     = 5 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] glance.rbd_pool                =  {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] glance.rbd_user                =  {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] glance.region_name             = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] glance.service_name            = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] glance.service_type            = image {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] glance.split_loggers           = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] glance.status_code_retries     = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] glance.status_code_retry_delay = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] glance.timeout                 = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] glance.verify_glance_signatures = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] glance.version                 = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] guestfs.debug                  = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] hyperv.config_drive_cdrom      = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] hyperv.config_drive_inject_password = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] hyperv.enable_instance_metrics_collection = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] hyperv.enable_remotefx         = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] hyperv.instances_path_share    =  {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] hyperv.iscsi_initiator_list    = [] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] hyperv.limit_cpu_features      = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] hyperv.power_state_check_timeframe = 60 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] hyperv.use_multipath_io        = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] hyperv.volume_attach_retry_count = 10 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] hyperv.vswitch_name            = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] mks.enabled                    = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] image_cache.manager_interval   = 2400 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] image_cache.precache_concurrency = 1 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] image_cache.remove_unused_base_images = True {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] image_cache.subdirectory_name  = _base {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] ironic.api_max_retries         = 60 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] ironic.api_retry_interval      = 2 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] ironic.auth_section            = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] ironic.auth_type               = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] ironic.cafile                  = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] ironic.certfile                = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] ironic.collect_timing          = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] ironic.connect_retries         = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] ironic.connect_retry_delay     = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] ironic.endpoint_override       = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] ironic.insecure                = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] ironic.keyfile                 = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] ironic.max_version             = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] ironic.min_version             = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] ironic.partition_key           = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] ironic.peer_list               = [] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] ironic.region_name             = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] ironic.serial_console_state_timeout = 10 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] ironic.service_name            = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] ironic.service_type            = baremetal {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] ironic.split_loggers           = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] ironic.status_code_retries     = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] ironic.status_code_retry_delay = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] ironic.timeout                 = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] ironic.version                 = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] key_manager.fixed_key          = **** {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] barbican.barbican_api_version  = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] barbican.barbican_endpoint     = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] barbican.barbican_endpoint_type = public {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] barbican.barbican_region_name  = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] barbican.cafile                = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] barbican.certfile              = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] barbican.collect_timing        = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] barbican.insecure              = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] barbican.keyfile               = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] barbican.number_of_retries     = 60 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] barbican.retry_delay           = 1 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] barbican.send_service_user_token = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] barbican.split_loggers         = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] barbican.timeout               = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] barbican.verify_ssl            = True {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] barbican.verify_ssl_path       = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] barbican_service_user.auth_section = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] barbican_service_user.auth_type = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] barbican_service_user.cafile   = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] barbican_service_user.certfile = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] barbican_service_user.collect_timing = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] barbican_service_user.insecure = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] barbican_service_user.keyfile  = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] barbican_service_user.split_loggers = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] barbican_service_user.timeout  = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vault.approle_role_id          = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vault.approle_secret_id        = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vault.cafile                   = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vault.certfile                 = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vault.collect_timing           = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vault.insecure                 = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vault.keyfile                  = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vault.kv_mountpoint            = secret {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vault.kv_version               = 2 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vault.namespace                = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vault.root_token_id            = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vault.split_loggers            = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vault.ssl_ca_crt_file          = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vault.timeout                  = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vault.use_ssl                  = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] keystone.cafile                = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] keystone.certfile              = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] keystone.collect_timing        = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] keystone.connect_retries       = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] keystone.connect_retry_delay   = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] keystone.endpoint_override     = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] keystone.insecure              = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] keystone.keyfile               = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] keystone.max_version           = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] keystone.min_version           = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] keystone.region_name           = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] keystone.service_name          = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] keystone.service_type          = identity {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] keystone.split_loggers         = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] keystone.status_code_retries   = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] keystone.status_code_retry_delay = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] keystone.timeout               = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] keystone.version               = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.connection_uri         =  {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.cpu_mode               = custom {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: WARNING oslo_config.cfg [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.cpu_power_governor_high = performance {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.cpu_power_governor_low = powersave {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.cpu_power_management   = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.device_detach_attempts = 8 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.device_detach_timeout  = 20 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.disk_cachemodes        = [] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.disk_prefix            = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.enabled_perf_events    = [] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.file_backed_memory     = 0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.gid_maps               = [] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.hw_disk_discard        = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.hw_machine_type        = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.images_rbd_glance_store_name =  {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.images_rbd_pool        = rbd {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.images_type            = default {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.images_volume_group    = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.inject_key             = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.inject_partition       = -2 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.inject_password        = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.iscsi_iface            = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.iser_use_multipath     = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.live_migration_bandwidth = 0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.live_migration_downtime = 500 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.live_migration_inbound_addr = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.live_migration_permit_post_copy = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.live_migration_scheme  = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.live_migration_timeout_action = abort {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.live_migration_tunnelled = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: WARNING oslo_config.cfg [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 16 22:20:40 user nova-compute[72773]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 16 22:20:40 user nova-compute[72773]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 16 22:20:40 user nova-compute[72773]: and ``live_migration_inbound_addr`` respectively.
Aug 16 22:20:40 user nova-compute[72773]: ).  Its value may be silently ignored in the future.
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.live_migration_with_native_tls = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.max_queues             = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.nfs_mount_options      = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.num_memory_encrypted_guests = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.num_pcie_ports         = 0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.pmem_namespaces        = [] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.quobyte_client_cfg     = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.rbd_secret_uuid        = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.rbd_user               = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.remote_filesystem_transport = ssh {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.rescue_image_id        = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.rescue_kernel_id       = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.rescue_ramdisk_id      = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.rx_queue_size          = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.smbfs_mount_options    =  {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.snapshot_compression   = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.snapshot_image_format  = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.sparse_logical_volumes = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.swtpm_enabled          = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.swtpm_group            = tss {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.swtpm_user             = tss {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.sysinfo_serial         = unique {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.tb_cache_size          = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.tx_queue_size          = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.uid_maps               = [] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.use_virtio_for_bridges = True {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.virt_type              = kvm {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.volume_clear           = zero {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.volume_clear_size      = 0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.volume_use_multipath   = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.vzstorage_cache_path   = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.vzstorage_mount_user   = stack {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] neutron.auth_section           = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] neutron.auth_type              = password {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] neutron.cafile                 = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] neutron.certfile               = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] neutron.collect_timing         = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] neutron.connect_retries        = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] neutron.connect_retry_delay    = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] neutron.default_floating_pool  = public {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] neutron.endpoint_override      = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] neutron.extension_sync_interval = 600 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] neutron.http_retries           = 3 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] neutron.insecure               = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] neutron.keyfile                = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] neutron.max_version            = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] neutron.min_version            = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] neutron.ovs_bridge             = br-int {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] neutron.physnets               = [] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] neutron.region_name            = RegionOne {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] neutron.service_metadata_proxy = True {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] neutron.service_name           = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] neutron.service_type           = network {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] neutron.split_loggers          = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] neutron.status_code_retries    = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] neutron.status_code_retry_delay = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] neutron.timeout                = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] neutron.version                = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] notifications.bdms_in_notifications = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] notifications.default_level    = INFO {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] notifications.notification_format = unversioned {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] notifications.notify_on_state_change = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] pci.alias                      = [] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] pci.device_spec                = [] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] pci.report_in_placement        = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.auth_section         = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.auth_type            = password {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.cafile               = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.certfile             = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.collect_timing       = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.connect_retries      = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.connect_retry_delay  = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.default_domain_id    = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.default_domain_name  = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.domain_id            = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.domain_name          = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.endpoint_override    = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.insecure             = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.keyfile              = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.max_version          = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.min_version          = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.password             = **** {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.project_domain_id    = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.project_domain_name  = Default {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.project_id           = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.project_name         = service {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.region_name          = RegionOne {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.service_name         = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.service_type         = placement {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.split_loggers        = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.status_code_retries  = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.status_code_retry_delay = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.system_scope         = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.timeout              = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.trust_id             = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.user_domain_id       = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.user_domain_name     = Default {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.user_id              = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.username             = placement {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] placement.version              = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] quota.cores                    = 20 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] quota.count_usage_from_placement = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] quota.injected_file_content_bytes = 10240 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] quota.injected_file_path_length = 255 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] quota.injected_files           = 5 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] quota.instances                = 10 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] quota.key_pairs                = 100 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] quota.metadata_items           = 128 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] quota.ram                      = 51200 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] quota.recheck_quota            = True {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] quota.server_group_members     = 10 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] quota.server_groups            = 10 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] rdp.enabled                    = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] scheduler.image_metadata_prefilter = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] scheduler.max_attempts         = 3 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] scheduler.max_placement_results = 1000 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] scheduler.query_placement_for_availability_zone = True {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] scheduler.query_placement_for_image_type_support = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] scheduler.workers              = 3 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] filter_scheduler.host_subset_size = 1 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] filter_scheduler.isolated_hosts = [] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] filter_scheduler.isolated_images = [] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] filter_scheduler.pci_in_placement = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] filter_scheduler.track_instance_changes = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] metrics.required               = True {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] metrics.weight_multiplier      = 1.0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] metrics.weight_setting         = [] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] serial_console.enabled         = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] serial_console.port_range      = 10000:20000 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] serial_console.serialproxy_port = 6083 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] service_user.auth_section      = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] service_user.auth_type         = password {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] service_user.cafile            = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] service_user.certfile          = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] service_user.collect_timing    = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] service_user.insecure          = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] service_user.keyfile           = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] service_user.send_service_user_token = True {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] service_user.split_loggers     = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] service_user.timeout           = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] spice.agent_enabled            = True {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] spice.enabled                  = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] spice.html5proxy_port          = 6082 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] spice.image_compression        = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] spice.jpeg_compression         = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] spice.playback_compression     = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] spice.server_listen            = 127.0.0.1 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] spice.streaming_mode           = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] spice.zlib_compression         = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] upgrade_levels.baseapi         = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] upgrade_levels.cert            = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] upgrade_levels.compute         = auto {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] upgrade_levels.conductor       = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] upgrade_levels.scheduler       = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vendordata_dynamic_auth.auth_section = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vendordata_dynamic_auth.auth_type = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vendordata_dynamic_auth.cafile = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vendordata_dynamic_auth.certfile = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vendordata_dynamic_auth.insecure = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vendordata_dynamic_auth.keyfile = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vendordata_dynamic_auth.timeout = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vmware.api_retry_count         = 10 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vmware.ca_file                 = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vmware.cache_prefix            = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vmware.cluster_name            = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vmware.connection_pool_size    = 10 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vmware.console_delay_seconds   = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vmware.datastore_regex         = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vmware.host_ip                 = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vmware.host_password           = **** {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vmware.host_port               = 443 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vmware.host_username           = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vmware.insecure                = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vmware.integration_bridge      = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vmware.maximum_objects         = 100 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vmware.pbm_default_policy      = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vmware.pbm_enabled             = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vmware.pbm_wsdl_location       = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vmware.serial_port_proxy_uri   = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vmware.serial_port_service_uri = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vmware.task_poll_interval      = 0.5 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vmware.use_linked_clone        = True {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vmware.vnc_keymap              = en-us {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vmware.vnc_port                = 5900 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vmware.vnc_port_total          = 10000 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vnc.auth_schemes               = ['none'] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vnc.enabled                    = True {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vnc.novncproxy_port            = 6080 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vnc.server_listen              = 0.0.0.0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vnc.vencrypt_ca_certs          = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vnc.vencrypt_client_cert       = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vnc.vencrypt_client_key        = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] workarounds.disable_rootwrap   = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] workarounds.enable_numa_live_migration = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] workarounds.libvirt_disable_apic = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] wsgi.client_socket_timeout     = 900 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] wsgi.default_pool_size         = 1000 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] wsgi.keep_alive                = True {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] wsgi.max_header_line           = 16384 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] wsgi.ssl_ca_file               = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] wsgi.ssl_cert_file             = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] wsgi.ssl_key_file              = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] wsgi.tcp_keepidle              = 600 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] zvm.ca_file                    = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] zvm.cloud_connector_url        = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] zvm.reachable_timeout          = 300 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_policy.enforce_new_defaults = True {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_policy.enforce_scope      = True {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_policy.policy_default_rule = default {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_policy.policy_file        = policy.yaml {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] profiler.connection_string     = messaging:// {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] profiler.enabled               = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] profiler.es_doc_type           = notification {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] profiler.es_scroll_size        = 10000 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] profiler.es_scroll_time        = 2m {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] profiler.filter_error_trace    = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] profiler.hmac_keys             = **** {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] profiler.sentinel_service_name = mymaster {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] profiler.socket_timeout        = 0.1 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] profiler.trace_requests        = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] profiler.trace_sqlalchemy      = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] profiler_jaeger.process_tags   = {} {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] profiler_jaeger.service_name_prefix = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] profiler_otlp.service_name_prefix = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] remote_debug.host              = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] remote_debug.port              = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_rabbit.ssl      = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_notifications.retry = -1 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_messaging_notifications.transport_url = **** {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_limit.auth_section        = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_limit.auth_type           = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_limit.cafile              = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_limit.certfile            = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_limit.collect_timing      = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_limit.connect_retries     = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_limit.connect_retry_delay = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_limit.endpoint_id         = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_limit.endpoint_override   = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_limit.insecure            = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_limit.keyfile             = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_limit.max_version         = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_limit.min_version         = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_limit.region_name         = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_limit.service_name        = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_limit.service_type        = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_limit.split_loggers       = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_limit.status_code_retries = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_limit.status_code_retry_delay = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_limit.timeout             = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_limit.valid_interfaces    = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_limit.version             = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_reports.file_event_handler = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] oslo_reports.log_dir           = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vif_plug_ovs_privileged.group  = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] vif_plug_ovs_privileged.user   = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] os_vif_linux_bridge.flat_interface = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] os_vif_ovs.isolate_vif         = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] os_vif_ovs.per_port_bridge     = False {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] os_brick.lock_path             = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] privsep_osbrick.capabilities   = [21] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] privsep_osbrick.group          = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] privsep_osbrick.helper_command = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] privsep_osbrick.user           = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] nova_sys_admin.group           = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] nova_sys_admin.helper_command  = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] nova_sys_admin.user            = None {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 22:20:40 user nova-compute[72773]: DEBUG oslo_service.service [None req-6511871c-6530-4eeb-ab88-cde37dd3701e None None] ******************************************************************************** {{(pid=72773) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 16 22:20:40 user nova-compute[72773]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 16 22:20:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Starting native event thread {{(pid=72773) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 16 22:20:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Starting green dispatch thread {{(pid=72773) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 16 22:20:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Starting connection event dispatch thread {{(pid=72773) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 16 22:20:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Connecting to libvirt: qemu:///system {{(pid=72773) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 16 22:20:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fef89540ee0> {{(pid=72773) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 16 22:20:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fef89540ee0> {{(pid=72773) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 16 22:20:41 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Connection event '1' reason 'None'
Aug 16 22:20:41 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 16 22:20:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.mount [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Initialising _HostMountState generation 0 {{(pid=72773) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 16 22:20:48 user nova-compute[72773]: INFO nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Libvirt host capabilities <capabilities>
Aug 16 22:20:48 user nova-compute[72773]:   <host>
Aug 16 22:20:48 user nova-compute[72773]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 16 22:20:48 user nova-compute[72773]:     <cpu>
Aug 16 22:20:48 user nova-compute[72773]:       <arch>x86_64</arch>
Aug 16 22:20:48 user nova-compute[72773]:       <model>IvyBridge-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <vendor>Intel</vendor>
Aug 16 22:20:48 user nova-compute[72773]:       <microcode version='1070'/>
Aug 16 22:20:48 user nova-compute[72773]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 16 22:20:48 user nova-compute[72773]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature name='ss'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature name='vmx'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature name='pcid'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature name='osxsave'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature name='hypervisor'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature name='arat'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature name='tsc_adjust'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature name='md-clear'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature name='stibp'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature name='arch-capabilities'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature name='ssbd'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature name='invtsc'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature name='rsba'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature name='skip-l1dfl-vmentry'/>
Aug 16 22:20:48 user nova-compute[72773]:       <pages unit='KiB' size='4'/>
Aug 16 22:20:48 user nova-compute[72773]:       <pages unit='KiB' size='2048'/>
Aug 16 22:20:48 user nova-compute[72773]:     </cpu>
Aug 16 22:20:48 user nova-compute[72773]:     <power_management>
Aug 16 22:20:48 user nova-compute[72773]:       <suspend_mem/>
Aug 16 22:20:48 user nova-compute[72773]:       <suspend_disk/>
Aug 16 22:20:48 user nova-compute[72773]:       <suspend_hybrid/>
Aug 16 22:20:48 user nova-compute[72773]:     </power_management>
Aug 16 22:20:48 user nova-compute[72773]:     <iommu support='no'/>
Aug 16 22:20:48 user nova-compute[72773]:     <migration_features>
Aug 16 22:20:48 user nova-compute[72773]:       <live/>
Aug 16 22:20:48 user nova-compute[72773]:       <uri_transports>
Aug 16 22:20:48 user nova-compute[72773]:         <uri_transport>tcp</uri_transport>
Aug 16 22:20:48 user nova-compute[72773]:         <uri_transport>rdma</uri_transport>
Aug 16 22:20:48 user nova-compute[72773]:       </uri_transports>
Aug 16 22:20:48 user nova-compute[72773]:     </migration_features>
Aug 16 22:20:48 user nova-compute[72773]:     <topology>
Aug 16 22:20:48 user nova-compute[72773]:       <cells num='2'>
Aug 16 22:20:48 user nova-compute[72773]:         <cell id='0'>
Aug 16 22:20:48 user nova-compute[72773]:           <memory unit='KiB'>8140616</memory>
Aug 16 22:20:48 user nova-compute[72773]:           <pages unit='KiB' size='4'>2035154</pages>
Aug 16 22:20:48 user nova-compute[72773]:           <pages unit='KiB' size='2048'>0</pages>
Aug 16 22:20:48 user nova-compute[72773]:           <distances>
Aug 16 22:20:48 user nova-compute[72773]:             <sibling id='0' value='10'/>
Aug 16 22:20:48 user nova-compute[72773]:             <sibling id='1' value='20'/>
Aug 16 22:20:48 user nova-compute[72773]:           </distances>
Aug 16 22:20:48 user nova-compute[72773]:           <cpus num='6'>
Aug 16 22:20:48 user nova-compute[72773]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 16 22:20:48 user nova-compute[72773]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 16 22:20:48 user nova-compute[72773]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 16 22:20:48 user nova-compute[72773]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 16 22:20:48 user nova-compute[72773]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 16 22:20:48 user nova-compute[72773]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 16 22:20:48 user nova-compute[72773]:           </cpus>
Aug 16 22:20:48 user nova-compute[72773]:         </cell>
Aug 16 22:20:48 user nova-compute[72773]:         <cell id='1'>
Aug 16 22:20:48 user nova-compute[72773]:           <memory unit='KiB'>8255068</memory>
Aug 16 22:20:48 user nova-compute[72773]:           <pages unit='KiB' size='4'>2063767</pages>
Aug 16 22:20:48 user nova-compute[72773]:           <pages unit='KiB' size='2048'>0</pages>
Aug 16 22:20:48 user nova-compute[72773]:           <distances>
Aug 16 22:20:48 user nova-compute[72773]:             <sibling id='0' value='20'/>
Aug 16 22:20:48 user nova-compute[72773]:             <sibling id='1' value='10'/>
Aug 16 22:20:48 user nova-compute[72773]:           </distances>
Aug 16 22:20:48 user nova-compute[72773]:           <cpus num='6'>
Aug 16 22:20:48 user nova-compute[72773]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 16 22:20:48 user nova-compute[72773]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 16 22:20:48 user nova-compute[72773]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 16 22:20:48 user nova-compute[72773]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 16 22:20:48 user nova-compute[72773]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 16 22:20:48 user nova-compute[72773]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 16 22:20:48 user nova-compute[72773]:           </cpus>
Aug 16 22:20:48 user nova-compute[72773]:         </cell>
Aug 16 22:20:48 user nova-compute[72773]:       </cells>
Aug 16 22:20:48 user nova-compute[72773]:     </topology>
Aug 16 22:20:48 user nova-compute[72773]:     <cache>
Aug 16 22:20:48 user nova-compute[72773]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 16 22:20:48 user nova-compute[72773]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 16 22:20:48 user nova-compute[72773]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 16 22:20:48 user nova-compute[72773]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 16 22:20:48 user nova-compute[72773]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 16 22:20:48 user nova-compute[72773]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 16 22:20:48 user nova-compute[72773]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 16 22:20:48 user nova-compute[72773]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 16 22:20:48 user nova-compute[72773]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 16 22:20:48 user nova-compute[72773]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 16 22:20:48 user nova-compute[72773]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 16 22:20:48 user nova-compute[72773]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 16 22:20:48 user nova-compute[72773]:     </cache>
Aug 16 22:20:48 user nova-compute[72773]:     <secmodel>
Aug 16 22:20:48 user nova-compute[72773]:       <model>apparmor</model>
Aug 16 22:20:48 user nova-compute[72773]:       <doi>0</doi>
Aug 16 22:20:48 user nova-compute[72773]:     </secmodel>
Aug 16 22:20:48 user nova-compute[72773]:     <secmodel>
Aug 16 22:20:48 user nova-compute[72773]:       <model>dac</model>
Aug 16 22:20:48 user nova-compute[72773]:       <doi>0</doi>
Aug 16 22:20:48 user nova-compute[72773]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 16 22:20:48 user nova-compute[72773]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 16 22:20:48 user nova-compute[72773]:     </secmodel>
Aug 16 22:20:48 user nova-compute[72773]:   </host>
Aug 16 22:20:48 user nova-compute[72773]:   <guest>
Aug 16 22:20:48 user nova-compute[72773]:     <os_type>hvm</os_type>
Aug 16 22:20:48 user nova-compute[72773]:     <arch name='alpha'>
Aug 16 22:20:48 user nova-compute[72773]:       <wordsize>64</wordsize>
Aug 16 22:20:48 user nova-compute[72773]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='4'>clipper</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <domain type='qemu'/>
Aug 16 22:20:48 user nova-compute[72773]:     </arch>
Aug 16 22:20:48 user nova-compute[72773]:     <features>
Aug 16 22:20:48 user nova-compute[72773]:       <cpuselection/>
Aug 16 22:20:48 user nova-compute[72773]:       <deviceboot/>
Aug 16 22:20:48 user nova-compute[72773]:       <disksnapshot default='on' toggle='no'/>
Aug 16 22:20:48 user nova-compute[72773]:     </features>
Aug 16 22:20:48 user nova-compute[72773]:   </guest>
Aug 16 22:20:48 user nova-compute[72773]:   <guest>
Aug 16 22:20:48 user nova-compute[72773]:     <os_type>hvm</os_type>
Aug 16 22:20:48 user nova-compute[72773]:     <arch name='armv6l'>
Aug 16 22:20:48 user nova-compute[72773]:       <wordsize>32</wordsize>
Aug 16 22:20:48 user nova-compute[72773]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>integratorcp</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>borzoi</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>spitz</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>nuri</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>musca-b1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>versatileab</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>kzm</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>musca-a</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>smdkc210</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>sx1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>z2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>tosa</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='4'>sabrelite</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>realview-eb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>n810</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>n800</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>versatilepb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>terrier</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>mainstone</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='4'>midway</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>musicpal</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>microbit</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>cubieboard</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>verdex</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>netduino2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='4'>raspi2b</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>cheetah</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='4'>highbank</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>akita</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>connex</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>collie</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>raspi0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <domain type='qemu'/>
Aug 16 22:20:48 user nova-compute[72773]:     </arch>
Aug 16 22:20:48 user nova-compute[72773]:     <features>
Aug 16 22:20:48 user nova-compute[72773]:       <cpuselection/>
Aug 16 22:20:48 user nova-compute[72773]:       <deviceboot/>
Aug 16 22:20:48 user nova-compute[72773]:       <disksnapshot default='on' toggle='no'/>
Aug 16 22:20:48 user nova-compute[72773]:     </features>
Aug 16 22:20:48 user nova-compute[72773]:   </guest>
Aug 16 22:20:48 user nova-compute[72773]:   <guest>
Aug 16 22:20:48 user nova-compute[72773]:     <os_type>hvm</os_type>
Aug 16 22:20:48 user nova-compute[72773]:     <arch name='armv7l'>
Aug 16 22:20:48 user nova-compute[72773]:       <wordsize>32</wordsize>
Aug 16 22:20:48 user nova-compute[72773]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>integratorcp</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>borzoi</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>spitz</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>nuri</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>musca-b1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>versatileab</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>kzm</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>musca-a</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>smdkc210</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>sx1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>z2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>tosa</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='4'>sabrelite</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>realview-eb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>n810</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>n800</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>versatilepb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>terrier</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>mainstone</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='4'>midway</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>musicpal</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>microbit</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>cubieboard</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>verdex</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>netduino2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='4'>raspi2b</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>cheetah</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='4'>highbank</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>akita</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>connex</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>collie</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>raspi0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <domain type='qemu'/>
Aug 16 22:20:48 user nova-compute[72773]:     </arch>
Aug 16 22:20:48 user nova-compute[72773]:     <features>
Aug 16 22:20:48 user nova-compute[72773]:       <cpuselection/>
Aug 16 22:20:48 user nova-compute[72773]:       <deviceboot/>
Aug 16 22:20:48 user nova-compute[72773]:       <disksnapshot default='on' toggle='no'/>
Aug 16 22:20:48 user nova-compute[72773]:     </features>
Aug 16 22:20:48 user nova-compute[72773]:   </guest>
Aug 16 22:20:48 user nova-compute[72773]:   <guest>
Aug 16 22:20:48 user nova-compute[72773]:     <os_type>hvm</os_type>
Aug 16 22:20:48 user nova-compute[72773]:     <arch name='aarch64'>
Aug 16 22:20:48 user nova-compute[72773]:       <wordsize>64</wordsize>
Aug 16 22:20:48 user nova-compute[72773]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>integratorcp</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>borzoi</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>spitz</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>nuri</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>musca-b1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>versatileab</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>kzm</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>musca-a</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>smdkc210</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>sx1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>z2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>tosa</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='4'>sabrelite</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>realview-eb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>n810</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>n800</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>versatilepb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>terrier</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>mainstone</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='4'>midway</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>musicpal</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>microbit</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>cubieboard</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>verdex</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>netduino2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='4'>raspi3b</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='4'>raspi2b</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>cheetah</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='4'>highbank</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>akita</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>connex</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>collie</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>raspi0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <domain type='qemu'/>
Aug 16 22:20:48 user nova-compute[72773]:     </arch>
Aug 16 22:20:48 user nova-compute[72773]:     <features>
Aug 16 22:20:48 user nova-compute[72773]:       <acpi default='on' toggle='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:       <cpuselection/>
Aug 16 22:20:48 user nova-compute[72773]:       <deviceboot/>
Aug 16 22:20:48 user nova-compute[72773]:       <disksnapshot default='on' toggle='no'/>
Aug 16 22:20:48 user nova-compute[72773]:     </features>
Aug 16 22:20:48 user nova-compute[72773]:   </guest>
Aug 16 22:20:48 user nova-compute[72773]:   <guest>
Aug 16 22:20:48 user nova-compute[72773]:     <os_type>hvm</os_type>
Aug 16 22:20:48 user nova-compute[72773]:     <arch name='cris'>
Aug 16 22:20:48 user nova-compute[72773]:       <wordsize>32</wordsize>
Aug 16 22:20:48 user nova-compute[72773]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <domain type='qemu'/>
Aug 16 22:20:48 user nova-compute[72773]:     </arch>
Aug 16 22:20:48 user nova-compute[72773]:     <features>
Aug 16 22:20:48 user nova-compute[72773]:       <cpuselection/>
Aug 16 22:20:48 user nova-compute[72773]:       <deviceboot/>
Aug 16 22:20:48 user nova-compute[72773]:       <disksnapshot default='on' toggle='no'/>
Aug 16 22:20:48 user nova-compute[72773]:     </features>
Aug 16 22:20:48 user nova-compute[72773]:   </guest>
Aug 16 22:20:48 user nova-compute[72773]:   <guest>
Aug 16 22:20:48 user nova-compute[72773]:     <os_type>hvm</os_type>
Aug 16 22:20:48 user nova-compute[72773]:     <arch name='i686'>
Aug 16 22:20:48 user nova-compute[72773]:       <wordsize>32</wordsize>
Aug 16 22:20:48 user nova-compute[72773]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>x-remote</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>isapc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>microvm</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <domain type='qemu'/>
Aug 16 22:20:48 user nova-compute[72773]:       <domain type='kvm'/>
Aug 16 22:20:48 user nova-compute[72773]:     </arch>
Aug 16 22:20:48 user nova-compute[72773]:     <features>
Aug 16 22:20:48 user nova-compute[72773]:       <pae/>
Aug 16 22:20:48 user nova-compute[72773]:       <nonpae/>
Aug 16 22:20:48 user nova-compute[72773]:       <acpi default='on' toggle='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:       <apic default='on' toggle='no'/>
Aug 16 22:20:48 user nova-compute[72773]:       <cpuselection/>
Aug 16 22:20:48 user nova-compute[72773]:       <deviceboot/>
Aug 16 22:20:48 user nova-compute[72773]:       <disksnapshot default='on' toggle='no'/>
Aug 16 22:20:48 user nova-compute[72773]:     </features>
Aug 16 22:20:48 user nova-compute[72773]:   </guest>
Aug 16 22:20:48 user nova-compute[72773]:   <guest>
Aug 16 22:20:48 user nova-compute[72773]:     <os_type>hvm</os_type>
Aug 16 22:20:48 user nova-compute[72773]:     <arch name='m68k'>
Aug 16 22:20:48 user nova-compute[72773]:       <wordsize>32</wordsize>
Aug 16 22:20:48 user nova-compute[72773]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>an5206</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>q800</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>next-cube</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <domain type='qemu'/>
Aug 16 22:20:48 user nova-compute[72773]:     </arch>
Aug 16 22:20:48 user nova-compute[72773]:     <features>
Aug 16 22:20:48 user nova-compute[72773]:       <cpuselection/>
Aug 16 22:20:48 user nova-compute[72773]:       <deviceboot/>
Aug 16 22:20:48 user nova-compute[72773]:       <disksnapshot default='on' toggle='no'/>
Aug 16 22:20:48 user nova-compute[72773]:     </features>
Aug 16 22:20:48 user nova-compute[72773]:   </guest>
Aug 16 22:20:48 user nova-compute[72773]:   <guest>
Aug 16 22:20:48 user nova-compute[72773]:     <os_type>hvm</os_type>
Aug 16 22:20:48 user nova-compute[72773]:     <arch name='microblaze'>
Aug 16 22:20:48 user nova-compute[72773]:       <wordsize>32</wordsize>
Aug 16 22:20:48 user nova-compute[72773]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <domain type='qemu'/>
Aug 16 22:20:48 user nova-compute[72773]:     </arch>
Aug 16 22:20:48 user nova-compute[72773]:     <features>
Aug 16 22:20:48 user nova-compute[72773]:       <cpuselection/>
Aug 16 22:20:48 user nova-compute[72773]:       <deviceboot/>
Aug 16 22:20:48 user nova-compute[72773]:       <disksnapshot default='on' toggle='no'/>
Aug 16 22:20:48 user nova-compute[72773]:     </features>
Aug 16 22:20:48 user nova-compute[72773]:   </guest>
Aug 16 22:20:48 user nova-compute[72773]:   <guest>
Aug 16 22:20:48 user nova-compute[72773]:     <os_type>hvm</os_type>
Aug 16 22:20:48 user nova-compute[72773]:     <arch name='microblazeel'>
Aug 16 22:20:48 user nova-compute[72773]:       <wordsize>32</wordsize>
Aug 16 22:20:48 user nova-compute[72773]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <domain type='qemu'/>
Aug 16 22:20:48 user nova-compute[72773]:     </arch>
Aug 16 22:20:48 user nova-compute[72773]:     <features>
Aug 16 22:20:48 user nova-compute[72773]:       <cpuselection/>
Aug 16 22:20:48 user nova-compute[72773]:       <deviceboot/>
Aug 16 22:20:48 user nova-compute[72773]:       <disksnapshot default='on' toggle='no'/>
Aug 16 22:20:48 user nova-compute[72773]:     </features>
Aug 16 22:20:48 user nova-compute[72773]:   </guest>
Aug 16 22:20:48 user nova-compute[72773]:   <guest>
Aug 16 22:20:48 user nova-compute[72773]:     <os_type>hvm</os_type>
Aug 16 22:20:48 user nova-compute[72773]:     <arch name='mips'>
Aug 16 22:20:48 user nova-compute[72773]:       <wordsize>32</wordsize>
Aug 16 22:20:48 user nova-compute[72773]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='16'>malta</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <domain type='qemu'/>
Aug 16 22:20:48 user nova-compute[72773]:     </arch>
Aug 16 22:20:48 user nova-compute[72773]:     <features>
Aug 16 22:20:48 user nova-compute[72773]:       <cpuselection/>
Aug 16 22:20:48 user nova-compute[72773]:       <deviceboot/>
Aug 16 22:20:48 user nova-compute[72773]:       <disksnapshot default='on' toggle='no'/>
Aug 16 22:20:48 user nova-compute[72773]:     </features>
Aug 16 22:20:48 user nova-compute[72773]:   </guest>
Aug 16 22:20:48 user nova-compute[72773]:   <guest>
Aug 16 22:20:48 user nova-compute[72773]:     <os_type>hvm</os_type>
Aug 16 22:20:48 user nova-compute[72773]:     <arch name='mipsel'>
Aug 16 22:20:48 user nova-compute[72773]:       <wordsize>32</wordsize>
Aug 16 22:20:48 user nova-compute[72773]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='16'>malta</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <domain type='qemu'/>
Aug 16 22:20:48 user nova-compute[72773]:     </arch>
Aug 16 22:20:48 user nova-compute[72773]:     <features>
Aug 16 22:20:48 user nova-compute[72773]:       <cpuselection/>
Aug 16 22:20:48 user nova-compute[72773]:       <deviceboot/>
Aug 16 22:20:48 user nova-compute[72773]:       <disksnapshot default='on' toggle='no'/>
Aug 16 22:20:48 user nova-compute[72773]:     </features>
Aug 16 22:20:48 user nova-compute[72773]:   </guest>
Aug 16 22:20:48 user nova-compute[72773]:   <guest>
Aug 16 22:20:48 user nova-compute[72773]:     <os_type>hvm</os_type>
Aug 16 22:20:48 user nova-compute[72773]:     <arch name='mips64'>
Aug 16 22:20:48 user nova-compute[72773]:       <wordsize>64</wordsize>
Aug 16 22:20:48 user nova-compute[72773]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='16'>malta</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>pica61</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>magnum</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <domain type='qemu'/>
Aug 16 22:20:48 user nova-compute[72773]:     </arch>
Aug 16 22:20:48 user nova-compute[72773]:     <features>
Aug 16 22:20:48 user nova-compute[72773]:       <cpuselection/>
Aug 16 22:20:48 user nova-compute[72773]:       <deviceboot/>
Aug 16 22:20:48 user nova-compute[72773]:       <disksnapshot default='on' toggle='no'/>
Aug 16 22:20:48 user nova-compute[72773]:     </features>
Aug 16 22:20:48 user nova-compute[72773]:   </guest>
Aug 16 22:20:48 user nova-compute[72773]:   <guest>
Aug 16 22:20:48 user nova-compute[72773]:     <os_type>hvm</os_type>
Aug 16 22:20:48 user nova-compute[72773]:     <arch name='mips64el'>
Aug 16 22:20:48 user nova-compute[72773]:       <wordsize>64</wordsize>
Aug 16 22:20:48 user nova-compute[72773]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='16'>malta</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>pica61</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>magnum</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='16'>boston</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <domain type='qemu'/>
Aug 16 22:20:48 user nova-compute[72773]:     </arch>
Aug 16 22:20:48 user nova-compute[72773]:     <features>
Aug 16 22:20:48 user nova-compute[72773]:       <cpuselection/>
Aug 16 22:20:48 user nova-compute[72773]:       <deviceboot/>
Aug 16 22:20:48 user nova-compute[72773]:       <disksnapshot default='on' toggle='no'/>
Aug 16 22:20:48 user nova-compute[72773]:     </features>
Aug 16 22:20:48 user nova-compute[72773]:   </guest>
Aug 16 22:20:48 user nova-compute[72773]:   <guest>
Aug 16 22:20:48 user nova-compute[72773]:     <os_type>hvm</os_type>
Aug 16 22:20:48 user nova-compute[72773]:     <arch name='ppc'>
Aug 16 22:20:48 user nova-compute[72773]:       <wordsize>32</wordsize>
Aug 16 22:20:48 user nova-compute[72773]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>g3beige</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>mac99</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='32'>ppce500</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>pegasos2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>sam460ex</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>bamboo</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>40p</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>ref405ep</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>taihu</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <domain type='qemu'/>
Aug 16 22:20:48 user nova-compute[72773]:     </arch>
Aug 16 22:20:48 user nova-compute[72773]:     <features>
Aug 16 22:20:48 user nova-compute[72773]:       <cpuselection/>
Aug 16 22:20:48 user nova-compute[72773]:       <deviceboot/>
Aug 16 22:20:48 user nova-compute[72773]:       <disksnapshot default='on' toggle='no'/>
Aug 16 22:20:48 user nova-compute[72773]:     </features>
Aug 16 22:20:48 user nova-compute[72773]:   </guest>
Aug 16 22:20:48 user nova-compute[72773]:   <guest>
Aug 16 22:20:48 user nova-compute[72773]:     <os_type>hvm</os_type>
Aug 16 22:20:48 user nova-compute[72773]:     <arch name='ppc64'>
Aug 16 22:20:48 user nova-compute[72773]:       <wordsize>64</wordsize>
Aug 16 22:20:48 user nova-compute[72773]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2048'>powernv9</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>taihu</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2048'>powernv10</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='32'>ppce500</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>40p</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>pegasos2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>bamboo</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>g3beige</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>mac99</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>sam460ex</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>ref405ep</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2048'>powernv8</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <domain type='qemu'/>
Aug 16 22:20:48 user nova-compute[72773]:     </arch>
Aug 16 22:20:48 user nova-compute[72773]:     <features>
Aug 16 22:20:48 user nova-compute[72773]:       <cpuselection/>
Aug 16 22:20:48 user nova-compute[72773]:       <deviceboot/>
Aug 16 22:20:48 user nova-compute[72773]:       <disksnapshot default='on' toggle='no'/>
Aug 16 22:20:48 user nova-compute[72773]:     </features>
Aug 16 22:20:48 user nova-compute[72773]:   </guest>
Aug 16 22:20:48 user nova-compute[72773]:   <guest>
Aug 16 22:20:48 user nova-compute[72773]:     <os_type>hvm</os_type>
Aug 16 22:20:48 user nova-compute[72773]:     <arch name='ppc64le'>
Aug 16 22:20:48 user nova-compute[72773]:       <wordsize>64</wordsize>
Aug 16 22:20:48 user nova-compute[72773]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2048'>powernv9</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>taihu</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2048'>powernv10</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='32'>ppce500</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>40p</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>pegasos2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>bamboo</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>g3beige</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>mac99</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>sam460ex</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>ref405ep</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2048'>powernv8</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <domain type='qemu'/>
Aug 16 22:20:48 user nova-compute[72773]:     </arch>
Aug 16 22:20:48 user nova-compute[72773]:     <features>
Aug 16 22:20:48 user nova-compute[72773]:       <cpuselection/>
Aug 16 22:20:48 user nova-compute[72773]:       <deviceboot/>
Aug 16 22:20:48 user nova-compute[72773]:       <disksnapshot default='on' toggle='no'/>
Aug 16 22:20:48 user nova-compute[72773]:     </features>
Aug 16 22:20:48 user nova-compute[72773]:   </guest>
Aug 16 22:20:48 user nova-compute[72773]:   <guest>
Aug 16 22:20:48 user nova-compute[72773]:     <os_type>hvm</os_type>
Aug 16 22:20:48 user nova-compute[72773]:     <arch name='riscv32'>
Aug 16 22:20:48 user nova-compute[72773]:       <wordsize>32</wordsize>
Aug 16 22:20:48 user nova-compute[72773]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='8'>spike</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>opentitan</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='5'>sifive_u</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>sifive_e</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='8'>virt</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <domain type='qemu'/>
Aug 16 22:20:48 user nova-compute[72773]:     </arch>
Aug 16 22:20:48 user nova-compute[72773]:     <features>
Aug 16 22:20:48 user nova-compute[72773]:       <cpuselection/>
Aug 16 22:20:48 user nova-compute[72773]:       <deviceboot/>
Aug 16 22:20:48 user nova-compute[72773]:       <disksnapshot default='on' toggle='no'/>
Aug 16 22:20:48 user nova-compute[72773]:     </features>
Aug 16 22:20:48 user nova-compute[72773]:   </guest>
Aug 16 22:20:48 user nova-compute[72773]:   <guest>
Aug 16 22:20:48 user nova-compute[72773]:     <os_type>hvm</os_type>
Aug 16 22:20:48 user nova-compute[72773]:     <arch name='riscv64'>
Aug 16 22:20:48 user nova-compute[72773]:       <wordsize>64</wordsize>
Aug 16 22:20:48 user nova-compute[72773]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='8'>spike</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='5'>sifive_u</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>shakti_c</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>sifive_e</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='8'>virt</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <domain type='qemu'/>
Aug 16 22:20:48 user nova-compute[72773]:     </arch>
Aug 16 22:20:48 user nova-compute[72773]:     <features>
Aug 16 22:20:48 user nova-compute[72773]:       <cpuselection/>
Aug 16 22:20:48 user nova-compute[72773]:       <deviceboot/>
Aug 16 22:20:48 user nova-compute[72773]:       <disksnapshot default='on' toggle='no'/>
Aug 16 22:20:48 user nova-compute[72773]:     </features>
Aug 16 22:20:48 user nova-compute[72773]:   </guest>
Aug 16 22:20:48 user nova-compute[72773]:   <guest>
Aug 16 22:20:48 user nova-compute[72773]:     <os_type>hvm</os_type>
Aug 16 22:20:48 user nova-compute[72773]:     <arch name='s390x'>
Aug 16 22:20:48 user nova-compute[72773]:       <wordsize>64</wordsize>
Aug 16 22:20:48 user nova-compute[72773]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <domain type='qemu'/>
Aug 16 22:20:48 user nova-compute[72773]:     </arch>
Aug 16 22:20:48 user nova-compute[72773]:     <features>
Aug 16 22:20:48 user nova-compute[72773]:       <cpuselection/>
Aug 16 22:20:48 user nova-compute[72773]:       <deviceboot/>
Aug 16 22:20:48 user nova-compute[72773]:       <disksnapshot default='on' toggle='no'/>
Aug 16 22:20:48 user nova-compute[72773]:     </features>
Aug 16 22:20:48 user nova-compute[72773]:   </guest>
Aug 16 22:20:48 user nova-compute[72773]:   <guest>
Aug 16 22:20:48 user nova-compute[72773]:     <os_type>hvm</os_type>
Aug 16 22:20:48 user nova-compute[72773]:     <arch name='sh4'>
Aug 16 22:20:48 user nova-compute[72773]:       <wordsize>32</wordsize>
Aug 16 22:20:48 user nova-compute[72773]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>shix</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>r2d</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <domain type='qemu'/>
Aug 16 22:20:48 user nova-compute[72773]:     </arch>
Aug 16 22:20:48 user nova-compute[72773]:     <features>
Aug 16 22:20:48 user nova-compute[72773]:       <cpuselection/>
Aug 16 22:20:48 user nova-compute[72773]:       <deviceboot/>
Aug 16 22:20:48 user nova-compute[72773]:       <disksnapshot default='on' toggle='no'/>
Aug 16 22:20:48 user nova-compute[72773]:     </features>
Aug 16 22:20:48 user nova-compute[72773]:   </guest>
Aug 16 22:20:48 user nova-compute[72773]:   <guest>
Aug 16 22:20:48 user nova-compute[72773]:     <os_type>hvm</os_type>
Aug 16 22:20:48 user nova-compute[72773]:     <arch name='sh4eb'>
Aug 16 22:20:48 user nova-compute[72773]:       <wordsize>64</wordsize>
Aug 16 22:20:48 user nova-compute[72773]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>shix</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>r2d</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <domain type='qemu'/>
Aug 16 22:20:48 user nova-compute[72773]:     </arch>
Aug 16 22:20:48 user nova-compute[72773]:     <features>
Aug 16 22:20:48 user nova-compute[72773]:       <cpuselection/>
Aug 16 22:20:48 user nova-compute[72773]:       <deviceboot/>
Aug 16 22:20:48 user nova-compute[72773]:       <disksnapshot default='on' toggle='no'/>
Aug 16 22:20:48 user nova-compute[72773]:     </features>
Aug 16 22:20:48 user nova-compute[72773]:   </guest>
Aug 16 22:20:48 user nova-compute[72773]:   <guest>
Aug 16 22:20:48 user nova-compute[72773]:     <os_type>hvm</os_type>
Aug 16 22:20:48 user nova-compute[72773]:     <arch name='sparc'>
Aug 16 22:20:48 user nova-compute[72773]:       <wordsize>32</wordsize>
Aug 16 22:20:48 user nova-compute[72773]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>SS-5</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='4'>SS-20</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>LX</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>SS-4</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='4'>SS-10</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>Voyager</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <domain type='qemu'/>
Aug 16 22:20:48 user nova-compute[72773]:     </arch>
Aug 16 22:20:48 user nova-compute[72773]:     <features>
Aug 16 22:20:48 user nova-compute[72773]:       <cpuselection/>
Aug 16 22:20:48 user nova-compute[72773]:       <deviceboot/>
Aug 16 22:20:48 user nova-compute[72773]:       <disksnapshot default='on' toggle='no'/>
Aug 16 22:20:48 user nova-compute[72773]:     </features>
Aug 16 22:20:48 user nova-compute[72773]:   </guest>
Aug 16 22:20:48 user nova-compute[72773]:   <guest>
Aug 16 22:20:48 user nova-compute[72773]:     <os_type>hvm</os_type>
Aug 16 22:20:48 user nova-compute[72773]:     <arch name='sparc64'>
Aug 16 22:20:48 user nova-compute[72773]:       <wordsize>64</wordsize>
Aug 16 22:20:48 user nova-compute[72773]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>sun4u</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>niagara</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>sun4v</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <domain type='qemu'/>
Aug 16 22:20:48 user nova-compute[72773]:     </arch>
Aug 16 22:20:48 user nova-compute[72773]:     <features>
Aug 16 22:20:48 user nova-compute[72773]:       <cpuselection/>
Aug 16 22:20:48 user nova-compute[72773]:       <deviceboot/>
Aug 16 22:20:48 user nova-compute[72773]:       <disksnapshot default='on' toggle='no'/>
Aug 16 22:20:48 user nova-compute[72773]:     </features>
Aug 16 22:20:48 user nova-compute[72773]:   </guest>
Aug 16 22:20:48 user nova-compute[72773]:   <guest>
Aug 16 22:20:48 user nova-compute[72773]:     <os_type>hvm</os_type>
Aug 16 22:20:48 user nova-compute[72773]:     <arch name='x86_64'>
Aug 16 22:20:48 user nova-compute[72773]:       <wordsize>64</wordsize>
Aug 16 22:20:48 user nova-compute[72773]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>x-remote</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='1'>isapc</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>microvm</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <domain type='qemu'/>
Aug 16 22:20:48 user nova-compute[72773]:       <domain type='kvm'/>
Aug 16 22:20:48 user nova-compute[72773]:     </arch>
Aug 16 22:20:48 user nova-compute[72773]:     <features>
Aug 16 22:20:48 user nova-compute[72773]:       <acpi default='on' toggle='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:       <apic default='on' toggle='no'/>
Aug 16 22:20:48 user nova-compute[72773]:       <cpuselection/>
Aug 16 22:20:48 user nova-compute[72773]:       <deviceboot/>
Aug 16 22:20:48 user nova-compute[72773]:       <disksnapshot default='on' toggle='no'/>
Aug 16 22:20:48 user nova-compute[72773]:     </features>
Aug 16 22:20:48 user nova-compute[72773]:   </guest>
Aug 16 22:20:48 user nova-compute[72773]:   <guest>
Aug 16 22:20:48 user nova-compute[72773]:     <os_type>hvm</os_type>
Aug 16 22:20:48 user nova-compute[72773]:     <arch name='xtensa'>
Aug 16 22:20:48 user nova-compute[72773]:       <wordsize>32</wordsize>
Aug 16 22:20:48 user nova-compute[72773]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='4'>sim</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='32'>kc705</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='32'>ml605</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='32'>virt</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='32'>lx200</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='32'>lx60</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <domain type='qemu'/>
Aug 16 22:20:48 user nova-compute[72773]:     </arch>
Aug 16 22:20:48 user nova-compute[72773]:     <features>
Aug 16 22:20:48 user nova-compute[72773]:       <cpuselection/>
Aug 16 22:20:48 user nova-compute[72773]:       <deviceboot/>
Aug 16 22:20:48 user nova-compute[72773]:       <disksnapshot default='on' toggle='no'/>
Aug 16 22:20:48 user nova-compute[72773]:     </features>
Aug 16 22:20:48 user nova-compute[72773]:   </guest>
Aug 16 22:20:48 user nova-compute[72773]:   <guest>
Aug 16 22:20:48 user nova-compute[72773]:     <os_type>hvm</os_type>
Aug 16 22:20:48 user nova-compute[72773]:     <arch name='xtensaeb'>
Aug 16 22:20:48 user nova-compute[72773]:       <wordsize>32</wordsize>
Aug 16 22:20:48 user nova-compute[72773]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='4'>sim</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='32'>kc705</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='32'>ml605</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='32'>virt</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='32'>lx200</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='32'>lx60</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 16 22:20:48 user nova-compute[72773]:       <domain type='qemu'/>
Aug 16 22:20:48 user nova-compute[72773]:     </arch>
Aug 16 22:20:48 user nova-compute[72773]:     <features>
Aug 16 22:20:48 user nova-compute[72773]:       <cpuselection/>
Aug 16 22:20:48 user nova-compute[72773]:       <deviceboot/>
Aug 16 22:20:48 user nova-compute[72773]:       <disksnapshot default='on' toggle='no'/>
Aug 16 22:20:48 user nova-compute[72773]:     </features>
Aug 16 22:20:48 user nova-compute[72773]:   </guest>
Aug 16 22:20:48 user nova-compute[72773]: </capabilities>
Aug 16 22:20:48 user nova-compute[72773]: 
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72773) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72773) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72773) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72773) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72773) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72773) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72773) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72773) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72773) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72773) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72773) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Getting domain capabilities for i686 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=72773) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 16 22:20:48 user nova-compute[72773]: <domainCapabilities>
Aug 16 22:20:48 user nova-compute[72773]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 22:20:48 user nova-compute[72773]:   <domain>kvm</domain>
Aug 16 22:20:48 user nova-compute[72773]:   <machine>pc-q35-6.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:   <arch>i686</arch>
Aug 16 22:20:48 user nova-compute[72773]:   <vcpu max='288'/>
Aug 16 22:20:48 user nova-compute[72773]:   <iothreads supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:   <os supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:     <enum name='firmware'/>
Aug 16 22:20:48 user nova-compute[72773]:     <loader supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='type'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>rom</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>pflash</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='readonly'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>yes</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>no</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='secure'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>no</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </loader>
Aug 16 22:20:48 user nova-compute[72773]:   </os>
Aug 16 22:20:48 user nova-compute[72773]:   <cpu>
Aug 16 22:20:48 user nova-compute[72773]:     <mode name='host-passthrough' supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='hostPassthroughMigratable'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>off</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </mode>
Aug 16 22:20:48 user nova-compute[72773]:     <mode name='maximum' supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='maximumMigratable'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>on</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>off</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </mode>
Aug 16 22:20:48 user nova-compute[72773]:     <mode name='host-model' supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <vendor>Intel</vendor>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='ss'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='vmx'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='pcid'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='hypervisor'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='arat'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='umip'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='md-clear'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='stibp'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='ssbd'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='ibpb'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='ibrs'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='amd-stibp'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='disable' name='erms'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='disable' name='lm'/>
Aug 16 22:20:48 user nova-compute[72773]:     </mode>
Aug 16 22:20:48 user nova-compute[72773]:     <mode name='custom' supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>qemu64</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>qemu32</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>phenom</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>pentium3</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>pentium2</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>pentium</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>n270</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>kvm64</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>kvm32</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>coreduo</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>core2duo</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>athlon</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Westmere</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Snowridge</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Server</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Client</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>SandyBridge</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Penryn</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G5</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G4</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G3</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G2</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G1</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Nehalem</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>IvyBridge</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Icelake-Server</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Haswell</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>EPYC-Rome</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>EPYC-Milan</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>EPYC</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Dhyana</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Cooperlake</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Conroe</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Broadwell</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>486</model>
Aug 16 22:20:48 user nova-compute[72773]:     </mode>
Aug 16 22:20:48 user nova-compute[72773]:   </cpu>
Aug 16 22:20:48 user nova-compute[72773]:   <memoryBacking supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:     <enum name='sourceType'>
Aug 16 22:20:48 user nova-compute[72773]:       <value>file</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>anonymous</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>memfd</value>
Aug 16 22:20:48 user nova-compute[72773]:     </enum>
Aug 16 22:20:48 user nova-compute[72773]:   </memoryBacking>
Aug 16 22:20:48 user nova-compute[72773]:   <devices>
Aug 16 22:20:48 user nova-compute[72773]:     <disk supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='diskDevice'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>disk</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>cdrom</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>floppy</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>lun</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='bus'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>fdc</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>scsi</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>usb</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>sata</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='model'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio-transitional</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio-non-transitional</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </disk>
Aug 16 22:20:48 user nova-compute[72773]:     <graphics supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='type'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>sdl</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>vnc</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>spice</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>egl-headless</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </graphics>
Aug 16 22:20:48 user nova-compute[72773]:     <video supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='modelType'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>vga</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>cirrus</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>vmvga</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>qxl</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>none</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>bochs</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>ramfb</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </video>
Aug 16 22:20:48 user nova-compute[72773]:     <hostdev supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='mode'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>subsystem</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='startupPolicy'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>default</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>mandatory</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>requisite</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>optional</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='subsysType'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>usb</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>pci</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>scsi</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='capsType'/>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='pciBackend'/>
Aug 16 22:20:48 user nova-compute[72773]:     </hostdev>
Aug 16 22:20:48 user nova-compute[72773]:     <rng supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='model'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio-transitional</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio-non-transitional</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='backendModel'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>random</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>egd</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>builtin</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </rng>
Aug 16 22:20:48 user nova-compute[72773]:     <filesystem supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='driverType'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>path</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>handle</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtiofs</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </filesystem>
Aug 16 22:20:48 user nova-compute[72773]:     <tpm supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='model'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>tpm-tis</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>tpm-crb</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='backendModel'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>passthrough</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>emulator</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </tpm>
Aug 16 22:20:48 user nova-compute[72773]:   </devices>
Aug 16 22:20:48 user nova-compute[72773]:   <features>
Aug 16 22:20:48 user nova-compute[72773]:     <gic supported='no'/>
Aug 16 22:20:48 user nova-compute[72773]:     <vmcoreinfo supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:     <genid supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:     <backingStoreInput supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:     <backup supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:     <sev supported='no'/>
Aug 16 22:20:48 user nova-compute[72773]:   </features>
Aug 16 22:20:48 user nova-compute[72773]: </domainCapabilities>
Aug 16 22:20:48 user nova-compute[72773]:  {{(pid=72773) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 16 22:20:48 user nova-compute[72773]: <domainCapabilities>
Aug 16 22:20:48 user nova-compute[72773]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 22:20:48 user nova-compute[72773]:   <domain>kvm</domain>
Aug 16 22:20:48 user nova-compute[72773]:   <machine>pc-i440fx-6.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:   <arch>i686</arch>
Aug 16 22:20:48 user nova-compute[72773]:   <vcpu max='255'/>
Aug 16 22:20:48 user nova-compute[72773]:   <iothreads supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:   <os supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:     <enum name='firmware'/>
Aug 16 22:20:48 user nova-compute[72773]:     <loader supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='type'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>rom</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>pflash</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='readonly'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>yes</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>no</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='secure'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>no</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </loader>
Aug 16 22:20:48 user nova-compute[72773]:   </os>
Aug 16 22:20:48 user nova-compute[72773]:   <cpu>
Aug 16 22:20:48 user nova-compute[72773]:     <mode name='host-passthrough' supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='hostPassthroughMigratable'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>off</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </mode>
Aug 16 22:20:48 user nova-compute[72773]:     <mode name='maximum' supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='maximumMigratable'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>on</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>off</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </mode>
Aug 16 22:20:48 user nova-compute[72773]:     <mode name='host-model' supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <vendor>Intel</vendor>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='ss'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='vmx'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='pcid'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='hypervisor'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='arat'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='umip'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='md-clear'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='stibp'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='ssbd'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='ibpb'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='ibrs'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='amd-stibp'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='disable' name='erms'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='disable' name='lm'/>
Aug 16 22:20:48 user nova-compute[72773]:     </mode>
Aug 16 22:20:48 user nova-compute[72773]:     <mode name='custom' supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>qemu64</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>qemu32</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>phenom</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>pentium3</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>pentium2</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>pentium</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>n270</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>kvm64</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>kvm32</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>coreduo</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>core2duo</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>athlon</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Westmere</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Snowridge</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Server</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Client</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>SandyBridge</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Penryn</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G5</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G4</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G3</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G2</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G1</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Nehalem</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>IvyBridge</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Icelake-Server</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Haswell</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>EPYC-Rome</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>EPYC-Milan</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>EPYC</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Dhyana</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Cooperlake</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Conroe</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Broadwell</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>486</model>
Aug 16 22:20:48 user nova-compute[72773]:     </mode>
Aug 16 22:20:48 user nova-compute[72773]:   </cpu>
Aug 16 22:20:48 user nova-compute[72773]:   <memoryBacking supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:     <enum name='sourceType'>
Aug 16 22:20:48 user nova-compute[72773]:       <value>file</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>anonymous</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>memfd</value>
Aug 16 22:20:48 user nova-compute[72773]:     </enum>
Aug 16 22:20:48 user nova-compute[72773]:   </memoryBacking>
Aug 16 22:20:48 user nova-compute[72773]:   <devices>
Aug 16 22:20:48 user nova-compute[72773]:     <disk supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='diskDevice'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>disk</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>cdrom</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>floppy</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>lun</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='bus'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>ide</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>fdc</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>scsi</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>usb</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>sata</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='model'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio-transitional</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio-non-transitional</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </disk>
Aug 16 22:20:48 user nova-compute[72773]:     <graphics supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='type'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>sdl</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>vnc</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>spice</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>egl-headless</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </graphics>
Aug 16 22:20:48 user nova-compute[72773]:     <video supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='modelType'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>vga</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>cirrus</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>vmvga</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>qxl</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>none</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>bochs</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>ramfb</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </video>
Aug 16 22:20:48 user nova-compute[72773]:     <hostdev supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='mode'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>subsystem</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='startupPolicy'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>default</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>mandatory</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>requisite</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>optional</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='subsysType'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>usb</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>pci</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>scsi</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='capsType'/>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='pciBackend'/>
Aug 16 22:20:48 user nova-compute[72773]:     </hostdev>
Aug 16 22:20:48 user nova-compute[72773]:     <rng supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='model'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio-transitional</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio-non-transitional</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='backendModel'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>random</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>egd</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>builtin</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </rng>
Aug 16 22:20:48 user nova-compute[72773]:     <filesystem supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='driverType'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>path</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>handle</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtiofs</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </filesystem>
Aug 16 22:20:48 user nova-compute[72773]:     <tpm supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='model'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>tpm-tis</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>tpm-crb</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='backendModel'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>passthrough</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>emulator</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </tpm>
Aug 16 22:20:48 user nova-compute[72773]:   </devices>
Aug 16 22:20:48 user nova-compute[72773]:   <features>
Aug 16 22:20:48 user nova-compute[72773]:     <gic supported='no'/>
Aug 16 22:20:48 user nova-compute[72773]:     <vmcoreinfo supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:     <genid supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:     <backingStoreInput supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:     <backup supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:     <sev supported='no'/>
Aug 16 22:20:48 user nova-compute[72773]:   </features>
Aug 16 22:20:48 user nova-compute[72773]: </domainCapabilities>
Aug 16 22:20:48 user nova-compute[72773]:  {{(pid=72773) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 16 22:20:48 user nova-compute[72773]: <domainCapabilities>
Aug 16 22:20:48 user nova-compute[72773]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 22:20:48 user nova-compute[72773]:   <domain>kvm</domain>
Aug 16 22:20:48 user nova-compute[72773]:   <machine>pc-q35-jammy</machine>
Aug 16 22:20:48 user nova-compute[72773]:   <arch>i686</arch>
Aug 16 22:20:48 user nova-compute[72773]:   <vcpu max='288'/>
Aug 16 22:20:48 user nova-compute[72773]:   <iothreads supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:   <os supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:     <enum name='firmware'/>
Aug 16 22:20:48 user nova-compute[72773]:     <loader supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='type'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>rom</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>pflash</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='readonly'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>yes</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>no</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='secure'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>no</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </loader>
Aug 16 22:20:48 user nova-compute[72773]:   </os>
Aug 16 22:20:48 user nova-compute[72773]:   <cpu>
Aug 16 22:20:48 user nova-compute[72773]:     <mode name='host-passthrough' supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='hostPassthroughMigratable'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>off</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </mode>
Aug 16 22:20:48 user nova-compute[72773]:     <mode name='maximum' supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='maximumMigratable'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>on</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>off</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </mode>
Aug 16 22:20:48 user nova-compute[72773]:     <mode name='host-model' supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <vendor>Intel</vendor>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='ss'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='vmx'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='pcid'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='hypervisor'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='arat'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='umip'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='md-clear'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='stibp'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='ssbd'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='ibpb'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='ibrs'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='amd-stibp'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='disable' name='erms'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='disable' name='lm'/>
Aug 16 22:20:48 user nova-compute[72773]:     </mode>
Aug 16 22:20:48 user nova-compute[72773]:     <mode name='custom' supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>qemu64</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>qemu32</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>phenom</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>pentium3</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>pentium2</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>pentium</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>n270</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>kvm64</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>kvm32</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>coreduo</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>core2duo</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>athlon</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Westmere</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Snowridge</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Server</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Client</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>SandyBridge</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Penryn</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G5</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G4</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G3</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G2</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G1</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Nehalem</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>IvyBridge</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Icelake-Server</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Haswell</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>EPYC-Rome</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>EPYC-Milan</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>EPYC</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Dhyana</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Cooperlake</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Conroe</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Broadwell</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>486</model>
Aug 16 22:20:48 user nova-compute[72773]:     </mode>
Aug 16 22:20:48 user nova-compute[72773]:   </cpu>
Aug 16 22:20:48 user nova-compute[72773]:   <memoryBacking supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:     <enum name='sourceType'>
Aug 16 22:20:48 user nova-compute[72773]:       <value>file</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>anonymous</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>memfd</value>
Aug 16 22:20:48 user nova-compute[72773]:     </enum>
Aug 16 22:20:48 user nova-compute[72773]:   </memoryBacking>
Aug 16 22:20:48 user nova-compute[72773]:   <devices>
Aug 16 22:20:48 user nova-compute[72773]:     <disk supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='diskDevice'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>disk</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>cdrom</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>floppy</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>lun</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='bus'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>fdc</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>scsi</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>usb</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>sata</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='model'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio-transitional</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio-non-transitional</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </disk>
Aug 16 22:20:48 user nova-compute[72773]:     <graphics supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='type'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>sdl</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>vnc</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>spice</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>egl-headless</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </graphics>
Aug 16 22:20:48 user nova-compute[72773]:     <video supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='modelType'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>vga</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>cirrus</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>vmvga</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>qxl</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>none</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>bochs</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>ramfb</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </video>
Aug 16 22:20:48 user nova-compute[72773]:     <hostdev supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='mode'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>subsystem</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='startupPolicy'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>default</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>mandatory</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>requisite</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>optional</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='subsysType'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>usb</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>pci</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>scsi</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='capsType'/>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='pciBackend'/>
Aug 16 22:20:48 user nova-compute[72773]:     </hostdev>
Aug 16 22:20:48 user nova-compute[72773]:     <rng supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='model'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio-transitional</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio-non-transitional</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='backendModel'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>random</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>egd</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>builtin</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </rng>
Aug 16 22:20:48 user nova-compute[72773]:     <filesystem supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='driverType'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>path</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>handle</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtiofs</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </filesystem>
Aug 16 22:20:48 user nova-compute[72773]:     <tpm supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='model'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>tpm-tis</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>tpm-crb</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='backendModel'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>passthrough</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>emulator</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </tpm>
Aug 16 22:20:48 user nova-compute[72773]:   </devices>
Aug 16 22:20:48 user nova-compute[72773]:   <features>
Aug 16 22:20:48 user nova-compute[72773]:     <gic supported='no'/>
Aug 16 22:20:48 user nova-compute[72773]:     <vmcoreinfo supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:     <genid supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:     <backingStoreInput supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:     <backup supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:     <sev supported='no'/>
Aug 16 22:20:48 user nova-compute[72773]:   </features>
Aug 16 22:20:48 user nova-compute[72773]: </domainCapabilities>
Aug 16 22:20:48 user nova-compute[72773]:  {{(pid=72773) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 16 22:20:48 user nova-compute[72773]: <domainCapabilities>
Aug 16 22:20:48 user nova-compute[72773]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 22:20:48 user nova-compute[72773]:   <domain>kvm</domain>
Aug 16 22:20:48 user nova-compute[72773]:   <machine>pc-i440fx-jammy</machine>
Aug 16 22:20:48 user nova-compute[72773]:   <arch>i686</arch>
Aug 16 22:20:48 user nova-compute[72773]:   <vcpu max='255'/>
Aug 16 22:20:48 user nova-compute[72773]:   <iothreads supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:   <os supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:     <enum name='firmware'/>
Aug 16 22:20:48 user nova-compute[72773]:     <loader supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='type'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>rom</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>pflash</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='readonly'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>yes</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>no</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='secure'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>no</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </loader>
Aug 16 22:20:48 user nova-compute[72773]:   </os>
Aug 16 22:20:48 user nova-compute[72773]:   <cpu>
Aug 16 22:20:48 user nova-compute[72773]:     <mode name='host-passthrough' supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='hostPassthroughMigratable'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>off</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </mode>
Aug 16 22:20:48 user nova-compute[72773]:     <mode name='maximum' supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='maximumMigratable'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>on</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>off</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </mode>
Aug 16 22:20:48 user nova-compute[72773]:     <mode name='host-model' supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <vendor>Intel</vendor>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='ss'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='vmx'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='pcid'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='hypervisor'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='arat'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='umip'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='md-clear'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='stibp'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='ssbd'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='ibpb'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='ibrs'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='amd-stibp'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='disable' name='erms'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='disable' name='lm'/>
Aug 16 22:20:48 user nova-compute[72773]:     </mode>
Aug 16 22:20:48 user nova-compute[72773]:     <mode name='custom' supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>qemu64</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>qemu32</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>phenom</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>pentium3</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>pentium2</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>pentium</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>n270</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>kvm64</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>kvm32</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>coreduo</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>core2duo</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>athlon</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Westmere</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Snowridge</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Server</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Client</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>SandyBridge</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Penryn</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G5</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G4</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G3</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G2</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G1</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Nehalem</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>IvyBridge</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Icelake-Server</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Haswell</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>EPYC-Rome</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>EPYC-Milan</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>EPYC</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Dhyana</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Cooperlake</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Conroe</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Broadwell</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>486</model>
Aug 16 22:20:48 user nova-compute[72773]:     </mode>
Aug 16 22:20:48 user nova-compute[72773]:   </cpu>
Aug 16 22:20:48 user nova-compute[72773]:   <memoryBacking supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:     <enum name='sourceType'>
Aug 16 22:20:48 user nova-compute[72773]:       <value>file</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>anonymous</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>memfd</value>
Aug 16 22:20:48 user nova-compute[72773]:     </enum>
Aug 16 22:20:48 user nova-compute[72773]:   </memoryBacking>
Aug 16 22:20:48 user nova-compute[72773]:   <devices>
Aug 16 22:20:48 user nova-compute[72773]:     <disk supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='diskDevice'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>disk</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>cdrom</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>floppy</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>lun</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='bus'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>ide</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>fdc</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>scsi</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>usb</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>sata</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='model'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio-transitional</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio-non-transitional</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </disk>
Aug 16 22:20:48 user nova-compute[72773]:     <graphics supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='type'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>sdl</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>vnc</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>spice</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>egl-headless</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </graphics>
Aug 16 22:20:48 user nova-compute[72773]:     <video supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='modelType'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>vga</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>cirrus</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>vmvga</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>qxl</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>none</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>bochs</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>ramfb</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </video>
Aug 16 22:20:48 user nova-compute[72773]:     <hostdev supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='mode'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>subsystem</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='startupPolicy'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>default</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>mandatory</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>requisite</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>optional</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='subsysType'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>usb</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>pci</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>scsi</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='capsType'/>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='pciBackend'/>
Aug 16 22:20:48 user nova-compute[72773]:     </hostdev>
Aug 16 22:20:48 user nova-compute[72773]:     <rng supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='model'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio-transitional</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio-non-transitional</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='backendModel'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>random</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>egd</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>builtin</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </rng>
Aug 16 22:20:48 user nova-compute[72773]:     <filesystem supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='driverType'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>path</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>handle</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtiofs</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </filesystem>
Aug 16 22:20:48 user nova-compute[72773]:     <tpm supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='model'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>tpm-tis</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>tpm-crb</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='backendModel'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>passthrough</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>emulator</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </tpm>
Aug 16 22:20:48 user nova-compute[72773]:   </devices>
Aug 16 22:20:48 user nova-compute[72773]:   <features>
Aug 16 22:20:48 user nova-compute[72773]:     <gic supported='no'/>
Aug 16 22:20:48 user nova-compute[72773]:     <vmcoreinfo supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:     <genid supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:     <backingStoreInput supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:     <backup supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:     <sev supported='no'/>
Aug 16 22:20:48 user nova-compute[72773]:   </features>
Aug 16 22:20:48 user nova-compute[72773]: </domainCapabilities>
Aug 16 22:20:48 user nova-compute[72773]:  {{(pid=72773) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72773) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72773) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72773) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72773) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72773) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72773) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72773) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72773) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72773) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72773) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72773) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72773) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72773) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72773) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72773) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72773) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72773) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=72773) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72773) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72773) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72773) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=72773) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72773) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72773) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72773) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72773) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72773) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72773) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72773) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72773) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72773) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72773) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72773) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72773) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72773) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72773) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72773) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72773) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=72773) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 16 22:20:48 user nova-compute[72773]: <domainCapabilities>
Aug 16 22:20:48 user nova-compute[72773]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 22:20:48 user nova-compute[72773]:   <domain>kvm</domain>
Aug 16 22:20:48 user nova-compute[72773]:   <machine>pc-q35-6.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:   <arch>x86_64</arch>
Aug 16 22:20:48 user nova-compute[72773]:   <vcpu max='288'/>
Aug 16 22:20:48 user nova-compute[72773]:   <iothreads supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:   <os supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:     <enum name='firmware'>
Aug 16 22:20:48 user nova-compute[72773]:       <value>efi</value>
Aug 16 22:20:48 user nova-compute[72773]:     </enum>
Aug 16 22:20:48 user nova-compute[72773]:     <loader supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='type'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>rom</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>pflash</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='readonly'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>yes</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>no</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='secure'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>yes</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>no</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </loader>
Aug 16 22:20:48 user nova-compute[72773]:   </os>
Aug 16 22:20:48 user nova-compute[72773]:   <cpu>
Aug 16 22:20:48 user nova-compute[72773]:     <mode name='host-passthrough' supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='hostPassthroughMigratable'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>on</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>off</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </mode>
Aug 16 22:20:48 user nova-compute[72773]:     <mode name='maximum' supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='maximumMigratable'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>on</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>off</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </mode>
Aug 16 22:20:48 user nova-compute[72773]:     <mode name='host-model' supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <vendor>Intel</vendor>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='ss'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='vmx'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='pcid'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='hypervisor'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='arat'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='umip'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='md-clear'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='stibp'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='ssbd'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='invtsc'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='ibpb'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='ibrs'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='amd-stibp'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='rsba'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='disable' name='erms'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 22:20:48 user nova-compute[72773]:     </mode>
Aug 16 22:20:48 user nova-compute[72773]:     <mode name='custom' supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>qemu64</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>qemu32</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>phenom</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>pentium3</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>pentium2</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>pentium</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>n270</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>kvm64</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>kvm32</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>coreduo</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>core2duo</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>athlon</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>Westmere</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Snowridge</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Server</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Client</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>SandyBridge</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>Penryn</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G5</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G4</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G3</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G2</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>Opteron_G1</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>Nehalem</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>IvyBridge</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Icelake-Server</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Haswell</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>EPYC-Rome</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>EPYC-Milan</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>EPYC</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Dhyana</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Cooperlake</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>Conroe</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Broadwell</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>486</model>
Aug 16 22:20:48 user nova-compute[72773]:     </mode>
Aug 16 22:20:48 user nova-compute[72773]:   </cpu>
Aug 16 22:20:48 user nova-compute[72773]:   <memoryBacking supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:     <enum name='sourceType'>
Aug 16 22:20:48 user nova-compute[72773]:       <value>file</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>anonymous</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>memfd</value>
Aug 16 22:20:48 user nova-compute[72773]:     </enum>
Aug 16 22:20:48 user nova-compute[72773]:   </memoryBacking>
Aug 16 22:20:48 user nova-compute[72773]:   <devices>
Aug 16 22:20:48 user nova-compute[72773]:     <disk supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='diskDevice'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>disk</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>cdrom</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>floppy</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>lun</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='bus'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>fdc</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>scsi</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>usb</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>sata</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='model'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio-transitional</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio-non-transitional</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </disk>
Aug 16 22:20:48 user nova-compute[72773]:     <graphics supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='type'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>sdl</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>vnc</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>spice</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>egl-headless</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </graphics>
Aug 16 22:20:48 user nova-compute[72773]:     <video supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='modelType'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>vga</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>cirrus</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>vmvga</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>qxl</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>none</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>bochs</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>ramfb</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </video>
Aug 16 22:20:48 user nova-compute[72773]:     <hostdev supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='mode'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>subsystem</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='startupPolicy'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>default</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>mandatory</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>requisite</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>optional</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='subsysType'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>usb</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>pci</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>scsi</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='capsType'/>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='pciBackend'/>
Aug 16 22:20:48 user nova-compute[72773]:     </hostdev>
Aug 16 22:20:48 user nova-compute[72773]:     <rng supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='model'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio-transitional</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio-non-transitional</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='backendModel'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>random</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>egd</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>builtin</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </rng>
Aug 16 22:20:48 user nova-compute[72773]:     <filesystem supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='driverType'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>path</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>handle</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtiofs</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </filesystem>
Aug 16 22:20:48 user nova-compute[72773]:     <tpm supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='model'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>tpm-tis</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>tpm-crb</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='backendModel'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>passthrough</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>emulator</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </tpm>
Aug 16 22:20:48 user nova-compute[72773]:   </devices>
Aug 16 22:20:48 user nova-compute[72773]:   <features>
Aug 16 22:20:48 user nova-compute[72773]:     <gic supported='no'/>
Aug 16 22:20:48 user nova-compute[72773]:     <vmcoreinfo supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:     <genid supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:     <backingStoreInput supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:     <backup supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:     <sev supported='no'/>
Aug 16 22:20:48 user nova-compute[72773]:   </features>
Aug 16 22:20:48 user nova-compute[72773]: </domainCapabilities>
Aug 16 22:20:48 user nova-compute[72773]:  {{(pid=72773) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 16 22:20:48 user nova-compute[72773]: <domainCapabilities>
Aug 16 22:20:48 user nova-compute[72773]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 22:20:48 user nova-compute[72773]:   <domain>kvm</domain>
Aug 16 22:20:48 user nova-compute[72773]:   <machine>pc-i440fx-6.2</machine>
Aug 16 22:20:48 user nova-compute[72773]:   <arch>x86_64</arch>
Aug 16 22:20:48 user nova-compute[72773]:   <vcpu max='255'/>
Aug 16 22:20:48 user nova-compute[72773]:   <iothreads supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:   <os supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:     <enum name='firmware'>
Aug 16 22:20:48 user nova-compute[72773]:       <value>efi</value>
Aug 16 22:20:48 user nova-compute[72773]:     </enum>
Aug 16 22:20:48 user nova-compute[72773]:     <loader supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='type'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>rom</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>pflash</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='readonly'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>yes</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>no</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='secure'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>no</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </loader>
Aug 16 22:20:48 user nova-compute[72773]:   </os>
Aug 16 22:20:48 user nova-compute[72773]:   <cpu>
Aug 16 22:20:48 user nova-compute[72773]:     <mode name='host-passthrough' supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='hostPassthroughMigratable'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>on</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>off</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </mode>
Aug 16 22:20:48 user nova-compute[72773]:     <mode name='maximum' supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='maximumMigratable'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>on</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>off</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </mode>
Aug 16 22:20:48 user nova-compute[72773]:     <mode name='host-model' supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <vendor>Intel</vendor>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='ss'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='vmx'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='pcid'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='hypervisor'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='arat'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='umip'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='md-clear'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='stibp'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='ssbd'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='invtsc'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='ibpb'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='ibrs'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='amd-stibp'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='rsba'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='disable' name='erms'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 22:20:48 user nova-compute[72773]:     </mode>
Aug 16 22:20:48 user nova-compute[72773]:     <mode name='custom' supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>qemu64</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>qemu32</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>phenom</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>pentium3</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>pentium2</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>pentium</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>n270</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>kvm64</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>kvm32</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>coreduo</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>core2duo</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>athlon</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>Westmere</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Snowridge</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Server</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Client</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>SandyBridge</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>Penryn</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G5</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G4</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G3</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G2</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>Opteron_G1</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>Nehalem</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>IvyBridge</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Icelake-Server</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Haswell</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>EPYC-Rome</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>EPYC-Milan</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>EPYC</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Dhyana</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Cooperlake</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>Conroe</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Broadwell</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>486</model>
Aug 16 22:20:48 user nova-compute[72773]:     </mode>
Aug 16 22:20:48 user nova-compute[72773]:   </cpu>
Aug 16 22:20:48 user nova-compute[72773]:   <memoryBacking supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:     <enum name='sourceType'>
Aug 16 22:20:48 user nova-compute[72773]:       <value>file</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>anonymous</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>memfd</value>
Aug 16 22:20:48 user nova-compute[72773]:     </enum>
Aug 16 22:20:48 user nova-compute[72773]:   </memoryBacking>
Aug 16 22:20:48 user nova-compute[72773]:   <devices>
Aug 16 22:20:48 user nova-compute[72773]:     <disk supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='diskDevice'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>disk</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>cdrom</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>floppy</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>lun</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='bus'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>ide</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>fdc</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>scsi</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>usb</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>sata</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='model'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio-transitional</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio-non-transitional</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </disk>
Aug 16 22:20:48 user nova-compute[72773]:     <graphics supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='type'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>sdl</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>vnc</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>spice</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>egl-headless</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </graphics>
Aug 16 22:20:48 user nova-compute[72773]:     <video supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='modelType'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>vga</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>cirrus</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>vmvga</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>qxl</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>none</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>bochs</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>ramfb</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </video>
Aug 16 22:20:48 user nova-compute[72773]:     <hostdev supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='mode'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>subsystem</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='startupPolicy'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>default</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>mandatory</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>requisite</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>optional</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='subsysType'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>usb</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>pci</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>scsi</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='capsType'/>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='pciBackend'/>
Aug 16 22:20:48 user nova-compute[72773]:     </hostdev>
Aug 16 22:20:48 user nova-compute[72773]:     <rng supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='model'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio-transitional</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio-non-transitional</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='backendModel'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>random</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>egd</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>builtin</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </rng>
Aug 16 22:20:48 user nova-compute[72773]:     <filesystem supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='driverType'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>path</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>handle</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtiofs</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </filesystem>
Aug 16 22:20:48 user nova-compute[72773]:     <tpm supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='model'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>tpm-tis</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>tpm-crb</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='backendModel'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>passthrough</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>emulator</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </tpm>
Aug 16 22:20:48 user nova-compute[72773]:   </devices>
Aug 16 22:20:48 user nova-compute[72773]:   <features>
Aug 16 22:20:48 user nova-compute[72773]:     <gic supported='no'/>
Aug 16 22:20:48 user nova-compute[72773]:     <vmcoreinfo supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:     <genid supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:     <backingStoreInput supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:     <backup supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:     <sev supported='no'/>
Aug 16 22:20:48 user nova-compute[72773]:   </features>
Aug 16 22:20:48 user nova-compute[72773]: </domainCapabilities>
Aug 16 22:20:48 user nova-compute[72773]:  {{(pid=72773) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 16 22:20:48 user nova-compute[72773]: <domainCapabilities>
Aug 16 22:20:48 user nova-compute[72773]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 22:20:48 user nova-compute[72773]:   <domain>kvm</domain>
Aug 16 22:20:48 user nova-compute[72773]:   <machine>pc-q35-jammy</machine>
Aug 16 22:20:48 user nova-compute[72773]:   <arch>x86_64</arch>
Aug 16 22:20:48 user nova-compute[72773]:   <vcpu max='288'/>
Aug 16 22:20:48 user nova-compute[72773]:   <iothreads supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:   <os supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:     <enum name='firmware'>
Aug 16 22:20:48 user nova-compute[72773]:       <value>efi</value>
Aug 16 22:20:48 user nova-compute[72773]:     </enum>
Aug 16 22:20:48 user nova-compute[72773]:     <loader supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='type'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>rom</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>pflash</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='readonly'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>yes</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>no</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='secure'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>yes</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>no</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </loader>
Aug 16 22:20:48 user nova-compute[72773]:   </os>
Aug 16 22:20:48 user nova-compute[72773]:   <cpu>
Aug 16 22:20:48 user nova-compute[72773]:     <mode name='host-passthrough' supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='hostPassthroughMigratable'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>on</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>off</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </mode>
Aug 16 22:20:48 user nova-compute[72773]:     <mode name='maximum' supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='maximumMigratable'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>on</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>off</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </mode>
Aug 16 22:20:48 user nova-compute[72773]:     <mode name='host-model' supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <vendor>Intel</vendor>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='ss'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='vmx'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='pcid'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='hypervisor'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='arat'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='umip'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='md-clear'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='stibp'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='ssbd'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='invtsc'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='ibpb'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='ibrs'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='amd-stibp'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='rsba'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='disable' name='erms'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 22:20:48 user nova-compute[72773]:     </mode>
Aug 16 22:20:48 user nova-compute[72773]:     <mode name='custom' supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>qemu64</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>qemu32</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>phenom</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>pentium3</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>pentium2</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>pentium</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>n270</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>kvm64</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>kvm32</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>coreduo</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>core2duo</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>athlon</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>Westmere</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Snowridge</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Server</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Client</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>SandyBridge</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>Penryn</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G5</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G4</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G3</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G2</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>Opteron_G1</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>Nehalem</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>IvyBridge</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Icelake-Server</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Haswell</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>EPYC-Rome</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>EPYC-Milan</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>EPYC</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Dhyana</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Cooperlake</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>Conroe</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Broadwell</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>486</model>
Aug 16 22:20:48 user nova-compute[72773]:     </mode>
Aug 16 22:20:48 user nova-compute[72773]:   </cpu>
Aug 16 22:20:48 user nova-compute[72773]:   <memoryBacking supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:     <enum name='sourceType'>
Aug 16 22:20:48 user nova-compute[72773]:       <value>file</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>anonymous</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>memfd</value>
Aug 16 22:20:48 user nova-compute[72773]:     </enum>
Aug 16 22:20:48 user nova-compute[72773]:   </memoryBacking>
Aug 16 22:20:48 user nova-compute[72773]:   <devices>
Aug 16 22:20:48 user nova-compute[72773]:     <disk supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='diskDevice'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>disk</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>cdrom</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>floppy</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>lun</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='bus'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>fdc</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>scsi</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>usb</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>sata</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='model'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio-transitional</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio-non-transitional</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </disk>
Aug 16 22:20:48 user nova-compute[72773]:     <graphics supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='type'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>sdl</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>vnc</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>spice</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>egl-headless</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </graphics>
Aug 16 22:20:48 user nova-compute[72773]:     <video supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='modelType'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>vga</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>cirrus</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>vmvga</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>qxl</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>none</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>bochs</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>ramfb</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </video>
Aug 16 22:20:48 user nova-compute[72773]:     <hostdev supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='mode'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>subsystem</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='startupPolicy'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>default</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>mandatory</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>requisite</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>optional</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='subsysType'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>usb</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>pci</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>scsi</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='capsType'/>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='pciBackend'/>
Aug 16 22:20:48 user nova-compute[72773]:     </hostdev>
Aug 16 22:20:48 user nova-compute[72773]:     <rng supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='model'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio-transitional</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio-non-transitional</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='backendModel'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>random</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>egd</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>builtin</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </rng>
Aug 16 22:20:48 user nova-compute[72773]:     <filesystem supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='driverType'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>path</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>handle</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtiofs</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </filesystem>
Aug 16 22:20:48 user nova-compute[72773]:     <tpm supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='model'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>tpm-tis</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>tpm-crb</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='backendModel'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>passthrough</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>emulator</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </tpm>
Aug 16 22:20:48 user nova-compute[72773]:   </devices>
Aug 16 22:20:48 user nova-compute[72773]:   <features>
Aug 16 22:20:48 user nova-compute[72773]:     <gic supported='no'/>
Aug 16 22:20:48 user nova-compute[72773]:     <vmcoreinfo supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:     <genid supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:     <backingStoreInput supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:     <backup supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:     <sev supported='no'/>
Aug 16 22:20:48 user nova-compute[72773]:   </features>
Aug 16 22:20:48 user nova-compute[72773]: </domainCapabilities>
Aug 16 22:20:48 user nova-compute[72773]:  {{(pid=72773) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 16 22:20:48 user nova-compute[72773]: <domainCapabilities>
Aug 16 22:20:48 user nova-compute[72773]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 22:20:48 user nova-compute[72773]:   <domain>kvm</domain>
Aug 16 22:20:48 user nova-compute[72773]:   <machine>pc-i440fx-jammy</machine>
Aug 16 22:20:48 user nova-compute[72773]:   <arch>x86_64</arch>
Aug 16 22:20:48 user nova-compute[72773]:   <vcpu max='255'/>
Aug 16 22:20:48 user nova-compute[72773]:   <iothreads supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:   <os supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:     <enum name='firmware'>
Aug 16 22:20:48 user nova-compute[72773]:       <value>efi</value>
Aug 16 22:20:48 user nova-compute[72773]:     </enum>
Aug 16 22:20:48 user nova-compute[72773]:     <loader supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='type'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>rom</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>pflash</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='readonly'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>yes</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>no</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='secure'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>no</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </loader>
Aug 16 22:20:48 user nova-compute[72773]:   </os>
Aug 16 22:20:48 user nova-compute[72773]:   <cpu>
Aug 16 22:20:48 user nova-compute[72773]:     <mode name='host-passthrough' supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='hostPassthroughMigratable'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>on</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>off</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </mode>
Aug 16 22:20:48 user nova-compute[72773]:     <mode name='maximum' supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='maximumMigratable'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>on</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>off</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </mode>
Aug 16 22:20:48 user nova-compute[72773]:     <mode name='host-model' supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <vendor>Intel</vendor>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='ss'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='vmx'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='pcid'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='hypervisor'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='arat'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='umip'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='md-clear'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='stibp'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='ssbd'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='invtsc'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='ibpb'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='ibrs'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='amd-stibp'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='rsba'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='disable' name='erms'/>
Aug 16 22:20:48 user nova-compute[72773]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 22:20:48 user nova-compute[72773]:     </mode>
Aug 16 22:20:48 user nova-compute[72773]:     <mode name='custom' supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>qemu64</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>qemu32</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>phenom</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>pentium3</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>pentium2</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>pentium</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>n270</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>kvm64</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>kvm32</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>coreduo</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>core2duo</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>athlon</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>Westmere</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Snowridge</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Server</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Skylake-Client</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>SandyBridge</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>Penryn</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G5</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G4</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G3</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Opteron_G2</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>Opteron_G1</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>Nehalem</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>IvyBridge</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Icelake-Server</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Haswell</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>EPYC-Rome</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>EPYC-Milan</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>EPYC</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Dhyana</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Cooperlake</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>Conroe</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='no'>Broadwell</model>
Aug 16 22:20:48 user nova-compute[72773]:       <model usable='yes'>486</model>
Aug 16 22:20:48 user nova-compute[72773]:     </mode>
Aug 16 22:20:48 user nova-compute[72773]:   </cpu>
Aug 16 22:20:48 user nova-compute[72773]:   <memoryBacking supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:     <enum name='sourceType'>
Aug 16 22:20:48 user nova-compute[72773]:       <value>file</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>anonymous</value>
Aug 16 22:20:48 user nova-compute[72773]:       <value>memfd</value>
Aug 16 22:20:48 user nova-compute[72773]:     </enum>
Aug 16 22:20:48 user nova-compute[72773]:   </memoryBacking>
Aug 16 22:20:48 user nova-compute[72773]:   <devices>
Aug 16 22:20:48 user nova-compute[72773]:     <disk supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='diskDevice'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>disk</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>cdrom</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>floppy</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>lun</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='bus'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>ide</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>fdc</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>scsi</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>usb</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>sata</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='model'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio-transitional</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio-non-transitional</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </disk>
Aug 16 22:20:48 user nova-compute[72773]:     <graphics supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='type'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>sdl</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>vnc</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>spice</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>egl-headless</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </graphics>
Aug 16 22:20:48 user nova-compute[72773]:     <video supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='modelType'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>vga</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>cirrus</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>vmvga</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>qxl</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>none</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>bochs</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>ramfb</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </video>
Aug 16 22:20:48 user nova-compute[72773]:     <hostdev supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='mode'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>subsystem</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='startupPolicy'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>default</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>mandatory</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>requisite</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>optional</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='subsysType'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>usb</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>pci</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>scsi</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='capsType'/>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='pciBackend'/>
Aug 16 22:20:48 user nova-compute[72773]:     </hostdev>
Aug 16 22:20:48 user nova-compute[72773]:     <rng supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='model'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio-transitional</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtio-non-transitional</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='backendModel'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>random</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>egd</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>builtin</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </rng>
Aug 16 22:20:48 user nova-compute[72773]:     <filesystem supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='driverType'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>path</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>handle</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>virtiofs</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </filesystem>
Aug 16 22:20:48 user nova-compute[72773]:     <tpm supported='yes'>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='model'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>tpm-tis</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>tpm-crb</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:       <enum name='backendModel'>
Aug 16 22:20:48 user nova-compute[72773]:         <value>passthrough</value>
Aug 16 22:20:48 user nova-compute[72773]:         <value>emulator</value>
Aug 16 22:20:48 user nova-compute[72773]:       </enum>
Aug 16 22:20:48 user nova-compute[72773]:     </tpm>
Aug 16 22:20:48 user nova-compute[72773]:   </devices>
Aug 16 22:20:48 user nova-compute[72773]:   <features>
Aug 16 22:20:48 user nova-compute[72773]:     <gic supported='no'/>
Aug 16 22:20:48 user nova-compute[72773]:     <vmcoreinfo supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:     <genid supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:     <backingStoreInput supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:     <backup supported='yes'/>
Aug 16 22:20:48 user nova-compute[72773]:     <sev supported='no'/>
Aug 16 22:20:48 user nova-compute[72773]:   </features>
Aug 16 22:20:48 user nova-compute[72773]: </domainCapabilities>
Aug 16 22:20:48 user nova-compute[72773]:  {{(pid=72773) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72773) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72773) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72773) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72773) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Checking secure boot support for host arch (x86_64) {{(pid=72773) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 16 22:20:48 user nova-compute[72773]: INFO nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Secure Boot support detected
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] cpu compare xml: <cpu match="exact">
Aug 16 22:20:48 user nova-compute[72773]:   <model>Nehalem</model>
Aug 16 22:20:48 user nova-compute[72773]: </cpu>
Aug 16 22:20:48 user nova-compute[72773]:  {{(pid=72773) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 16 22:20:48 user nova-compute[72773]: INFO nova.virt.node [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Generated node identity 03cd1900-3798-4f8f-b4d5-3eec5ac6735e
Aug 16 22:20:48 user nova-compute[72773]: INFO nova.virt.node [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Wrote node identity 03cd1900-3798-4f8f-b4d5-3eec5ac6735e to /opt/stack/data/nova/compute_id
Aug 16 22:20:48 user nova-compute[72773]: WARNING nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Compute nodes ['03cd1900-3798-4f8f-b4d5-3eec5ac6735e'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 16 22:20:48 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 16 22:20:48 user nova-compute[72773]: WARNING nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 16 22:20:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:20:48 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:20:48 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Hypervisor/Node resource view: name=user free_ram=10888MB free_disk=26.51409912109375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:20:48 user nova-compute[72773]: WARNING nova.compute.resource_tracker [None req-87966913-7caf-487d-bc43-31432767e2ce None None] No compute node record for user:03cd1900-3798-4f8f-b4d5-3eec5ac6735e: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 03cd1900-3798-4f8f-b4d5-3eec5ac6735e could not be found.
Aug 16 22:20:48 user nova-compute[72773]: INFO nova.compute.resource_tracker [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Compute node record created for user:user with uuid: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:20:48 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:20:48 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [req-90104344-21c1-4ebf-afb6-9e8b410a504c] Created resource provider record via placement API for resource provider with UUID 03cd1900-3798-4f8f-b4d5-3eec5ac6735e and name user.
Aug 16 22:20:49 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72773) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 16 22:20:49 user nova-compute[72773]: INFO nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] kernel doesn't support AMD SEV
Aug 16 22:20:49 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Updating inventory in ProviderTree for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 22:20:49 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:20:49 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Libvirt baseline CPU <cpu>
Aug 16 22:20:49 user nova-compute[72773]:   <arch>x86_64</arch>
Aug 16 22:20:49 user nova-compute[72773]:   <model>Nehalem</model>
Aug 16 22:20:49 user nova-compute[72773]:   <vendor>Intel</vendor>
Aug 16 22:20:49 user nova-compute[72773]:   <topology sockets="6" cores="1" threads="1"/>
Aug 16 22:20:49 user nova-compute[72773]: </cpu>
Aug 16 22:20:49 user nova-compute[72773]:  {{(pid=72773) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 16 22:20:49 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Updated inventory for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 16 22:20:49 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Updating resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e generation from 0 to 1 during operation: update_inventory {{(pid=72773) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 16 22:20:49 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Updating inventory in ProviderTree for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 22:20:49 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Updating resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e generation from 1 to 2 during operation: update_traits {{(pid=72773) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 16 22:20:49 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:20:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.626s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:20:49 user nova-compute[72773]: DEBUG nova.service [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Creating RPC server for service compute {{(pid=72773) start /opt/stack/nova/nova/service.py:182}}
Aug 16 22:20:49 user nova-compute[72773]: DEBUG nova.service [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Join ServiceGroup membership for this service compute {{(pid=72773) start /opt/stack/nova/nova/service.py:199}}
Aug 16 22:20:49 user nova-compute[72773]: DEBUG nova.servicegroup.drivers.db [None req-87966913-7caf-487d-bc43-31432767e2ce None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72773) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 16 22:21:18 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_power_states {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:21:18 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:21:40 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:21:40 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:21:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:21:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Rebuilding the list of instances to heal {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 22:21:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Didn't find any instances for network info cache update. {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 22:21:40 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:21:40 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:21:40 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:21:40 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:21:40 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:21:40 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:21:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:21:40 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:21:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:21:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:21:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:21:40 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:21:40 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:21:40 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:21:40 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=10314MB free_disk=26.417842864990234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:21:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:21:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:21:40 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:21:40 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:21:40 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:21:40 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:21:40 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:21:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:22:40 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:22:40 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:22:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:22:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Rebuilding the list of instances to heal {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 22:22:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Didn't find any instances for network info cache update. {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 22:22:40 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:22:40 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:22:40 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:22:40 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:22:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:22:41 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:22:41 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:22:41 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:22:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:22:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:22:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:22:41 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:22:41 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:22:41 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:22:41 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=10241MB free_disk=26.464309692382812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:22:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:22:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:22:41 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:22:41 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:22:41 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:22:41 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:22:41 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:22:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.096s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:22:42 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:23:40 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:23:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:23:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Rebuilding the list of instances to heal {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 22:23:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Didn't find any instances for network info cache update. {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 22:23:40 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:23:40 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:23:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:23:41 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:23:41 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:23:42 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:23:42 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:23:43 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:23:43 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:23:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:23:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:23:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:23:43 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:23:43 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:23:43 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:23:43 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=10263MB free_disk=26.24811553955078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:23:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:23:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:23:43 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:23:43 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:23:43 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:23:43 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:23:43 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:23:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.100s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:24:40 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:24:40 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:24:40 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:24:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:24:42 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:24:42 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:24:42 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:24:42 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Rebuilding the list of instances to heal {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 22:24:42 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Didn't find any instances for network info cache update. {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 22:24:42 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:24:43 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:24:44 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:24:44 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:24:45 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:24:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:24:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:24:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:24:45 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:24:45 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:24:45 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:24:45 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=9505MB free_disk=26.271141052246094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:24:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:24:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:24:46 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:24:46 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:24:46 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:24:46 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:24:46 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:24:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.405s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:24:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "956d334e-f190-4625-b144-ab44d2f3321a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:24:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "956d334e-f190-4625-b144-ab44d2f3321a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:24:50 user nova-compute[72773]: DEBUG nova.compute.manager [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:24:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:24:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:24:50 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:24:50 user nova-compute[72773]: INFO nova.compute.claims [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Claim successful on node user
Aug 16 22:24:50 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:24:50 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:24:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.321s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:24:50 user nova-compute[72773]: DEBUG nova.compute.manager [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:24:50 user nova-compute[72773]: DEBUG nova.compute.manager [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:24:50 user nova-compute[72773]: DEBUG nova.network.neutron [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:24:50 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:24:51 user nova-compute[72773]: DEBUG nova.compute.manager [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:24:51 user nova-compute[72773]: DEBUG nova.compute.manager [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:24:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:24:51 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Creating image(s)
Aug 16 22:24:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "/opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:24:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "/opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:24:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "/opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:24:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:24:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:24:51 user nova-compute[72773]: DEBUG nova.policy [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '42e8c8d0806e45ed9d1126aad24a034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f496354017e467e9b7a537c73248fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:24:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380.part --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:24:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380.part --force-share --output=json" returned: 0 in 0.192s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:24:52 user nova-compute[72773]: DEBUG nova.virt.images [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] 370c21db-2a77-45c9-b1ac-4447fbc4f414 was qcow2, converting to raw {{(pid=72773) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 22:24:52 user nova-compute[72773]: DEBUG nova.privsep.utils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72773) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 22:24:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380.part /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380.converted {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:24:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380.part /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380.converted" returned: 0 in 0.170s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:24:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380.converted --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:24:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380.converted --force-share --output=json" returned: 0 in 0.213s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:24:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.612s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:24:52 user nova-compute[72773]: INFO oslo.privsep.daemon [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpsa1qrr_j/privsep.sock']
Aug 16 22:24:52 user sudo[81991]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpsa1qrr_j/privsep.sock
Aug 16 22:24:52 user sudo[81991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 16 22:24:54 user nova-compute[72773]: DEBUG nova.network.neutron [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Successfully created port: d1807881-ec54-4e55-8f2e-6f8046efd351 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:24:54 user sudo[81991]: pam_unix(sudo:session): session closed for user root
Aug 16 22:24:54 user nova-compute[72773]: INFO oslo.privsep.daemon [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Spawned new privsep daemon via rootwrap
Aug 16 22:24:54 user nova-compute[72773]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 16 22:24:54 user nova-compute[72773]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 16 22:24:54 user nova-compute[72773]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 16 22:24:54 user nova-compute[72773]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81995
Aug 16 22:24:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:24:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.184s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:24:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:24:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:24:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:24:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.167s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:24:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:24:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk 1073741824" returned: 0 in 0.050s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:24:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:24:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:24:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Acquiring lock "02235c77-0c2a-4317-8526-7bd5096694a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:24:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Lock "02235c77-0c2a-4317-8526-7bd5096694a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:24:55 user nova-compute[72773]: DEBUG nova.compute.manager [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:24:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.201s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:24:55 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Checking if we can resize image /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:24:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:24:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:24:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:24:55 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:24:55 user nova-compute[72773]: INFO nova.compute.claims [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Claim successful on node user
Aug 16 22:24:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:24:55 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Cannot resize image /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:24:55 user nova-compute[72773]: DEBUG nova.objects.instance [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lazy-loading 'migration_context' on Instance uuid 956d334e-f190-4625-b144-ab44d2f3321a {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:24:55 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:24:55 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Ensure instance console log exists: /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:24:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:24:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:24:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:24:55 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:24:55 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:24:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.260s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:24:55 user nova-compute[72773]: DEBUG nova.compute.manager [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:24:55 user nova-compute[72773]: DEBUG nova.compute.manager [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:24:55 user nova-compute[72773]: DEBUG nova.network.neutron [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:24:55 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:24:55 user nova-compute[72773]: DEBUG nova.compute.manager [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:24:55 user nova-compute[72773]: DEBUG nova.compute.manager [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:24:55 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:24:55 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Creating image(s)
Aug 16 22:24:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Acquiring lock "/opt/stack/data/nova/instances/02235c77-0c2a-4317-8526-7bd5096694a2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:24:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Lock "/opt/stack/data/nova/instances/02235c77-0c2a-4317-8526-7bd5096694a2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:24:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Lock "/opt/stack/data/nova/instances/02235c77-0c2a-4317-8526-7bd5096694a2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:24:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:24:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.202s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:24:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:24:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:24:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:24:56 user nova-compute[72773]: DEBUG nova.policy [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f8b29d1bc1748909dc34b421b798678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4509d81443b499a8379f558bfad9338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:24:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.170s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:24:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/02235c77-0c2a-4317-8526-7bd5096694a2/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:24:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/02235c77-0c2a-4317-8526-7bd5096694a2/disk 1073741824" returned: 0 in 0.054s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:24:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:24:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:24:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.168s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:24:56 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Checking if we can resize image /opt/stack/data/nova/instances/02235c77-0c2a-4317-8526-7bd5096694a2/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:24:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02235c77-0c2a-4317-8526-7bd5096694a2/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:24:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02235c77-0c2a-4317-8526-7bd5096694a2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:24:56 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Cannot resize image /opt/stack/data/nova/instances/02235c77-0c2a-4317-8526-7bd5096694a2/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:24:56 user nova-compute[72773]: DEBUG nova.objects.instance [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Lazy-loading 'migration_context' on Instance uuid 02235c77-0c2a-4317-8526-7bd5096694a2 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:24:56 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:24:56 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Ensure instance console log exists: /opt/stack/data/nova/instances/02235c77-0c2a-4317-8526-7bd5096694a2/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:24:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:24:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:24:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:24:58 user nova-compute[72773]: DEBUG nova.network.neutron [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Successfully created port: f3bb17a2-593d-46be-92bc-9b4b64a48174 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:24:58 user nova-compute[72773]: DEBUG nova.network.neutron [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Successfully updated port: d1807881-ec54-4e55-8f2e-6f8046efd351 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:24:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "refresh_cache-956d334e-f190-4625-b144-ab44d2f3321a" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:24:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquired lock "refresh_cache-956d334e-f190-4625-b144-ab44d2f3321a" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:24:58 user nova-compute[72773]: DEBUG nova.network.neutron [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:24:58 user nova-compute[72773]: DEBUG nova.network.neutron [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:24:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-a13e34b5-43a9-4e6f-bcca-97f14e71969c req-5a8932e6-c41c-4432-a269-df38cf7911a5 service nova] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Received event network-changed-d1807881-ec54-4e55-8f2e-6f8046efd351 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:24:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-a13e34b5-43a9-4e6f-bcca-97f14e71969c req-5a8932e6-c41c-4432-a269-df38cf7911a5 service nova] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Refreshing instance network info cache due to event network-changed-d1807881-ec54-4e55-8f2e-6f8046efd351. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:24:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a13e34b5-43a9-4e6f-bcca-97f14e71969c req-5a8932e6-c41c-4432-a269-df38cf7911a5 service nova] Acquiring lock "refresh_cache-956d334e-f190-4625-b144-ab44d2f3321a" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:24:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "4efab321-f2aa-456c-a1ae-b32f399f694d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:24:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "4efab321-f2aa-456c-a1ae-b32f399f694d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:24:59 user nova-compute[72773]: DEBUG nova.compute.manager [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:24:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:24:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:24:59 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:24:59 user nova-compute[72773]: INFO nova.compute.claims [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Claim successful on node user
Aug 16 22:24:59 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:24:59 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:24:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.306s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:24:59 user nova-compute[72773]: DEBUG nova.compute.manager [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:24:59 user nova-compute[72773]: DEBUG nova.compute.manager [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:24:59 user nova-compute[72773]: DEBUG nova.network.neutron [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:24:59 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:24:59 user nova-compute[72773]: DEBUG nova.compute.manager [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.compute.manager [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:25:00 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Creating image(s)
Aug 16 22:25:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "/opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "/opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "/opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.policy [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3b873f599fc4a2686c154d856bd5f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49739a140d40508ea307eedceb9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.291s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.network.neutron [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Successfully updated port: f3bb17a2-593d-46be-92bc-9b4b64a48174 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.network.neutron [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Updating instance_info_cache with network_info: [{"id": "d1807881-ec54-4e55-8f2e-6f8046efd351", "address": "fa:16:3e:b5:0f:ad", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1807881-ec", "ovs_interfaceid": "d1807881-ec54-4e55-8f2e-6f8046efd351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Acquiring lock "refresh_cache-02235c77-0c2a-4317-8526-7bd5096694a2" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Acquired lock "refresh_cache-02235c77-0c2a-4317-8526-7bd5096694a2" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.network.neutron [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.165s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Releasing lock "refresh_cache-956d334e-f190-4625-b144-ab44d2f3321a" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.compute.manager [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Instance network_info: |[{"id": "d1807881-ec54-4e55-8f2e-6f8046efd351", "address": "fa:16:3e:b5:0f:ad", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1807881-ec", "ovs_interfaceid": "d1807881-ec54-4e55-8f2e-6f8046efd351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a13e34b5-43a9-4e6f-bcca-97f14e71969c req-5a8932e6-c41c-4432-a269-df38cf7911a5 service nova] Acquired lock "refresh_cache-956d334e-f190-4625-b144-ab44d2f3321a" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.network.neutron [req-a13e34b5-43a9-4e6f-bcca-97f14e71969c req-5a8932e6-c41c-4432-a269-df38cf7911a5 service nova] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Refreshing network info cache for port d1807881-ec54-4e55-8f2e-6f8046efd351 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Start _get_guest_xml network_info=[{"id": "d1807881-ec54-4e55-8f2e-6f8046efd351", "address": "fa:16:3e:b5:0f:ad", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1807881-ec", "ovs_interfaceid": "d1807881-ec54-4e55-8f2e-6f8046efd351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/disk 1073741824" returned: 0 in 0.106s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:00 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:25:00 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.privsep.utils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72773) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:24:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-509745796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-509745796',id=1,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f496354017e467e9b7a537c73248fe2',ramdisk_id='',reservation_id='r-ogm3kd31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648946443',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:24:51Z,user_data=None,user_id='42e8c8d0806e45ed9d1126aad24a034b',uuid=956d334e-f190-4625-b144-ab44d2f3321a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1807881-ec54-4e55-8f2e-6f8046efd351", "address": "fa:16:3e:b5:0f:ad", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1807881-ec", "ovs_interfaceid": "d1807881-ec54-4e55-8f2e-6f8046efd351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Converting VIF {"id": "d1807881-ec54-4e55-8f2e-6f8046efd351", "address": "fa:16:3e:b5:0f:ad", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1807881-ec", "ovs_interfaceid": "d1807881-ec54-4e55-8f2e-6f8046efd351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:0f:ad,bridge_name='br-int',has_traffic_filtering=True,id=d1807881-ec54-4e55-8f2e-6f8046efd351,network=Network(0a6ec813-28f9-4716-bf41-20722c69fe20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1807881-ec') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.objects.instance [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lazy-loading 'pci_devices' on Instance uuid 956d334e-f190-4625-b144-ab44d2f3321a {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:25:00 user nova-compute[72773]:   <uuid>956d334e-f190-4625-b144-ab44d2f3321a</uuid>
Aug 16 22:25:00 user nova-compute[72773]:   <name>instance-00000001</name>
Aug 16 22:25:00 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:25:00 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:25:00 user nova-compute[72773]:   <metadata>
Aug 16 22:25:00 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:25:00 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:25:00 user nova-compute[72773]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-509745796</nova:name>
Aug 16 22:25:00 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:25:00</nova:creationTime>
Aug 16 22:25:00 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:25:00 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:25:00 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:25:00 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:25:00 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:25:00 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:25:00 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:25:00 user nova-compute[72773]:       <nova:owner>
Aug 16 22:25:00 user nova-compute[72773]:         <nova:user uuid="42e8c8d0806e45ed9d1126aad24a034b">tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member</nova:user>
Aug 16 22:25:00 user nova-compute[72773]:         <nova:project uuid="4f496354017e467e9b7a537c73248fe2">tempest-ServerBootFromVolumeStableRescueTest-1648946443</nova:project>
Aug 16 22:25:00 user nova-compute[72773]:       </nova:owner>
Aug 16 22:25:00 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:25:00 user nova-compute[72773]:       <nova:ports>
Aug 16 22:25:00 user nova-compute[72773]:         <nova:port uuid="d1807881-ec54-4e55-8f2e-6f8046efd351">
Aug 16 22:25:00 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 22:25:00 user nova-compute[72773]:         </nova:port>
Aug 16 22:25:00 user nova-compute[72773]:       </nova:ports>
Aug 16 22:25:00 user nova-compute[72773]:     </nova:instance>
Aug 16 22:25:00 user nova-compute[72773]:   </metadata>
Aug 16 22:25:00 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:25:00 user nova-compute[72773]:     <system>
Aug 16 22:25:00 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:25:00 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:25:00 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:25:00 user nova-compute[72773]:       <entry name="serial">956d334e-f190-4625-b144-ab44d2f3321a</entry>
Aug 16 22:25:00 user nova-compute[72773]:       <entry name="uuid">956d334e-f190-4625-b144-ab44d2f3321a</entry>
Aug 16 22:25:00 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:25:00 user nova-compute[72773]:     </system>
Aug 16 22:25:00 user nova-compute[72773]:   </sysinfo>
Aug 16 22:25:00 user nova-compute[72773]:   <os>
Aug 16 22:25:00 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:25:00 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:25:00 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:25:00 user nova-compute[72773]:   </os>
Aug 16 22:25:00 user nova-compute[72773]:   <features>
Aug 16 22:25:00 user nova-compute[72773]:     <acpi/>
Aug 16 22:25:00 user nova-compute[72773]:     <apic/>
Aug 16 22:25:00 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:25:00 user nova-compute[72773]:   </features>
Aug 16 22:25:00 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:25:00 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:25:00 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:25:00 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:25:00 user nova-compute[72773]:   </clock>
Aug 16 22:25:00 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:25:00 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:25:00 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:25:00 user nova-compute[72773]:   </cpu>
Aug 16 22:25:00 user nova-compute[72773]:   <devices>
Aug 16 22:25:00 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:25:00 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:25:00 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk"/>
Aug 16 22:25:00 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:25:00 user nova-compute[72773]:     </disk>
Aug 16 22:25:00 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:25:00 user nova-compute[72773]:       <mac address="fa:16:3e:b5:0f:ad"/>
Aug 16 22:25:00 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:25:00 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:25:00 user nova-compute[72773]:       <target dev="tapd1807881-ec"/>
Aug 16 22:25:00 user nova-compute[72773]:     </interface>
Aug 16 22:25:00 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:25:00 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/console.log" append="off"/>
Aug 16 22:25:00 user nova-compute[72773]:     </serial>
Aug 16 22:25:00 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:25:00 user nova-compute[72773]:     <video>
Aug 16 22:25:00 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:25:00 user nova-compute[72773]:     </video>
Aug 16 22:25:00 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:25:00 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:25:00 user nova-compute[72773]:     </rng>
Aug 16 22:25:00 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:25:00 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:25:00 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:25:00 user nova-compute[72773]:     </memballoon>
Aug 16 22:25:00 user nova-compute[72773]:   </devices>
Aug 16 22:25:00 user nova-compute[72773]: </domain>
Aug 16 22:25:00 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:24:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-509745796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-509745796',id=1,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f496354017e467e9b7a537c73248fe2',ramdisk_id='',reservation_id='r-ogm3kd31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648946443',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:24:51Z,user_data=None,user_id='42e8c8d0806e45ed9d1126aad24a034b',uuid=956d334e-f190-4625-b144-ab44d2f3321a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1807881-ec54-4e55-8f2e-6f8046efd351", "address": "fa:16:3e:b5:0f:ad", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1807881-ec", "ovs_interfaceid": "d1807881-ec54-4e55-8f2e-6f8046efd351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Converting VIF {"id": "d1807881-ec54-4e55-8f2e-6f8046efd351", "address": "fa:16:3e:b5:0f:ad", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1807881-ec", "ovs_interfaceid": "d1807881-ec54-4e55-8f2e-6f8046efd351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:0f:ad,bridge_name='br-int',has_traffic_filtering=True,id=d1807881-ec54-4e55-8f2e-6f8046efd351,network=Network(0a6ec813-28f9-4716-bf41-20722c69fe20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1807881-ec') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG os_vif [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:0f:ad,bridge_name='br-int',has_traffic_filtering=True,id=d1807881-ec54-4e55-8f2e-6f8046efd351,network=Network(0a6ec813-28f9-4716-bf41-20722c69fe20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1807881-ec') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Created schema index Interface.name {{(pid=72773) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Created schema index Port.name {{(pid=72773) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Created schema index Bridge.name {{(pid=72773) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [POLLOUT] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.247s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.network.neutron [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.compute.manager [req-307ae7b2-a8ef-46f9-9ac0-8b4ceaf4bb14 req-477a01a2-1813-43ff-b6d4-216326caaee9 service nova] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Received event network-changed-f3bb17a2-593d-46be-92bc-9b4b64a48174 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG nova.compute.manager [req-307ae7b2-a8ef-46f9-9ac0-8b4ceaf4bb14 req-477a01a2-1813-43ff-b6d4-216326caaee9 service nova] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Refreshing instance network info cache due to event network-changed-f3bb17a2-593d-46be-92bc-9b4b64a48174. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:25:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-307ae7b2-a8ef-46f9-9ac0-8b4ceaf4bb14 req-477a01a2-1813-43ff-b6d4-216326caaee9 service nova] Acquiring lock "refresh_cache-02235c77-0c2a-4317-8526-7bd5096694a2" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:25:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:25:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:25:01 user nova-compute[72773]: INFO oslo.privsep.daemon [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmph7b0iedy/privsep.sock']
Aug 16 22:25:01 user sudo[82142]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmph7b0iedy/privsep.sock
Aug 16 22:25:01 user sudo[82142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 16 22:25:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:01 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Cannot resize image /opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:25:01 user nova-compute[72773]: DEBUG nova.objects.instance [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lazy-loading 'migration_context' on Instance uuid 4efab321-f2aa-456c-a1ae-b32f399f694d {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:25:01 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:25:01 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Ensure instance console log exists: /opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:25:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:01 user nova-compute[72773]: DEBUG nova.compute.manager [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:25:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:01 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:25:01 user nova-compute[72773]: INFO nova.compute.claims [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Claim successful on node user
Aug 16 22:25:01 user nova-compute[72773]: DEBUG nova.network.neutron [req-a13e34b5-43a9-4e6f-bcca-97f14e71969c req-5a8932e6-c41c-4432-a269-df38cf7911a5 service nova] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Updated VIF entry in instance network info cache for port d1807881-ec54-4e55-8f2e-6f8046efd351. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:25:01 user nova-compute[72773]: DEBUG nova.network.neutron [req-a13e34b5-43a9-4e6f-bcca-97f14e71969c req-5a8932e6-c41c-4432-a269-df38cf7911a5 service nova] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Updating instance_info_cache with network_info: [{"id": "d1807881-ec54-4e55-8f2e-6f8046efd351", "address": "fa:16:3e:b5:0f:ad", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1807881-ec", "ovs_interfaceid": "d1807881-ec54-4e55-8f2e-6f8046efd351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:25:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a13e34b5-43a9-4e6f-bcca-97f14e71969c req-5a8932e6-c41c-4432-a269-df38cf7911a5 service nova] Releasing lock "refresh_cache-956d334e-f190-4625-b144-ab44d2f3321a" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.301s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.compute.manager [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.compute.manager [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.network.neutron [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:25:02 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.network.neutron [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Updating instance_info_cache with network_info: [{"id": "f3bb17a2-593d-46be-92bc-9b4b64a48174", "address": "fa:16:3e:66:2d:a9", "network": {"id": "932581fe-de5a-42af-8214-9fc20f8e3038", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-982938001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4509d81443b499a8379f558bfad9338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bb17a2-59", "ovs_interfaceid": "f3bb17a2-593d-46be-92bc-9b4b64a48174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.compute.manager [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Releasing lock "refresh_cache-02235c77-0c2a-4317-8526-7bd5096694a2" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.compute.manager [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Instance network_info: |[{"id": "f3bb17a2-593d-46be-92bc-9b4b64a48174", "address": "fa:16:3e:66:2d:a9", "network": {"id": "932581fe-de5a-42af-8214-9fc20f8e3038", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-982938001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4509d81443b499a8379f558bfad9338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bb17a2-59", "ovs_interfaceid": "f3bb17a2-593d-46be-92bc-9b4b64a48174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-307ae7b2-a8ef-46f9-9ac0-8b4ceaf4bb14 req-477a01a2-1813-43ff-b6d4-216326caaee9 service nova] Acquired lock "refresh_cache-02235c77-0c2a-4317-8526-7bd5096694a2" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.network.neutron [req-307ae7b2-a8ef-46f9-9ac0-8b4ceaf4bb14 req-477a01a2-1813-43ff-b6d4-216326caaee9 service nova] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Refreshing network info cache for port f3bb17a2-593d-46be-92bc-9b4b64a48174 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Start _get_guest_xml network_info=[{"id": "f3bb17a2-593d-46be-92bc-9b4b64a48174", "address": "fa:16:3e:66:2d:a9", "network": {"id": "932581fe-de5a-42af-8214-9fc20f8e3038", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-982938001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4509d81443b499a8379f558bfad9338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bb17a2-59", "ovs_interfaceid": "f3bb17a2-593d-46be-92bc-9b4b64a48174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:25:02 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:25:02 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-934748313',display_name='tempest-DeleteServersTestJSON-server-934748313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-934748313',id=2,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4509d81443b499a8379f558bfad9338',ramdisk_id='',reservation_id='r-5cnhii1d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1769552369',owner_user_name='tempest-DeleteServersTestJSON-1769552369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:24:56Z,user_data=None,user_id='2f8b29d1bc1748909dc34b421b798678',uuid=02235c77-0c2a-4317-8526-7bd5096694a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3bb17a2-593d-46be-92bc-9b4b64a48174", "address": "fa:16:3e:66:2d:a9", "network": {"id": "932581fe-de5a-42af-8214-9fc20f8e3038", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-982938001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4509d81443b499a8379f558bfad9338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bb17a2-59", "ovs_interfaceid": "f3bb17a2-593d-46be-92bc-9b4b64a48174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Converting VIF {"id": "f3bb17a2-593d-46be-92bc-9b4b64a48174", "address": "fa:16:3e:66:2d:a9", "network": {"id": "932581fe-de5a-42af-8214-9fc20f8e3038", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-982938001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4509d81443b499a8379f558bfad9338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bb17a2-59", "ovs_interfaceid": "f3bb17a2-593d-46be-92bc-9b4b64a48174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:2d:a9,bridge_name='br-int',has_traffic_filtering=True,id=f3bb17a2-593d-46be-92bc-9b4b64a48174,network=Network(932581fe-de5a-42af-8214-9fc20f8e3038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3bb17a2-59') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.objects.instance [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Lazy-loading 'pci_devices' on Instance uuid 02235c77-0c2a-4317-8526-7bd5096694a2 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:25:02 user nova-compute[72773]:   <uuid>02235c77-0c2a-4317-8526-7bd5096694a2</uuid>
Aug 16 22:25:02 user nova-compute[72773]:   <name>instance-00000002</name>
Aug 16 22:25:02 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:25:02 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:25:02 user nova-compute[72773]:   <metadata>
Aug 16 22:25:02 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:25:02 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:25:02 user nova-compute[72773]:       <nova:name>tempest-DeleteServersTestJSON-server-934748313</nova:name>
Aug 16 22:25:02 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:25:02</nova:creationTime>
Aug 16 22:25:02 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:25:02 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:25:02 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:25:02 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:25:02 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:25:02 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:25:02 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:25:02 user nova-compute[72773]:       <nova:owner>
Aug 16 22:25:02 user nova-compute[72773]:         <nova:user uuid="2f8b29d1bc1748909dc34b421b798678">tempest-DeleteServersTestJSON-1769552369-project-member</nova:user>
Aug 16 22:25:02 user nova-compute[72773]:         <nova:project uuid="a4509d81443b499a8379f558bfad9338">tempest-DeleteServersTestJSON-1769552369</nova:project>
Aug 16 22:25:02 user nova-compute[72773]:       </nova:owner>
Aug 16 22:25:02 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:25:02 user nova-compute[72773]:       <nova:ports>
Aug 16 22:25:02 user nova-compute[72773]:         <nova:port uuid="f3bb17a2-593d-46be-92bc-9b4b64a48174">
Aug 16 22:25:02 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 22:25:02 user nova-compute[72773]:         </nova:port>
Aug 16 22:25:02 user nova-compute[72773]:       </nova:ports>
Aug 16 22:25:02 user nova-compute[72773]:     </nova:instance>
Aug 16 22:25:02 user nova-compute[72773]:   </metadata>
Aug 16 22:25:02 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:25:02 user nova-compute[72773]:     <system>
Aug 16 22:25:02 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:25:02 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:25:02 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:25:02 user nova-compute[72773]:       <entry name="serial">02235c77-0c2a-4317-8526-7bd5096694a2</entry>
Aug 16 22:25:02 user nova-compute[72773]:       <entry name="uuid">02235c77-0c2a-4317-8526-7bd5096694a2</entry>
Aug 16 22:25:02 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:25:02 user nova-compute[72773]:     </system>
Aug 16 22:25:02 user nova-compute[72773]:   </sysinfo>
Aug 16 22:25:02 user nova-compute[72773]:   <os>
Aug 16 22:25:02 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:25:02 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:25:02 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:25:02 user nova-compute[72773]:   </os>
Aug 16 22:25:02 user nova-compute[72773]:   <features>
Aug 16 22:25:02 user nova-compute[72773]:     <acpi/>
Aug 16 22:25:02 user nova-compute[72773]:     <apic/>
Aug 16 22:25:02 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:25:02 user nova-compute[72773]:   </features>
Aug 16 22:25:02 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:25:02 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:25:02 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:25:02 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:25:02 user nova-compute[72773]:   </clock>
Aug 16 22:25:02 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:25:02 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:25:02 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:25:02 user nova-compute[72773]:   </cpu>
Aug 16 22:25:02 user nova-compute[72773]:   <devices>
Aug 16 22:25:02 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:25:02 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:25:02 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/02235c77-0c2a-4317-8526-7bd5096694a2/disk"/>
Aug 16 22:25:02 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:25:02 user nova-compute[72773]:     </disk>
Aug 16 22:25:02 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:25:02 user nova-compute[72773]:       <mac address="fa:16:3e:66:2d:a9"/>
Aug 16 22:25:02 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:25:02 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:25:02 user nova-compute[72773]:       <target dev="tapf3bb17a2-59"/>
Aug 16 22:25:02 user nova-compute[72773]:     </interface>
Aug 16 22:25:02 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:25:02 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/02235c77-0c2a-4317-8526-7bd5096694a2/console.log" append="off"/>
Aug 16 22:25:02 user nova-compute[72773]:     </serial>
Aug 16 22:25:02 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:25:02 user nova-compute[72773]:     <video>
Aug 16 22:25:02 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:25:02 user nova-compute[72773]:     </video>
Aug 16 22:25:02 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:25:02 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:25:02 user nova-compute[72773]:     </rng>
Aug 16 22:25:02 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:25:02 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:25:02 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:25:02 user nova-compute[72773]:     </memballoon>
Aug 16 22:25:02 user nova-compute[72773]:   </devices>
Aug 16 22:25:02 user nova-compute[72773]: </domain>
Aug 16 22:25:02 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-934748313',display_name='tempest-DeleteServersTestJSON-server-934748313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-934748313',id=2,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4509d81443b499a8379f558bfad9338',ramdisk_id='',reservation_id='r-5cnhii1d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1769552369',owner_user_name='tempest-DeleteServersTestJSON-1769552369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:24:56Z,user_data=None,user_id='2f8b29d1bc1748909dc34b421b798678',uuid=02235c77-0c2a-4317-8526-7bd5096694a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3bb17a2-593d-46be-92bc-9b4b64a48174", "address": "fa:16:3e:66:2d:a9", "network": {"id": "932581fe-de5a-42af-8214-9fc20f8e3038", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-982938001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4509d81443b499a8379f558bfad9338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bb17a2-59", "ovs_interfaceid": "f3bb17a2-593d-46be-92bc-9b4b64a48174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Converting VIF {"id": "f3bb17a2-593d-46be-92bc-9b4b64a48174", "address": "fa:16:3e:66:2d:a9", "network": {"id": "932581fe-de5a-42af-8214-9fc20f8e3038", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-982938001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4509d81443b499a8379f558bfad9338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bb17a2-59", "ovs_interfaceid": "f3bb17a2-593d-46be-92bc-9b4b64a48174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:2d:a9,bridge_name='br-int',has_traffic_filtering=True,id=f3bb17a2-593d-46be-92bc-9b4b64a48174,network=Network(932581fe-de5a-42af-8214-9fc20f8e3038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3bb17a2-59') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG os_vif [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:2d:a9,bridge_name='br-int',has_traffic_filtering=True,id=f3bb17a2-593d-46be-92bc-9b4b64a48174,network=Network(932581fe-de5a-42af-8214-9fc20f8e3038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3bb17a2-59') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.compute.manager [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:25:02 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Creating image(s)
Aug 16 22:25:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "/opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "/opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "/opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG nova.policy [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '71cd9d1142ec45e792219e8b789cf2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef6a37d79341d7a94e5b314efddab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.162s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.175s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk 1073741824" returned: 0 in 0.046s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:03 user sudo[82142]: pam_unix(sudo:session): session closed for user root
Aug 16 22:25:03 user nova-compute[72773]: INFO oslo.privsep.daemon [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Spawned new privsep daemon via rootwrap
Aug 16 22:25:03 user nova-compute[72773]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 16 22:25:03 user nova-compute[72773]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 16 22:25:03 user nova-compute[72773]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 16 22:25:03 user nova-compute[72773]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82296
Aug 16 22:25:03 user nova-compute[72773]: WARNING oslo_privsep.priv_context [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] privsep daemon already running
Aug 16 22:25:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.179s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:03 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Checking if we can resize image /opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:25:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:03 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Cannot resize image /opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:25:03 user nova-compute[72773]: DEBUG nova.objects.instance [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lazy-loading 'migration_context' on Instance uuid 02227d9f-5ddf-42fe-91a8-ce56d76aa274 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:25:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:25:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Ensure instance console log exists: /opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:25:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3bb17a2-59, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:25:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf3bb17a2-59, col_values=(('external_ids', {'iface-id': 'f3bb17a2-593d-46be-92bc-9b4b64a48174', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:2d:a9', 'vm-uuid': '02235c77-0c2a-4317-8526-7bd5096694a2'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:25:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:25:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:03 user nova-compute[72773]: INFO os_vif [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:2d:a9,bridge_name='br-int',has_traffic_filtering=True,id=f3bb17a2-593d-46be-92bc-9b4b64a48174,network=Network(932581fe-de5a-42af-8214-9fc20f8e3038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3bb17a2-59')
Aug 16 22:25:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1807881-ec, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:25:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd1807881-ec, col_values=(('external_ids', {'iface-id': 'd1807881-ec54-4e55-8f2e-6f8046efd351', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:0f:ad', 'vm-uuid': '956d334e-f190-4625-b144-ab44d2f3321a'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:25:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:25:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:03 user nova-compute[72773]: INFO os_vif [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:0f:ad,bridge_name='br-int',has_traffic_filtering=True,id=d1807881-ec54-4e55-8f2e-6f8046efd351,network=Network(0a6ec813-28f9-4716-bf41-20722c69fe20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1807881-ec')
Aug 16 22:25:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:25:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] No VIF found with MAC fa:16:3e:66:2d:a9, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:25:03 user nova-compute[72773]: DEBUG nova.network.neutron [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Successfully created port: 94d9c8c3-7857-42d7-8e92-2b983bdd3dc6 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:25:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:25:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] No VIF found with MAC fa:16:3e:b5:0f:ad, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:25:04 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:04 user nova-compute[72773]: DEBUG nova.network.neutron [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Successfully created port: 26ca6ee6-83b5-4553-b31c-d1b135b219e9 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:25:04 user nova-compute[72773]: DEBUG nova.network.neutron [req-307ae7b2-a8ef-46f9-9ac0-8b4ceaf4bb14 req-477a01a2-1813-43ff-b6d4-216326caaee9 service nova] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Updated VIF entry in instance network info cache for port f3bb17a2-593d-46be-92bc-9b4b64a48174. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:25:04 user nova-compute[72773]: DEBUG nova.network.neutron [req-307ae7b2-a8ef-46f9-9ac0-8b4ceaf4bb14 req-477a01a2-1813-43ff-b6d4-216326caaee9 service nova] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Updating instance_info_cache with network_info: [{"id": "f3bb17a2-593d-46be-92bc-9b4b64a48174", "address": "fa:16:3e:66:2d:a9", "network": {"id": "932581fe-de5a-42af-8214-9fc20f8e3038", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-982938001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4509d81443b499a8379f558bfad9338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bb17a2-59", "ovs_interfaceid": "f3bb17a2-593d-46be-92bc-9b4b64a48174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:25:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-307ae7b2-a8ef-46f9-9ac0-8b4ceaf4bb14 req-477a01a2-1813-43ff-b6d4-216326caaee9 service nova] Releasing lock "refresh_cache-02235c77-0c2a-4317-8526-7bd5096694a2" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:25:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:06 user nova-compute[72773]: DEBUG nova.network.neutron [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Successfully updated port: 26ca6ee6-83b5-4553-b31c-d1b135b219e9 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:25:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "refresh_cache-02227d9f-5ddf-42fe-91a8-ce56d76aa274" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:25:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquired lock "refresh_cache-02227d9f-5ddf-42fe-91a8-ce56d76aa274" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:25:06 user nova-compute[72773]: DEBUG nova.network.neutron [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:25:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:06 user nova-compute[72773]: DEBUG nova.compute.manager [req-4a49b931-692b-4ab5-a7c5-49b61246ed6b req-225efa8b-bb2f-4d0b-8ff5-2d51e4ada742 service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Received event network-changed-26ca6ee6-83b5-4553-b31c-d1b135b219e9 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:25:06 user nova-compute[72773]: DEBUG nova.compute.manager [req-4a49b931-692b-4ab5-a7c5-49b61246ed6b req-225efa8b-bb2f-4d0b-8ff5-2d51e4ada742 service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Refreshing instance network info cache due to event network-changed-26ca6ee6-83b5-4553-b31c-d1b135b219e9. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:25:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4a49b931-692b-4ab5-a7c5-49b61246ed6b req-225efa8b-bb2f-4d0b-8ff5-2d51e4ada742 service nova] Acquiring lock "refresh_cache-02227d9f-5ddf-42fe-91a8-ce56d76aa274" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:25:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:06 user nova-compute[72773]: DEBUG nova.network.neutron [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:25:06 user nova-compute[72773]: DEBUG nova.network.neutron [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Successfully updated port: 94d9c8c3-7857-42d7-8e92-2b983bdd3dc6 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:25:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "refresh_cache-4efab321-f2aa-456c-a1ae-b32f399f694d" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:25:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquired lock "refresh_cache-4efab321-f2aa-456c-a1ae-b32f399f694d" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:25:06 user nova-compute[72773]: DEBUG nova.network.neutron [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG nova.compute.manager [req-57bffda3-f87f-4faa-be9f-ecf472208450 req-dd5cdd49-b514-4488-8bf4-783cdef2493e service nova] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Received event network-changed-94d9c8c3-7857-42d7-8e92-2b983bdd3dc6 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG nova.compute.manager [req-57bffda3-f87f-4faa-be9f-ecf472208450 req-dd5cdd49-b514-4488-8bf4-783cdef2493e service nova] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Refreshing instance network info cache due to event network-changed-94d9c8c3-7857-42d7-8e92-2b983bdd3dc6. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-57bffda3-f87f-4faa-be9f-ecf472208450 req-dd5cdd49-b514-4488-8bf4-783cdef2493e service nova] Acquiring lock "refresh_cache-4efab321-f2aa-456c-a1ae-b32f399f694d" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG nova.network.neutron [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG nova.network.neutron [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Updating instance_info_cache with network_info: [{"id": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "address": "fa:16:3e:4a:54:e0", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ca6ee6-83", "ovs_interfaceid": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Releasing lock "refresh_cache-02227d9f-5ddf-42fe-91a8-ce56d76aa274" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG nova.compute.manager [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Instance network_info: |[{"id": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "address": "fa:16:3e:4a:54:e0", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ca6ee6-83", "ovs_interfaceid": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4a49b931-692b-4ab5-a7c5-49b61246ed6b req-225efa8b-bb2f-4d0b-8ff5-2d51e4ada742 service nova] Acquired lock "refresh_cache-02227d9f-5ddf-42fe-91a8-ce56d76aa274" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG nova.network.neutron [req-4a49b931-692b-4ab5-a7c5-49b61246ed6b req-225efa8b-bb2f-4d0b-8ff5-2d51e4ada742 service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Refreshing network info cache for port 26ca6ee6-83b5-4553-b31c-d1b135b219e9 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Start _get_guest_xml network_info=[{"id": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "address": "fa:16:3e:4a:54:e0", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ca6ee6-83", "ovs_interfaceid": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:25:07 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:25:07 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:25:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-414068688',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-414068688',id=4,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGC6hdBcq53EaZ+ztnWCq9EEEmf6tlOudhff/uPCsPcoSF0txRuIbNZTZkFR19PxQuLSW0BQsR2r9cbeTZygr/GW6SXxJlq+Wnq0T9ugwZXHOdCCn9YF0qaQknT5h2D+7w==',key_name='tempest-keypair-1733371512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2ef6a37d79341d7a94e5b314efddab4',ramdisk_id='',reservation_id='r-fl923se9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-488184195',owner_user_name='tempest-AttachVolumeShelveTestJSON-488184195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:25:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71cd9d1142ec45e792219e8b789cf2a0',uuid=02227d9f-5ddf-42fe-91a8-ce56d76aa274,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "address": "fa:16:3e:4a:54:e0", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ca6ee6-83", "ovs_interfaceid": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Converting VIF {"id": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "address": "fa:16:3e:4a:54:e0", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ca6ee6-83", "ovs_interfaceid": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:54:e0,bridge_name='br-int',has_traffic_filtering=True,id=26ca6ee6-83b5-4553-b31c-d1b135b219e9,network=Network(9aa7e6bf-5a47-422d-b638-cff5a8429391),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26ca6ee6-83') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG nova.objects.instance [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lazy-loading 'pci_devices' on Instance uuid 02227d9f-5ddf-42fe-91a8-ce56d76aa274 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:25:07 user nova-compute[72773]:   <uuid>02227d9f-5ddf-42fe-91a8-ce56d76aa274</uuid>
Aug 16 22:25:07 user nova-compute[72773]:   <name>instance-00000004</name>
Aug 16 22:25:07 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:25:07 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:25:07 user nova-compute[72773]:   <metadata>
Aug 16 22:25:07 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:25:07 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:25:07 user nova-compute[72773]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-414068688</nova:name>
Aug 16 22:25:07 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:25:07</nova:creationTime>
Aug 16 22:25:07 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:25:07 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:25:07 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:25:07 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:25:07 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:25:07 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:25:07 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:25:07 user nova-compute[72773]:       <nova:owner>
Aug 16 22:25:07 user nova-compute[72773]:         <nova:user uuid="71cd9d1142ec45e792219e8b789cf2a0">tempest-AttachVolumeShelveTestJSON-488184195-project-member</nova:user>
Aug 16 22:25:07 user nova-compute[72773]:         <nova:project uuid="a2ef6a37d79341d7a94e5b314efddab4">tempest-AttachVolumeShelveTestJSON-488184195</nova:project>
Aug 16 22:25:07 user nova-compute[72773]:       </nova:owner>
Aug 16 22:25:07 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:25:07 user nova-compute[72773]:       <nova:ports>
Aug 16 22:25:07 user nova-compute[72773]:         <nova:port uuid="26ca6ee6-83b5-4553-b31c-d1b135b219e9">
Aug 16 22:25:07 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 22:25:07 user nova-compute[72773]:         </nova:port>
Aug 16 22:25:07 user nova-compute[72773]:       </nova:ports>
Aug 16 22:25:07 user nova-compute[72773]:     </nova:instance>
Aug 16 22:25:07 user nova-compute[72773]:   </metadata>
Aug 16 22:25:07 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:25:07 user nova-compute[72773]:     <system>
Aug 16 22:25:07 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:25:07 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:25:07 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:25:07 user nova-compute[72773]:       <entry name="serial">02227d9f-5ddf-42fe-91a8-ce56d76aa274</entry>
Aug 16 22:25:07 user nova-compute[72773]:       <entry name="uuid">02227d9f-5ddf-42fe-91a8-ce56d76aa274</entry>
Aug 16 22:25:07 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:25:07 user nova-compute[72773]:     </system>
Aug 16 22:25:07 user nova-compute[72773]:   </sysinfo>
Aug 16 22:25:07 user nova-compute[72773]:   <os>
Aug 16 22:25:07 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:25:07 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:25:07 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:25:07 user nova-compute[72773]:   </os>
Aug 16 22:25:07 user nova-compute[72773]:   <features>
Aug 16 22:25:07 user nova-compute[72773]:     <acpi/>
Aug 16 22:25:07 user nova-compute[72773]:     <apic/>
Aug 16 22:25:07 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:25:07 user nova-compute[72773]:   </features>
Aug 16 22:25:07 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:25:07 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:25:07 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:25:07 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:25:07 user nova-compute[72773]:   </clock>
Aug 16 22:25:07 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:25:07 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:25:07 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:25:07 user nova-compute[72773]:   </cpu>
Aug 16 22:25:07 user nova-compute[72773]:   <devices>
Aug 16 22:25:07 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:25:07 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:25:07 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk"/>
Aug 16 22:25:07 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:25:07 user nova-compute[72773]:     </disk>
Aug 16 22:25:07 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:25:07 user nova-compute[72773]:       <mac address="fa:16:3e:4a:54:e0"/>
Aug 16 22:25:07 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:25:07 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:25:07 user nova-compute[72773]:       <target dev="tap26ca6ee6-83"/>
Aug 16 22:25:07 user nova-compute[72773]:     </interface>
Aug 16 22:25:07 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:25:07 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/console.log" append="off"/>
Aug 16 22:25:07 user nova-compute[72773]:     </serial>
Aug 16 22:25:07 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:25:07 user nova-compute[72773]:     <video>
Aug 16 22:25:07 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:25:07 user nova-compute[72773]:     </video>
Aug 16 22:25:07 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:25:07 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:25:07 user nova-compute[72773]:     </rng>
Aug 16 22:25:07 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:25:07 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:25:07 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:25:07 user nova-compute[72773]:     </memballoon>
Aug 16 22:25:07 user nova-compute[72773]:   </devices>
Aug 16 22:25:07 user nova-compute[72773]: </domain>
Aug 16 22:25:07 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-414068688',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-414068688',id=4,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGC6hdBcq53EaZ+ztnWCq9EEEmf6tlOudhff/uPCsPcoSF0txRuIbNZTZkFR19PxQuLSW0BQsR2r9cbeTZygr/GW6SXxJlq+Wnq0T9ugwZXHOdCCn9YF0qaQknT5h2D+7w==',key_name='tempest-keypair-1733371512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2ef6a37d79341d7a94e5b314efddab4',ramdisk_id='',reservation_id='r-fl923se9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-488184195',owner_user_name='tempest-AttachVolumeShelveTestJSON-488184195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:25:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71cd9d1142ec45e792219e8b789cf2a0',uuid=02227d9f-5ddf-42fe-91a8-ce56d76aa274,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "address": "fa:16:3e:4a:54:e0", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ca6ee6-83", "ovs_interfaceid": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Converting VIF {"id": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "address": "fa:16:3e:4a:54:e0", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ca6ee6-83", "ovs_interfaceid": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:54:e0,bridge_name='br-int',has_traffic_filtering=True,id=26ca6ee6-83b5-4553-b31c-d1b135b219e9,network=Network(9aa7e6bf-5a47-422d-b638-cff5a8429391),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26ca6ee6-83') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG os_vif [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:54:e0,bridge_name='br-int',has_traffic_filtering=True,id=26ca6ee6-83b5-4553-b31c-d1b135b219e9,network=Network(9aa7e6bf-5a47-422d-b638-cff5a8429391),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26ca6ee6-83') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26ca6ee6-83, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap26ca6ee6-83, col_values=(('external_ids', {'iface-id': '26ca6ee6-83b5-4553-b31c-d1b135b219e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:54:e0', 'vm-uuid': '02227d9f-5ddf-42fe-91a8-ce56d76aa274'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:07 user nova-compute[72773]: INFO os_vif [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:54:e0,bridge_name='br-int',has_traffic_filtering=True,id=26ca6ee6-83b5-4553-b31c-d1b135b219e9,network=Network(9aa7e6bf-5a47-422d-b638-cff5a8429391),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26ca6ee6-83')
Aug 16 22:25:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:25:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] No VIF found with MAC fa:16:3e:4a:54:e0, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.network.neutron [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Updating instance_info_cache with network_info: [{"id": "94d9c8c3-7857-42d7-8e92-2b983bdd3dc6", "address": "fa:16:3e:05:f5:f1", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d9c8c3-78", "ovs_interfaceid": "94d9c8c3-7857-42d7-8e92-2b983bdd3dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Releasing lock "refresh_cache-4efab321-f2aa-456c-a1ae-b32f399f694d" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.compute.manager [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Instance network_info: |[{"id": "94d9c8c3-7857-42d7-8e92-2b983bdd3dc6", "address": "fa:16:3e:05:f5:f1", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d9c8c3-78", "ovs_interfaceid": "94d9c8c3-7857-42d7-8e92-2b983bdd3dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-57bffda3-f87f-4faa-be9f-ecf472208450 req-dd5cdd49-b514-4488-8bf4-783cdef2493e service nova] Acquired lock "refresh_cache-4efab321-f2aa-456c-a1ae-b32f399f694d" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.network.neutron [req-57bffda3-f87f-4faa-be9f-ecf472208450 req-dd5cdd49-b514-4488-8bf4-783cdef2493e service nova] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Refreshing network info cache for port 94d9c8c3-7857-42d7-8e92-2b983bdd3dc6 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Start _get_guest_xml network_info=[{"id": "94d9c8c3-7857-42d7-8e92-2b983bdd3dc6", "address": "fa:16:3e:05:f5:f1", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d9c8c3-78", "ovs_interfaceid": "94d9c8c3-7857-42d7-8e92-2b983bdd3dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:25:08 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:25:08 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:24:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1348965646',display_name='tempest-AttachVolumeNegativeTest-server-1348965646',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1348965646',id=3,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgiWRewC2Qj7MCFuZm5XsSG5+qBpMj50m8UMlDPVMWPOYCjMw+98JOSdiCZj15yI+19kpSknqHpTPxlZFX9opRD1CSGfc2Ian5BiAAwK7I8p43qM6iObvFJTZpEk8tdDw==',key_name='tempest-keypair-1236772400',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc49739a140d40508ea307eedceb9aaa',ramdisk_id='',reservation_id='r-vgwa91ah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-801754299',owner_user_name='tempest-AttachVolumeNegativeTest-801754299-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:25:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3b873f599fc4a2686c154d856bd5f06',uuid=4efab321-f2aa-456c-a1ae-b32f399f694d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94d9c8c3-7857-42d7-8e92-2b983bdd3dc6", "address": "fa:16:3e:05:f5:f1", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d9c8c3-78", "ovs_interfaceid": "94d9c8c3-7857-42d7-8e92-2b983bdd3dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Converting VIF {"id": "94d9c8c3-7857-42d7-8e92-2b983bdd3dc6", "address": "fa:16:3e:05:f5:f1", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d9c8c3-78", "ovs_interfaceid": "94d9c8c3-7857-42d7-8e92-2b983bdd3dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:f5:f1,bridge_name='br-int',has_traffic_filtering=True,id=94d9c8c3-7857-42d7-8e92-2b983bdd3dc6,network=Network(e0974c13-ec74-4a35-95b4-afae254c04a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94d9c8c3-78') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.objects.instance [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lazy-loading 'pci_devices' on Instance uuid 4efab321-f2aa-456c-a1ae-b32f399f694d {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224708.275042, 956d334e-f190-4625-b144-ab44d2f3321a => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:25:08 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] VM Resumed (Lifecycle Event)
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.compute.manager [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.compute.manager [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.network.neutron [req-4a49b931-692b-4ab5-a7c5-49b61246ed6b req-225efa8b-bb2f-4d0b-8ff5-2d51e4ada742 service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Updated VIF entry in instance network info cache for port 26ca6ee6-83b5-4553-b31c-d1b135b219e9. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.network.neutron [req-4a49b931-692b-4ab5-a7c5-49b61246ed6b req-225efa8b-bb2f-4d0b-8ff5-2d51e4ada742 service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Updating instance_info_cache with network_info: [{"id": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "address": "fa:16:3e:4a:54:e0", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ca6ee6-83", "ovs_interfaceid": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:25:08 user nova-compute[72773]:   <uuid>4efab321-f2aa-456c-a1ae-b32f399f694d</uuid>
Aug 16 22:25:08 user nova-compute[72773]:   <name>instance-00000003</name>
Aug 16 22:25:08 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:25:08 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:25:08 user nova-compute[72773]:   <metadata>
Aug 16 22:25:08 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:25:08 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:25:08 user nova-compute[72773]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1348965646</nova:name>
Aug 16 22:25:08 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:25:08</nova:creationTime>
Aug 16 22:25:08 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:25:08 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:25:08 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:25:08 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:25:08 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:25:08 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:25:08 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:25:08 user nova-compute[72773]:       <nova:owner>
Aug 16 22:25:08 user nova-compute[72773]:         <nova:user uuid="d3b873f599fc4a2686c154d856bd5f06">tempest-AttachVolumeNegativeTest-801754299-project-member</nova:user>
Aug 16 22:25:08 user nova-compute[72773]:         <nova:project uuid="dc49739a140d40508ea307eedceb9aaa">tempest-AttachVolumeNegativeTest-801754299</nova:project>
Aug 16 22:25:08 user nova-compute[72773]:       </nova:owner>
Aug 16 22:25:08 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:25:08 user nova-compute[72773]:       <nova:ports>
Aug 16 22:25:08 user nova-compute[72773]:         <nova:port uuid="94d9c8c3-7857-42d7-8e92-2b983bdd3dc6">
Aug 16 22:25:08 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 22:25:08 user nova-compute[72773]:         </nova:port>
Aug 16 22:25:08 user nova-compute[72773]:       </nova:ports>
Aug 16 22:25:08 user nova-compute[72773]:     </nova:instance>
Aug 16 22:25:08 user nova-compute[72773]:   </metadata>
Aug 16 22:25:08 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:25:08 user nova-compute[72773]:     <system>
Aug 16 22:25:08 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:25:08 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:25:08 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:25:08 user nova-compute[72773]:       <entry name="serial">4efab321-f2aa-456c-a1ae-b32f399f694d</entry>
Aug 16 22:25:08 user nova-compute[72773]:       <entry name="uuid">4efab321-f2aa-456c-a1ae-b32f399f694d</entry>
Aug 16 22:25:08 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:25:08 user nova-compute[72773]:     </system>
Aug 16 22:25:08 user nova-compute[72773]:   </sysinfo>
Aug 16 22:25:08 user nova-compute[72773]:   <os>
Aug 16 22:25:08 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:25:08 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:25:08 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:25:08 user nova-compute[72773]:   </os>
Aug 16 22:25:08 user nova-compute[72773]:   <features>
Aug 16 22:25:08 user nova-compute[72773]:     <acpi/>
Aug 16 22:25:08 user nova-compute[72773]:     <apic/>
Aug 16 22:25:08 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:25:08 user nova-compute[72773]:   </features>
Aug 16 22:25:08 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:25:08 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:25:08 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:25:08 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:25:08 user nova-compute[72773]:   </clock>
Aug 16 22:25:08 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:25:08 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:25:08 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:25:08 user nova-compute[72773]:   </cpu>
Aug 16 22:25:08 user nova-compute[72773]:   <devices>
Aug 16 22:25:08 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:25:08 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:25:08 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/disk"/>
Aug 16 22:25:08 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:25:08 user nova-compute[72773]:     </disk>
Aug 16 22:25:08 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:25:08 user nova-compute[72773]:       <mac address="fa:16:3e:05:f5:f1"/>
Aug 16 22:25:08 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:25:08 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:25:08 user nova-compute[72773]:       <target dev="tap94d9c8c3-78"/>
Aug 16 22:25:08 user nova-compute[72773]:     </interface>
Aug 16 22:25:08 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:25:08 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/console.log" append="off"/>
Aug 16 22:25:08 user nova-compute[72773]:     </serial>
Aug 16 22:25:08 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:25:08 user nova-compute[72773]:     <video>
Aug 16 22:25:08 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:25:08 user nova-compute[72773]:     </video>
Aug 16 22:25:08 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:25:08 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:25:08 user nova-compute[72773]:     </rng>
Aug 16 22:25:08 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:25:08 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:25:08 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:25:08 user nova-compute[72773]:     </memballoon>
Aug 16 22:25:08 user nova-compute[72773]:   </devices>
Aug 16 22:25:08 user nova-compute[72773]: </domain>
Aug 16 22:25:08 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:24:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1348965646',display_name='tempest-AttachVolumeNegativeTest-server-1348965646',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1348965646',id=3,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgiWRewC2Qj7MCFuZm5XsSG5+qBpMj50m8UMlDPVMWPOYCjMw+98JOSdiCZj15yI+19kpSknqHpTPxlZFX9opRD1CSGfc2Ian5BiAAwK7I8p43qM6iObvFJTZpEk8tdDw==',key_name='tempest-keypair-1236772400',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc49739a140d40508ea307eedceb9aaa',ramdisk_id='',reservation_id='r-vgwa91ah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-801754299',owner_user_name='tempest-AttachVolumeNegativeTest-801754299-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:25:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3b873f599fc4a2686c154d856bd5f06',uuid=4efab321-f2aa-456c-a1ae-b32f399f694d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94d9c8c3-7857-42d7-8e92-2b983bdd3dc6", "address": "fa:16:3e:05:f5:f1", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d9c8c3-78", "ovs_interfaceid": "94d9c8c3-7857-42d7-8e92-2b983bdd3dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Converting VIF {"id": "94d9c8c3-7857-42d7-8e92-2b983bdd3dc6", "address": "fa:16:3e:05:f5:f1", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d9c8c3-78", "ovs_interfaceid": "94d9c8c3-7857-42d7-8e92-2b983bdd3dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:f5:f1,bridge_name='br-int',has_traffic_filtering=True,id=94d9c8c3-7857-42d7-8e92-2b983bdd3dc6,network=Network(e0974c13-ec74-4a35-95b4-afae254c04a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94d9c8c3-78') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG os_vif [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:f5:f1,bridge_name='br-int',has_traffic_filtering=True,id=94d9c8c3-7857-42d7-8e92-2b983bdd3dc6,network=Network(e0974c13-ec74-4a35-95b4-afae254c04a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94d9c8c3-78') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:25:08 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Instance spawned successfully.
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94d9c8c3-78, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap94d9c8c3-78, col_values=(('external_ids', {'iface-id': '94d9c8c3-7857-42d7-8e92-2b983bdd3dc6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:f5:f1', 'vm-uuid': '4efab321-f2aa-456c-a1ae-b32f399f694d'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:25:08 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Instance spawned successfully.
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4a49b931-692b-4ab5-a7c5-49b61246ed6b req-225efa8b-bb2f-4d0b-8ff5-2d51e4ada742 service nova] Releasing lock "refresh_cache-02227d9f-5ddf-42fe-91a8-ce56d76aa274" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:08 user nova-compute[72773]: INFO os_vif [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:f5:f1,bridge_name='br-int',has_traffic_filtering=True,id=94d9c8c3-7857-42d7-8e92-2b983bdd3dc6,network=Network(e0974c13-ec74-4a35-95b4-afae254c04a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94d9c8c3-78')
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] No VIF found with MAC fa:16:3e:05:f5:f1, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:25:08 user nova-compute[72773]: INFO nova.compute.manager [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Took 12.79 seconds to spawn the instance on the hypervisor.
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.compute.manager [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:25:08 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224708.2806275, 956d334e-f190-4625-b144-ab44d2f3321a => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:25:08 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] VM Started (Lifecycle Event)
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:25:08 user nova-compute[72773]: INFO nova.compute.manager [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Took 17.41 seconds to spawn the instance on the hypervisor.
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.compute.manager [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:25:08 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224708.2854283, 02235c77-0c2a-4317-8526-7bd5096694a2 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:25:08 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] VM Resumed (Lifecycle Event)
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:08 user nova-compute[72773]: INFO nova.compute.manager [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Took 18.37 seconds to build instance.
Aug 16 22:25:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224708.2855258, 02235c77-0c2a-4317-8526-7bd5096694a2 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:25:08 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] VM Started (Lifecycle Event)
Aug 16 22:25:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-55154fc1-c269-49ea-b462-e45c30a57168 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "956d334e-f190-4625-b144-ab44d2f3321a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.582s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:08 user nova-compute[72773]: INFO nova.compute.manager [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Took 13.65 seconds to build instance.
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:25:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-716c9356-1f83-461a-82e7-d6af5d64e090 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Lock "02235c77-0c2a-4317-8526-7bd5096694a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.906s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:09 user nova-compute[72773]: DEBUG nova.network.neutron [req-57bffda3-f87f-4faa-be9f-ecf472208450 req-dd5cdd49-b514-4488-8bf4-783cdef2493e service nova] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Updated VIF entry in instance network info cache for port 94d9c8c3-7857-42d7-8e92-2b983bdd3dc6. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:25:09 user nova-compute[72773]: DEBUG nova.network.neutron [req-57bffda3-f87f-4faa-be9f-ecf472208450 req-dd5cdd49-b514-4488-8bf4-783cdef2493e service nova] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Updating instance_info_cache with network_info: [{"id": "94d9c8c3-7857-42d7-8e92-2b983bdd3dc6", "address": "fa:16:3e:05:f5:f1", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d9c8c3-78", "ovs_interfaceid": "94d9c8c3-7857-42d7-8e92-2b983bdd3dc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:25:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-57bffda3-f87f-4faa-be9f-ecf472208450 req-dd5cdd49-b514-4488-8bf4-783cdef2493e service nova] Releasing lock "refresh_cache-4efab321-f2aa-456c-a1ae-b32f399f694d" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:25:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:12 user nova-compute[72773]: DEBUG nova.compute.manager [req-c1b4d4f7-2474-46e6-8097-dae48d1fa1ab req-60916630-1d0f-4a3a-a9ef-98f810a07371 service nova] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Received event network-vif-plugged-d1807881-ec54-4e55-8f2e-6f8046efd351 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:25:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c1b4d4f7-2474-46e6-8097-dae48d1fa1ab req-60916630-1d0f-4a3a-a9ef-98f810a07371 service nova] Acquiring lock "956d334e-f190-4625-b144-ab44d2f3321a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c1b4d4f7-2474-46e6-8097-dae48d1fa1ab req-60916630-1d0f-4a3a-a9ef-98f810a07371 service nova] Lock "956d334e-f190-4625-b144-ab44d2f3321a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c1b4d4f7-2474-46e6-8097-dae48d1fa1ab req-60916630-1d0f-4a3a-a9ef-98f810a07371 service nova] Lock "956d334e-f190-4625-b144-ab44d2f3321a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:12 user nova-compute[72773]: DEBUG nova.compute.manager [req-c1b4d4f7-2474-46e6-8097-dae48d1fa1ab req-60916630-1d0f-4a3a-a9ef-98f810a07371 service nova] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] No waiting events found dispatching network-vif-plugged-d1807881-ec54-4e55-8f2e-6f8046efd351 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:25:12 user nova-compute[72773]: WARNING nova.compute.manager [req-c1b4d4f7-2474-46e6-8097-dae48d1fa1ab req-60916630-1d0f-4a3a-a9ef-98f810a07371 service nova] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Received unexpected event network-vif-plugged-d1807881-ec54-4e55-8f2e-6f8046efd351 for instance with vm_state active and task_state None.
Aug 16 22:25:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:14 user nova-compute[72773]: DEBUG nova.compute.manager [req-1045f35c-8a04-4c34-9d05-4b1b805d791a req-7b5fcafa-fc4b-4052-b9a4-f9e940e48b50 service nova] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Received event network-vif-plugged-d1807881-ec54-4e55-8f2e-6f8046efd351 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:25:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-1045f35c-8a04-4c34-9d05-4b1b805d791a req-7b5fcafa-fc4b-4052-b9a4-f9e940e48b50 service nova] Acquiring lock "956d334e-f190-4625-b144-ab44d2f3321a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-1045f35c-8a04-4c34-9d05-4b1b805d791a req-7b5fcafa-fc4b-4052-b9a4-f9e940e48b50 service nova] Lock "956d334e-f190-4625-b144-ab44d2f3321a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-1045f35c-8a04-4c34-9d05-4b1b805d791a req-7b5fcafa-fc4b-4052-b9a4-f9e940e48b50 service nova] Lock "956d334e-f190-4625-b144-ab44d2f3321a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:14 user nova-compute[72773]: DEBUG nova.compute.manager [req-1045f35c-8a04-4c34-9d05-4b1b805d791a req-7b5fcafa-fc4b-4052-b9a4-f9e940e48b50 service nova] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] No waiting events found dispatching network-vif-plugged-d1807881-ec54-4e55-8f2e-6f8046efd351 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:25:14 user nova-compute[72773]: WARNING nova.compute.manager [req-1045f35c-8a04-4c34-9d05-4b1b805d791a req-7b5fcafa-fc4b-4052-b9a4-f9e940e48b50 service nova] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Received unexpected event network-vif-plugged-d1807881-ec54-4e55-8f2e-6f8046efd351 for instance with vm_state active and task_state None.
Aug 16 22:25:14 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224714.5222282, 4efab321-f2aa-456c-a1ae-b32f399f694d => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:25:14 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] VM Resumed (Lifecycle Event)
Aug 16 22:25:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:25:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:25:14 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Instance spawned successfully.
Aug 16 22:25:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:25:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:25:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:25:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:14 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:25:14 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224714.5225463, 4efab321-f2aa-456c-a1ae-b32f399f694d => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:25:14 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] VM Started (Lifecycle Event)
Aug 16 22:25:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:25:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:25:14 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:25:14 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224714.7957928, 02227d9f-5ddf-42fe-91a8-ce56d76aa274 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:25:14 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] VM Resumed (Lifecycle Event)
Aug 16 22:25:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:25:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:25:14 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Instance spawned successfully.
Aug 16 22:25:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:25:14 user nova-compute[72773]: INFO nova.compute.manager [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Took 14.77 seconds to spawn the instance on the hypervisor.
Aug 16 22:25:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:25:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:25:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:25:14 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:25:14 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224714.7969518, 02227d9f-5ddf-42fe-91a8-ce56d76aa274 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:25:14 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] VM Started (Lifecycle Event)
Aug 16 22:25:15 user nova-compute[72773]: INFO nova.compute.manager [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Took 12.47 seconds to spawn the instance on the hypervisor.
Aug 16 22:25:15 user nova-compute[72773]: DEBUG nova.compute.manager [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:25:15 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:25:15 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:25:15 user nova-compute[72773]: INFO nova.compute.manager [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Took 15.72 seconds to build instance.
Aug 16 22:25:15 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:25:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-61d55dab-00f8-46bb-ac83-981d451e3a62 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "4efab321-f2aa-456c-a1ae-b32f399f694d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.963s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:15 user nova-compute[72773]: INFO nova.compute.manager [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Took 13.43 seconds to build instance.
Aug 16 22:25:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fa84fbbd-43d2-45ca-95fb-0a925fd27390 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.581s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Acquiring lock "4387131d-7a86-477a-a231-69713b2d965d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Lock "4387131d-7a86-477a-a231-69713b2d965d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:16 user nova-compute[72773]: DEBUG nova.compute.manager [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:25:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:17 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:25:17 user nova-compute[72773]: INFO nova.compute.claims [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Claim successful on node user
Aug 16 22:25:17 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:25:17 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:25:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.801s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:17 user nova-compute[72773]: DEBUG nova.compute.manager [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:25:18 user nova-compute[72773]: DEBUG nova.compute.manager [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:25:18 user nova-compute[72773]: DEBUG nova.network.neutron [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:25:18 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:25:18 user nova-compute[72773]: DEBUG nova.compute.manager [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:25:18 user nova-compute[72773]: DEBUG nova.policy [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '78cd48612b2946d8a32f3256330660e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f27a55e197bd45cab4ca201a5a0b7b04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:25:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:18 user nova-compute[72773]: DEBUG nova.compute.manager [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:25:18 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:25:18 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Creating image(s)
Aug 16 22:25:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Acquiring lock "/opt/stack/data/nova/instances/4387131d-7a86-477a-a231-69713b2d965d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Lock "/opt/stack/data/nova/instances/4387131d-7a86-477a-a231-69713b2d965d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Lock "/opt/stack/data/nova/instances/4387131d-7a86-477a-a231-69713b2d965d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Acquiring lock "c6adfa95-47ac-40d3-abc1-0c6027507f07" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "c6adfa95-47ac-40d3-abc1-0c6027507f07" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:18 user nova-compute[72773]: DEBUG nova.compute.manager [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:25:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.280s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:18 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:25:18 user nova-compute[72773]: INFO nova.compute.claims [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Claim successful on node user
Aug 16 22:25:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.192s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/4387131d-7a86-477a-a231-69713b2d965d/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/4387131d-7a86-477a-a231-69713b2d965d/disk 1073741824" returned: 0 in 0.064s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.266s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:19 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4387131d-7a86-477a-a231-69713b2d965d/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:25:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4387131d-7a86-477a-a231-69713b2d965d/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Acquiring lock "aa4cbd72-a11c-4dab-b2e2-29fe10493931" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lock "aa4cbd72-a11c-4dab-b2e2-29fe10493931" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:19 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:25:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4387131d-7a86-477a-a231-69713b2d965d/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:19 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Cannot resize image /opt/stack/data/nova/instances/4387131d-7a86-477a-a231-69713b2d965d/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:25:19 user nova-compute[72773]: DEBUG nova.objects.instance [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Lazy-loading 'migration_context' on Instance uuid 4387131d-7a86-477a-a231-69713b2d965d {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:25:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:25:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Ensure instance console log exists: /opt/stack/data/nova/instances/4387131d-7a86-477a-a231-69713b2d965d/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:25:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:19 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:25:19 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:25:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.777s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:19 user nova-compute[72773]: DEBUG nova.compute.manager [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:25:19 user nova-compute[72773]: DEBUG nova.network.neutron [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Successfully created port: b757c921-b63d-4724-874a-2b9bd0710124 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:25:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.043s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:19 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:25:19 user nova-compute[72773]: INFO nova.compute.claims [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Claim successful on node user
Aug 16 22:25:19 user nova-compute[72773]: DEBUG nova.compute.manager [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:25:19 user nova-compute[72773]: DEBUG nova.network.neutron [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:25:19 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:25:19 user nova-compute[72773]: DEBUG nova.compute.manager [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:25:19 user nova-compute[72773]: DEBUG nova.policy [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cdc2f4b4e44b46689635994d2d3ab066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086072338454300bb7a455bff6d0757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:25:19 user nova-compute[72773]: DEBUG nova.compute.manager [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:25:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:25:19 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Creating image(s)
Aug 16 22:25:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Acquiring lock "/opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "/opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "/opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.236s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:20 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:25:20 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:25:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.680s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:20 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:25:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.188s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:20 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:25:20 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:25:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk 1073741824" returned: 0 in 0.080s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:20 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 16 22:25:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:20 user nova-compute[72773]: DEBUG nova.network.neutron [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Successfully updated port: b757c921-b63d-4724-874a-2b9bd0710124 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:25:20 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:25:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Acquiring lock "refresh_cache-4387131d-7a86-477a-a231-69713b2d965d" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:25:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Acquired lock "refresh_cache-4387131d-7a86-477a-a231-69713b2d965d" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:25:20 user nova-compute[72773]: DEBUG nova.network.neutron [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:25:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-125a05ae-cc2b-4ba9-8825-8e8dc8581d55 req-b24223a1-49b5-4dd6-8978-a61d5c647ee6 service nova] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Received event network-changed-b757c921-b63d-4724-874a-2b9bd0710124 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:25:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-125a05ae-cc2b-4ba9-8825-8e8dc8581d55 req-b24223a1-49b5-4dd6-8978-a61d5c647ee6 service nova] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Refreshing instance network info cache due to event network-changed-b757c921-b63d-4724-874a-2b9bd0710124. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:25:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-125a05ae-cc2b-4ba9-8825-8e8dc8581d55 req-b24223a1-49b5-4dd6-8978-a61d5c647ee6 service nova] Acquiring lock "refresh_cache-4387131d-7a86-477a-a231-69713b2d965d" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:25:20 user nova-compute[72773]: DEBUG nova.policy [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec229d21f9ca4d6db7758eb42579f4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc901cb159c84701b71722d227c56baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:25:20 user nova-compute[72773]: DEBUG nova.network.neutron [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:25:20 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:25:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:25:20 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Creating image(s)
Aug 16 22:25:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa4cbd72-a11c-4dab-b2e2-29fe10493931/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lock "/opt/stack/data/nova/instances/aa4cbd72-a11c-4dab-b2e2-29fe10493931/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lock "/opt/stack/data/nova/instances/aa4cbd72-a11c-4dab-b2e2-29fe10493931/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Acquiring lock "2d6dba68d0e5e8e46c780821637dacd24f834fcf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lock "2d6dba68d0e5e8e46c780821637dacd24f834fcf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.263s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:20 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:25:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d6dba68d0e5e8e46c780821637dacd24f834fcf.part --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:21 user nova-compute[72773]: DEBUG nova.network.neutron [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Successfully created port: 813736f3-3cf2-4d52-9bf5-239b93647ee2 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:25:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk --force-share --output=json" returned: 0 in 0.505s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:21 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Cannot resize image /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:25:21 user nova-compute[72773]: DEBUG nova.objects.instance [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lazy-loading 'migration_context' on Instance uuid c6adfa95-47ac-40d3-abc1-0c6027507f07 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:25:21 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:25:21 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Ensure instance console log exists: /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:25:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d6dba68d0e5e8e46c780821637dacd24f834fcf.part --force-share --output=json" returned: 0 in 0.243s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:21 user nova-compute[72773]: DEBUG nova.virt.images [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] 9e426ed0-4ff6-486b-b1d1-cbe7b9263905 was qcow2, converting to raw {{(pid=72773) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 22:25:21 user nova-compute[72773]: DEBUG nova.privsep.utils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72773) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 22:25:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2d6dba68d0e5e8e46c780821637dacd24f834fcf.part /opt/stack/data/nova/instances/_base/2d6dba68d0e5e8e46c780821637dacd24f834fcf.converted {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:21 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Successfully created port: c0ab5700-b895-412c-acca-e116a216cc89 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:25:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2d6dba68d0e5e8e46c780821637dacd24f834fcf.part /opt/stack/data/nova/instances/_base/2d6dba68d0e5e8e46c780821637dacd24f834fcf.converted" returned: 0 in 0.317s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d6dba68d0e5e8e46c780821637dacd24f834fcf.converted --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:21 user nova-compute[72773]: DEBUG nova.network.neutron [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Updating instance_info_cache with network_info: [{"id": "b757c921-b63d-4724-874a-2b9bd0710124", "address": "fa:16:3e:30:86:c9", "network": {"id": "5f00189e-3c15-4517-85ba-30c0d1de2ee7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-297270230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f27a55e197bd45cab4ca201a5a0b7b04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb757c921-b6", "ovs_interfaceid": "b757c921-b63d-4724-874a-2b9bd0710124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d6dba68d0e5e8e46c780821637dacd24f834fcf.converted --force-share --output=json" returned: 0 in 0.266s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lock "2d6dba68d0e5e8e46c780821637dacd24f834fcf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.369s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d6dba68d0e5e8e46c780821637dacd24f834fcf --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Releasing lock "refresh_cache-4387131d-7a86-477a-a231-69713b2d965d" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG nova.compute.manager [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Instance network_info: |[{"id": "b757c921-b63d-4724-874a-2b9bd0710124", "address": "fa:16:3e:30:86:c9", "network": {"id": "5f00189e-3c15-4517-85ba-30c0d1de2ee7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-297270230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f27a55e197bd45cab4ca201a5a0b7b04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb757c921-b6", "ovs_interfaceid": "b757c921-b63d-4724-874a-2b9bd0710124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-125a05ae-cc2b-4ba9-8825-8e8dc8581d55 req-b24223a1-49b5-4dd6-8978-a61d5c647ee6 service nova] Acquired lock "refresh_cache-4387131d-7a86-477a-a231-69713b2d965d" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG nova.network.neutron [req-125a05ae-cc2b-4ba9-8825-8e8dc8581d55 req-b24223a1-49b5-4dd6-8978-a61d5c647ee6 service nova] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Refreshing network info cache for port b757c921-b63d-4724-874a-2b9bd0710124 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Start _get_guest_xml network_info=[{"id": "b757c921-b63d-4724-874a-2b9bd0710124", "address": "fa:16:3e:30:86:c9", "network": {"id": "5f00189e-3c15-4517-85ba-30c0d1de2ee7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-297270230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f27a55e197bd45cab4ca201a5a0b7b04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb757c921-b6", "ovs_interfaceid": "b757c921-b63d-4724-874a-2b9bd0710124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:25:22 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:25:22 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:25:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:25:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2115442895',display_name='tempest-VolumesAssistedSnapshotsTest-server-2115442895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2115442895',id=5,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRYhDfT8rkTuCsZud1B58oN0/sq0ayADgvTT4dRhw6mj+39kDHlhNko4F5UZFPEEfuRf9N2oVO5oBiwjHotKtCVc32bGePrGAb4rqgllL0eelRZutnbU0nxTtrxOh/p7w==',key_name='tempest-keypair-2081781708',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f27a55e197bd45cab4ca201a5a0b7b04',ramdisk_id='',reservation_id='r-8uvuspab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-179215479',owner_user_name='tempest-VolumesAssistedSnapshotsTest-179215479-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:25:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78cd48612b2946d8a32f3256330660e4',uuid=4387131d-7a86-477a-a231-69713b2d965d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b757c921-b63d-4724-874a-2b9bd0710124", "address": "fa:16:3e:30:86:c9", "network": {"id": "5f00189e-3c15-4517-85ba-30c0d1de2ee7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-297270230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f27a55e197bd45cab4ca201a5a0b7b04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb757c921-b6", "ovs_interfaceid": "b757c921-b63d-4724-874a-2b9bd0710124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Converting VIF {"id": "b757c921-b63d-4724-874a-2b9bd0710124", "address": "fa:16:3e:30:86:c9", "network": {"id": "5f00189e-3c15-4517-85ba-30c0d1de2ee7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-297270230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f27a55e197bd45cab4ca201a5a0b7b04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb757c921-b6", "ovs_interfaceid": "b757c921-b63d-4724-874a-2b9bd0710124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:86:c9,bridge_name='br-int',has_traffic_filtering=True,id=b757c921-b63d-4724-874a-2b9bd0710124,network=Network(5f00189e-3c15-4517-85ba-30c0d1de2ee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb757c921-b6') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG nova.objects.instance [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Lazy-loading 'pci_devices' on Instance uuid 4387131d-7a86-477a-a231-69713b2d965d {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:25:22 user nova-compute[72773]:   <uuid>4387131d-7a86-477a-a231-69713b2d965d</uuid>
Aug 16 22:25:22 user nova-compute[72773]:   <name>instance-00000005</name>
Aug 16 22:25:22 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:25:22 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:25:22 user nova-compute[72773]:   <metadata>
Aug 16 22:25:22 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:25:22 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:25:22 user nova-compute[72773]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-2115442895</nova:name>
Aug 16 22:25:22 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:25:22</nova:creationTime>
Aug 16 22:25:22 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:25:22 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:25:22 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:25:22 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:25:22 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:25:22 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:25:22 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:25:22 user nova-compute[72773]:       <nova:owner>
Aug 16 22:25:22 user nova-compute[72773]:         <nova:user uuid="78cd48612b2946d8a32f3256330660e4">tempest-VolumesAssistedSnapshotsTest-179215479-project-member</nova:user>
Aug 16 22:25:22 user nova-compute[72773]:         <nova:project uuid="f27a55e197bd45cab4ca201a5a0b7b04">tempest-VolumesAssistedSnapshotsTest-179215479</nova:project>
Aug 16 22:25:22 user nova-compute[72773]:       </nova:owner>
Aug 16 22:25:22 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:25:22 user nova-compute[72773]:       <nova:ports>
Aug 16 22:25:22 user nova-compute[72773]:         <nova:port uuid="b757c921-b63d-4724-874a-2b9bd0710124">
Aug 16 22:25:22 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 22:25:22 user nova-compute[72773]:         </nova:port>
Aug 16 22:25:22 user nova-compute[72773]:       </nova:ports>
Aug 16 22:25:22 user nova-compute[72773]:     </nova:instance>
Aug 16 22:25:22 user nova-compute[72773]:   </metadata>
Aug 16 22:25:22 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:25:22 user nova-compute[72773]:     <system>
Aug 16 22:25:22 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:25:22 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:25:22 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:25:22 user nova-compute[72773]:       <entry name="serial">4387131d-7a86-477a-a231-69713b2d965d</entry>
Aug 16 22:25:22 user nova-compute[72773]:       <entry name="uuid">4387131d-7a86-477a-a231-69713b2d965d</entry>
Aug 16 22:25:22 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:25:22 user nova-compute[72773]:     </system>
Aug 16 22:25:22 user nova-compute[72773]:   </sysinfo>
Aug 16 22:25:22 user nova-compute[72773]:   <os>
Aug 16 22:25:22 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:25:22 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:25:22 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:25:22 user nova-compute[72773]:   </os>
Aug 16 22:25:22 user nova-compute[72773]:   <features>
Aug 16 22:25:22 user nova-compute[72773]:     <acpi/>
Aug 16 22:25:22 user nova-compute[72773]:     <apic/>
Aug 16 22:25:22 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:25:22 user nova-compute[72773]:   </features>
Aug 16 22:25:22 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:25:22 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:25:22 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:25:22 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:25:22 user nova-compute[72773]:   </clock>
Aug 16 22:25:22 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:25:22 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:25:22 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:25:22 user nova-compute[72773]:   </cpu>
Aug 16 22:25:22 user nova-compute[72773]:   <devices>
Aug 16 22:25:22 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:25:22 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:25:22 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/4387131d-7a86-477a-a231-69713b2d965d/disk"/>
Aug 16 22:25:22 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:25:22 user nova-compute[72773]:     </disk>
Aug 16 22:25:22 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:25:22 user nova-compute[72773]:       <mac address="fa:16:3e:30:86:c9"/>
Aug 16 22:25:22 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:25:22 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:25:22 user nova-compute[72773]:       <target dev="tapb757c921-b6"/>
Aug 16 22:25:22 user nova-compute[72773]:     </interface>
Aug 16 22:25:22 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:25:22 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/4387131d-7a86-477a-a231-69713b2d965d/console.log" append="off"/>
Aug 16 22:25:22 user nova-compute[72773]:     </serial>
Aug 16 22:25:22 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:25:22 user nova-compute[72773]:     <video>
Aug 16 22:25:22 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:25:22 user nova-compute[72773]:     </video>
Aug 16 22:25:22 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:25:22 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:25:22 user nova-compute[72773]:     </rng>
Aug 16 22:25:22 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:25:22 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:25:22 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:25:22 user nova-compute[72773]:     </memballoon>
Aug 16 22:25:22 user nova-compute[72773]:   </devices>
Aug 16 22:25:22 user nova-compute[72773]: </domain>
Aug 16 22:25:22 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:25:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2115442895',display_name='tempest-VolumesAssistedSnapshotsTest-server-2115442895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2115442895',id=5,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRYhDfT8rkTuCsZud1B58oN0/sq0ayADgvTT4dRhw6mj+39kDHlhNko4F5UZFPEEfuRf9N2oVO5oBiwjHotKtCVc32bGePrGAb4rqgllL0eelRZutnbU0nxTtrxOh/p7w==',key_name='tempest-keypair-2081781708',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f27a55e197bd45cab4ca201a5a0b7b04',ramdisk_id='',reservation_id='r-8uvuspab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-179215479',owner_user_name='tempest-VolumesAssistedSnapshotsTest-179215479-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:25:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78cd48612b2946d8a32f3256330660e4',uuid=4387131d-7a86-477a-a231-69713b2d965d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b757c921-b63d-4724-874a-2b9bd0710124", "address": "fa:16:3e:30:86:c9", "network": {"id": "5f00189e-3c15-4517-85ba-30c0d1de2ee7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-297270230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f27a55e197bd45cab4ca201a5a0b7b04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb757c921-b6", "ovs_interfaceid": "b757c921-b63d-4724-874a-2b9bd0710124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Converting VIF {"id": "b757c921-b63d-4724-874a-2b9bd0710124", "address": "fa:16:3e:30:86:c9", "network": {"id": "5f00189e-3c15-4517-85ba-30c0d1de2ee7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-297270230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f27a55e197bd45cab4ca201a5a0b7b04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb757c921-b6", "ovs_interfaceid": "b757c921-b63d-4724-874a-2b9bd0710124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:86:c9,bridge_name='br-int',has_traffic_filtering=True,id=b757c921-b63d-4724-874a-2b9bd0710124,network=Network(5f00189e-3c15-4517-85ba-30c0d1de2ee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb757c921-b6') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG os_vif [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:86:c9,bridge_name='br-int',has_traffic_filtering=True,id=b757c921-b63d-4724-874a-2b9bd0710124,network=Network(5f00189e-3c15-4517-85ba-30c0d1de2ee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb757c921-b6') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d6dba68d0e5e8e46c780821637dacd24f834fcf --force-share --output=json" returned: 0 in 0.235s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Acquiring lock "2d6dba68d0e5e8e46c780821637dacd24f834fcf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lock "2d6dba68d0e5e8e46c780821637dacd24f834fcf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d6dba68d0e5e8e46c780821637dacd24f834fcf --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb757c921-b6, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb757c921-b6, col_values=(('external_ids', {'iface-id': 'b757c921-b63d-4724-874a-2b9bd0710124', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:86:c9', 'vm-uuid': '4387131d-7a86-477a-a231-69713b2d965d'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:25:22 user nova-compute[72773]: INFO os_vif [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:86:c9,bridge_name='br-int',has_traffic_filtering=True,id=b757c921-b63d-4724-874a-2b9bd0710124,network=Network(5f00189e-3c15-4517-85ba-30c0d1de2ee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb757c921-b6')
Aug 16 22:25:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] No VIF found with MAC fa:16:3e:30:86:c9, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d6dba68d0e5e8e46c780821637dacd24f834fcf --force-share --output=json" returned: 0 in 0.246s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2d6dba68d0e5e8e46c780821637dacd24f834fcf,backing_fmt=raw /opt/stack/data/nova/instances/aa4cbd72-a11c-4dab-b2e2-29fe10493931/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2d6dba68d0e5e8e46c780821637dacd24f834fcf,backing_fmt=raw /opt/stack/data/nova/instances/aa4cbd72-a11c-4dab-b2e2-29fe10493931/disk 1073741824" returned: 0 in 0.088s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lock "2d6dba68d0e5e8e46c780821637dacd24f834fcf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.358s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d6dba68d0e5e8e46c780821637dacd24f834fcf --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG nova.network.neutron [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Successfully updated port: 813736f3-3cf2-4d52-9bf5-239b93647ee2 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Acquiring lock "refresh_cache-c6adfa95-47ac-40d3-abc1-0c6027507f07" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Acquired lock "refresh_cache-c6adfa95-47ac-40d3-abc1-0c6027507f07" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG nova.network.neutron [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG nova.compute.manager [req-830659cd-9ce5-4dc9-ba03-066a8451815a req-bd7cf17e-1746-4478-a52d-3d5764597711 service nova] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Received event network-changed-813736f3-3cf2-4d52-9bf5-239b93647ee2 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG nova.compute.manager [req-830659cd-9ce5-4dc9-ba03-066a8451815a req-bd7cf17e-1746-4478-a52d-3d5764597711 service nova] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Refreshing instance network info cache due to event network-changed-813736f3-3cf2-4d52-9bf5-239b93647ee2. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-830659cd-9ce5-4dc9-ba03-066a8451815a req-bd7cf17e-1746-4478-a52d-3d5764597711 service nova] Acquiring lock "refresh_cache-c6adfa95-47ac-40d3-abc1-0c6027507f07" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG nova.network.neutron [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d6dba68d0e5e8e46c780821637dacd24f834fcf --force-share --output=json" returned: 0 in 0.273s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa4cbd72-a11c-4dab-b2e2-29fe10493931/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:25:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa4cbd72-a11c-4dab-b2e2-29fe10493931/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa4cbd72-a11c-4dab-b2e2-29fe10493931/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Cannot resize image /opt/stack/data/nova/instances/aa4cbd72-a11c-4dab-b2e2-29fe10493931/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.objects.instance [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lazy-loading 'migration_context' on Instance uuid aa4cbd72-a11c-4dab-b2e2-29fe10493931 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Ensure instance console log exists: /opt/stack/data/nova/instances/aa4cbd72-a11c-4dab-b2e2-29fe10493931/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.network.neutron [req-125a05ae-cc2b-4ba9-8825-8e8dc8581d55 req-b24223a1-49b5-4dd6-8978-a61d5c647ee6 service nova] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Updated VIF entry in instance network info cache for port b757c921-b63d-4724-874a-2b9bd0710124. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.network.neutron [req-125a05ae-cc2b-4ba9-8825-8e8dc8581d55 req-b24223a1-49b5-4dd6-8978-a61d5c647ee6 service nova] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Updating instance_info_cache with network_info: [{"id": "b757c921-b63d-4724-874a-2b9bd0710124", "address": "fa:16:3e:30:86:c9", "network": {"id": "5f00189e-3c15-4517-85ba-30c0d1de2ee7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-297270230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f27a55e197bd45cab4ca201a5a0b7b04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb757c921-b6", "ovs_interfaceid": "b757c921-b63d-4724-874a-2b9bd0710124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-125a05ae-cc2b-4ba9-8825-8e8dc8581d55 req-b24223a1-49b5-4dd6-8978-a61d5c647ee6 service nova] Releasing lock "refresh_cache-4387131d-7a86-477a-a231-69713b2d965d" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Successfully updated port: c0ab5700-b895-412c-acca-e116a216cc89 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Acquiring lock "refresh_cache-aa4cbd72-a11c-4dab-b2e2-29fe10493931" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Acquired lock "refresh_cache-aa4cbd72-a11c-4dab-b2e2-29fe10493931" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.compute.manager [req-fca795ab-522b-466a-83c3-0883c3e75bf2 req-41c8875b-5dcf-4e44-8565-8c7739babe19 service nova] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Received event network-changed-c0ab5700-b895-412c-acca-e116a216cc89 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.compute.manager [req-fca795ab-522b-466a-83c3-0883c3e75bf2 req-41c8875b-5dcf-4e44-8565-8c7739babe19 service nova] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Refreshing instance network info cache due to event network-changed-c0ab5700-b895-412c-acca-e116a216cc89. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fca795ab-522b-466a-83c3-0883c3e75bf2 req-41c8875b-5dcf-4e44-8565-8c7739babe19 service nova] Acquiring lock "refresh_cache-aa4cbd72-a11c-4dab-b2e2-29fe10493931" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.network.neutron [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Updating instance_info_cache with network_info: [{"id": "813736f3-3cf2-4d52-9bf5-239b93647ee2", "address": "fa:16:3e:55:99:4d", "network": {"id": "db5b9d7a-8d3c-409c-961b-9bd7d882664c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1507737858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9086072338454300bb7a455bff6d0757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813736f3-3c", "ovs_interfaceid": "813736f3-3cf2-4d52-9bf5-239b93647ee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Releasing lock "refresh_cache-c6adfa95-47ac-40d3-abc1-0c6027507f07" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.compute.manager [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Instance network_info: |[{"id": "813736f3-3cf2-4d52-9bf5-239b93647ee2", "address": "fa:16:3e:55:99:4d", "network": {"id": "db5b9d7a-8d3c-409c-961b-9bd7d882664c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1507737858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9086072338454300bb7a455bff6d0757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813736f3-3c", "ovs_interfaceid": "813736f3-3cf2-4d52-9bf5-239b93647ee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-830659cd-9ce5-4dc9-ba03-066a8451815a req-bd7cf17e-1746-4478-a52d-3d5764597711 service nova] Acquired lock "refresh_cache-c6adfa95-47ac-40d3-abc1-0c6027507f07" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.network.neutron [req-830659cd-9ce5-4dc9-ba03-066a8451815a req-bd7cf17e-1746-4478-a52d-3d5764597711 service nova] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Refreshing network info cache for port 813736f3-3cf2-4d52-9bf5-239b93647ee2 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Start _get_guest_xml network_info=[{"id": "813736f3-3cf2-4d52-9bf5-239b93647ee2", "address": "fa:16:3e:55:99:4d", "network": {"id": "db5b9d7a-8d3c-409c-961b-9bd7d882664c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1507737858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9086072338454300bb7a455bff6d0757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813736f3-3c", "ovs_interfaceid": "813736f3-3cf2-4d52-9bf5-239b93647ee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:25:23 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:25:23 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1294117104',display_name='tempest-VolumesAdminNegativeTest-server-1294117104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1294117104',id=6,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRWMftQ781JjYb0nzJaJuH2EAbEFNHAEEcXrOdOb0hALI/gs1sWKQ19FdNW8Om2Wh+Jz8h0z2FvT9bMF633wJJdBAFuAafzLnJxOEw1w7o2MkwWNxLorN7il/4PzN1jHQ==',key_name='tempest-keypair-1243701256',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9086072338454300bb7a455bff6d0757',ramdisk_id='',reservation_id='r-76ggpaa1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2096874148',owner_user_name='tempest-VolumesAdminNegativeTest-2096874148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:25:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cdc2f4b4e44b46689635994d2d3ab066',uuid=c6adfa95-47ac-40d3-abc1-0c6027507f07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "813736f3-3cf2-4d52-9bf5-239b93647ee2", "address": "fa:16:3e:55:99:4d", "network": {"id": "db5b9d7a-8d3c-409c-961b-9bd7d882664c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1507737858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9086072338454300bb7a455bff6d0757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813736f3-3c", "ovs_interfaceid": "813736f3-3cf2-4d52-9bf5-239b93647ee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Converting VIF {"id": "813736f3-3cf2-4d52-9bf5-239b93647ee2", "address": "fa:16:3e:55:99:4d", "network": {"id": "db5b9d7a-8d3c-409c-961b-9bd7d882664c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1507737858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9086072338454300bb7a455bff6d0757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813736f3-3c", "ovs_interfaceid": "813736f3-3cf2-4d52-9bf5-239b93647ee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:99:4d,bridge_name='br-int',has_traffic_filtering=True,id=813736f3-3cf2-4d52-9bf5-239b93647ee2,network=Network(db5b9d7a-8d3c-409c-961b-9bd7d882664c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap813736f3-3c') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.objects.instance [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lazy-loading 'pci_devices' on Instance uuid c6adfa95-47ac-40d3-abc1-0c6027507f07 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:25:23 user nova-compute[72773]:   <uuid>c6adfa95-47ac-40d3-abc1-0c6027507f07</uuid>
Aug 16 22:25:23 user nova-compute[72773]:   <name>instance-00000006</name>
Aug 16 22:25:23 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:25:23 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:25:23 user nova-compute[72773]:   <metadata>
Aug 16 22:25:23 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:25:23 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:25:23 user nova-compute[72773]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1294117104</nova:name>
Aug 16 22:25:23 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:25:23</nova:creationTime>
Aug 16 22:25:23 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:25:23 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:25:23 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:25:23 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:25:23 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:25:23 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:25:23 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:25:23 user nova-compute[72773]:       <nova:owner>
Aug 16 22:25:23 user nova-compute[72773]:         <nova:user uuid="cdc2f4b4e44b46689635994d2d3ab066">tempest-VolumesAdminNegativeTest-2096874148-project-member</nova:user>
Aug 16 22:25:23 user nova-compute[72773]:         <nova:project uuid="9086072338454300bb7a455bff6d0757">tempest-VolumesAdminNegativeTest-2096874148</nova:project>
Aug 16 22:25:23 user nova-compute[72773]:       </nova:owner>
Aug 16 22:25:23 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:25:23 user nova-compute[72773]:       <nova:ports>
Aug 16 22:25:23 user nova-compute[72773]:         <nova:port uuid="813736f3-3cf2-4d52-9bf5-239b93647ee2">
Aug 16 22:25:23 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 22:25:23 user nova-compute[72773]:         </nova:port>
Aug 16 22:25:23 user nova-compute[72773]:       </nova:ports>
Aug 16 22:25:23 user nova-compute[72773]:     </nova:instance>
Aug 16 22:25:23 user nova-compute[72773]:   </metadata>
Aug 16 22:25:23 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:25:23 user nova-compute[72773]:     <system>
Aug 16 22:25:23 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:25:23 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:25:23 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:25:23 user nova-compute[72773]:       <entry name="serial">c6adfa95-47ac-40d3-abc1-0c6027507f07</entry>
Aug 16 22:25:23 user nova-compute[72773]:       <entry name="uuid">c6adfa95-47ac-40d3-abc1-0c6027507f07</entry>
Aug 16 22:25:23 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:25:23 user nova-compute[72773]:     </system>
Aug 16 22:25:23 user nova-compute[72773]:   </sysinfo>
Aug 16 22:25:23 user nova-compute[72773]:   <os>
Aug 16 22:25:23 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:25:23 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:25:23 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:25:23 user nova-compute[72773]:   </os>
Aug 16 22:25:23 user nova-compute[72773]:   <features>
Aug 16 22:25:23 user nova-compute[72773]:     <acpi/>
Aug 16 22:25:23 user nova-compute[72773]:     <apic/>
Aug 16 22:25:23 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:25:23 user nova-compute[72773]:   </features>
Aug 16 22:25:23 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:25:23 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:25:23 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:25:23 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:25:23 user nova-compute[72773]:   </clock>
Aug 16 22:25:23 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:25:23 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:25:23 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:25:23 user nova-compute[72773]:   </cpu>
Aug 16 22:25:23 user nova-compute[72773]:   <devices>
Aug 16 22:25:23 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:25:23 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:25:23 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk"/>
Aug 16 22:25:23 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:25:23 user nova-compute[72773]:     </disk>
Aug 16 22:25:23 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:25:23 user nova-compute[72773]:       <mac address="fa:16:3e:55:99:4d"/>
Aug 16 22:25:23 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:25:23 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:25:23 user nova-compute[72773]:       <target dev="tap813736f3-3c"/>
Aug 16 22:25:23 user nova-compute[72773]:     </interface>
Aug 16 22:25:23 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:25:23 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/console.log" append="off"/>
Aug 16 22:25:23 user nova-compute[72773]:     </serial>
Aug 16 22:25:23 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:25:23 user nova-compute[72773]:     <video>
Aug 16 22:25:23 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:25:23 user nova-compute[72773]:     </video>
Aug 16 22:25:23 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:25:23 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:25:23 user nova-compute[72773]:     </rng>
Aug 16 22:25:23 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:25:23 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:25:23 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:25:23 user nova-compute[72773]:     </memballoon>
Aug 16 22:25:23 user nova-compute[72773]:   </devices>
Aug 16 22:25:23 user nova-compute[72773]: </domain>
Aug 16 22:25:23 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1294117104',display_name='tempest-VolumesAdminNegativeTest-server-1294117104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1294117104',id=6,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRWMftQ781JjYb0nzJaJuH2EAbEFNHAEEcXrOdOb0hALI/gs1sWKQ19FdNW8Om2Wh+Jz8h0z2FvT9bMF633wJJdBAFuAafzLnJxOEw1w7o2MkwWNxLorN7il/4PzN1jHQ==',key_name='tempest-keypair-1243701256',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9086072338454300bb7a455bff6d0757',ramdisk_id='',reservation_id='r-76ggpaa1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2096874148',owner_user_name='tempest-VolumesAdminNegativeTest-2096874148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:25:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cdc2f4b4e44b46689635994d2d3ab066',uuid=c6adfa95-47ac-40d3-abc1-0c6027507f07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "813736f3-3cf2-4d52-9bf5-239b93647ee2", "address": "fa:16:3e:55:99:4d", "network": {"id": "db5b9d7a-8d3c-409c-961b-9bd7d882664c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1507737858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9086072338454300bb7a455bff6d0757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813736f3-3c", "ovs_interfaceid": "813736f3-3cf2-4d52-9bf5-239b93647ee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Converting VIF {"id": "813736f3-3cf2-4d52-9bf5-239b93647ee2", "address": "fa:16:3e:55:99:4d", "network": {"id": "db5b9d7a-8d3c-409c-961b-9bd7d882664c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1507737858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9086072338454300bb7a455bff6d0757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813736f3-3c", "ovs_interfaceid": "813736f3-3cf2-4d52-9bf5-239b93647ee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:99:4d,bridge_name='br-int',has_traffic_filtering=True,id=813736f3-3cf2-4d52-9bf5-239b93647ee2,network=Network(db5b9d7a-8d3c-409c-961b-9bd7d882664c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap813736f3-3c') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG os_vif [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:99:4d,bridge_name='br-int',has_traffic_filtering=True,id=813736f3-3cf2-4d52-9bf5-239b93647ee2,network=Network(db5b9d7a-8d3c-409c-961b-9bd7d882664c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap813736f3-3c') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap813736f3-3c, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap813736f3-3c, col_values=(('external_ids', {'iface-id': '813736f3-3cf2-4d52-9bf5-239b93647ee2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:99:4d', 'vm-uuid': 'c6adfa95-47ac-40d3-abc1-0c6027507f07'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:23 user nova-compute[72773]: INFO os_vif [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:99:4d,bridge_name='br-int',has_traffic_filtering=True,id=813736f3-3cf2-4d52-9bf5-239b93647ee2,network=Network(db5b9d7a-8d3c-409c-961b-9bd7d882664c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap813736f3-3c')
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:25:23 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] No VIF found with MAC fa:16:3e:55:99:4d, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Updating instance_info_cache with network_info: [{"id": "c0ab5700-b895-412c-acca-e116a216cc89", "address": "fa:16:3e:19:53:af", "network": {"id": "03be4829-78f7-42b1-8d1d-742719d2e16d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-503860176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc901cb159c84701b71722d227c56baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ab5700-b8", "ovs_interfaceid": "c0ab5700-b895-412c-acca-e116a216cc89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Releasing lock "refresh_cache-aa4cbd72-a11c-4dab-b2e2-29fe10493931" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Instance network_info: |[{"id": "c0ab5700-b895-412c-acca-e116a216cc89", "address": "fa:16:3e:19:53:af", "network": {"id": "03be4829-78f7-42b1-8d1d-742719d2e16d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-503860176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc901cb159c84701b71722d227c56baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ab5700-b8", "ovs_interfaceid": "c0ab5700-b895-412c-acca-e116a216cc89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fca795ab-522b-466a-83c3-0883c3e75bf2 req-41c8875b-5dcf-4e44-8565-8c7739babe19 service nova] Acquired lock "refresh_cache-aa4cbd72-a11c-4dab-b2e2-29fe10493931" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG nova.network.neutron [req-fca795ab-522b-466a-83c3-0883c3e75bf2 req-41c8875b-5dcf-4e44-8565-8c7739babe19 service nova] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Refreshing network info cache for port c0ab5700-b895-412c-acca-e116a216cc89 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Start _get_guest_xml network_info=[{"id": "c0ab5700-b895-412c-acca-e116a216cc89", "address": "fa:16:3e:19:53:af", "network": {"id": "03be4829-78f7-42b1-8d1d-742719d2e16d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-503860176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc901cb159c84701b71722d227c56baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ab5700-b8", "ovs_interfaceid": "c0ab5700-b895-412c-acca-e116a216cc89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:25:11Z,direct_url=<?>,disk_format='qcow2',id=9e426ed0-4ff6-486b-b1d1-cbe7b9263905,min_disk=0,min_ram=0,name='',owner='d5b143ad70064a68a43abebff111c867',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:25:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/sda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'scsi', 'encrypted': False, 'image_id': '9e426ed0-4ff6-486b-b1d1-cbe7b9263905'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:24 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:25:24 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:25:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:25:11Z,direct_url=<?>,disk_format='qcow2',id=9e426ed0-4ff6-486b-b1d1-cbe7b9263905,min_disk=0,min_ram=0,name='',owner='d5b143ad70064a68a43abebff111c867',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:25:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:25:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-746378066',display_name='tempest-AttachSCSIVolumeTestJSON-server-746378066',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-746378066',id=7,image_ref='9e426ed0-4ff6-486b-b1d1-cbe7b9263905',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGK0Gwr1cE4s9SCf2MyvVFkEYgrkfLF28DejcAaX+XTTMVNBYt/JM5oTmiSbyJ43fEpvHckCm9aXpHl6+jLHKBYXqubFEinZkrnlQFL1v+Emqll/C2MfqevylzENFPV5Cw==',key_name='tempest-keypair-1212077302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc901cb159c84701b71722d227c56baf',ramdisk_id='',reservation_id='r-39mxluxs',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9e426ed0-4ff6-486b-b1d1-cbe7b9263905',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-445128069',owner_user_name='tempest-AttachSCSIVolumeTestJSON-445128069-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:25:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec229d21f9ca4d6db7758eb42579f4e9',uuid=aa4cbd72-a11c-4dab-b2e2-29fe10493931,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0ab5700-b895-412c-acca-e116a216cc89", "address": "fa:16:3e:19:53:af", "network": {"id": "03be4829-78f7-42b1-8d1d-742719d2e16d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-503860176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc901cb159c84701b71722d227c56baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ab5700-b8", "ovs_interfaceid": "c0ab5700-b895-412c-acca-e116a216cc89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Converting VIF {"id": "c0ab5700-b895-412c-acca-e116a216cc89", "address": "fa:16:3e:19:53:af", "network": {"id": "03be4829-78f7-42b1-8d1d-742719d2e16d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-503860176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc901cb159c84701b71722d227c56baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ab5700-b8", "ovs_interfaceid": "c0ab5700-b895-412c-acca-e116a216cc89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:53:af,bridge_name='br-int',has_traffic_filtering=True,id=c0ab5700-b895-412c-acca-e116a216cc89,network=Network(03be4829-78f7-42b1-8d1d-742719d2e16d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ab5700-b8') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG nova.objects.instance [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lazy-loading 'pci_devices' on Instance uuid aa4cbd72-a11c-4dab-b2e2-29fe10493931 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:25:24 user nova-compute[72773]:   <uuid>aa4cbd72-a11c-4dab-b2e2-29fe10493931</uuid>
Aug 16 22:25:24 user nova-compute[72773]:   <name>instance-00000007</name>
Aug 16 22:25:24 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:25:24 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:25:24 user nova-compute[72773]:   <metadata>
Aug 16 22:25:24 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:25:24 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:25:24 user nova-compute[72773]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-746378066</nova:name>
Aug 16 22:25:24 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:25:24</nova:creationTime>
Aug 16 22:25:24 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:25:24 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:25:24 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:25:24 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:25:24 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:25:24 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:25:24 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:25:24 user nova-compute[72773]:       <nova:owner>
Aug 16 22:25:24 user nova-compute[72773]:         <nova:user uuid="ec229d21f9ca4d6db7758eb42579f4e9">tempest-AttachSCSIVolumeTestJSON-445128069-project-member</nova:user>
Aug 16 22:25:24 user nova-compute[72773]:         <nova:project uuid="fc901cb159c84701b71722d227c56baf">tempest-AttachSCSIVolumeTestJSON-445128069</nova:project>
Aug 16 22:25:24 user nova-compute[72773]:       </nova:owner>
Aug 16 22:25:24 user nova-compute[72773]:       <nova:root type="image" uuid="9e426ed0-4ff6-486b-b1d1-cbe7b9263905"/>
Aug 16 22:25:24 user nova-compute[72773]:       <nova:ports>
Aug 16 22:25:24 user nova-compute[72773]:         <nova:port uuid="c0ab5700-b895-412c-acca-e116a216cc89">
Aug 16 22:25:24 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 22:25:24 user nova-compute[72773]:         </nova:port>
Aug 16 22:25:24 user nova-compute[72773]:       </nova:ports>
Aug 16 22:25:24 user nova-compute[72773]:     </nova:instance>
Aug 16 22:25:24 user nova-compute[72773]:   </metadata>
Aug 16 22:25:24 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:25:24 user nova-compute[72773]:     <system>
Aug 16 22:25:24 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:25:24 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:25:24 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:25:24 user nova-compute[72773]:       <entry name="serial">aa4cbd72-a11c-4dab-b2e2-29fe10493931</entry>
Aug 16 22:25:24 user nova-compute[72773]:       <entry name="uuid">aa4cbd72-a11c-4dab-b2e2-29fe10493931</entry>
Aug 16 22:25:24 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:25:24 user nova-compute[72773]:     </system>
Aug 16 22:25:24 user nova-compute[72773]:   </sysinfo>
Aug 16 22:25:24 user nova-compute[72773]:   <os>
Aug 16 22:25:24 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:25:24 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:25:24 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:25:24 user nova-compute[72773]:   </os>
Aug 16 22:25:24 user nova-compute[72773]:   <features>
Aug 16 22:25:24 user nova-compute[72773]:     <acpi/>
Aug 16 22:25:24 user nova-compute[72773]:     <apic/>
Aug 16 22:25:24 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:25:24 user nova-compute[72773]:   </features>
Aug 16 22:25:24 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:25:24 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:25:24 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:25:24 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:25:24 user nova-compute[72773]:   </clock>
Aug 16 22:25:24 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:25:24 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:25:24 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:25:24 user nova-compute[72773]:   </cpu>
Aug 16 22:25:24 user nova-compute[72773]:   <devices>
Aug 16 22:25:24 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:25:24 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:25:24 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/aa4cbd72-a11c-4dab-b2e2-29fe10493931/disk"/>
Aug 16 22:25:24 user nova-compute[72773]:       <target dev="sda" bus="scsi"/>
Aug 16 22:25:24 user nova-compute[72773]:       <address type="drive" controller="0" unit="0"/>
Aug 16 22:25:24 user nova-compute[72773]:     </disk>
Aug 16 22:25:24 user nova-compute[72773]:     <disk type="file" device="cdrom">
Aug 16 22:25:24 user nova-compute[72773]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 22:25:24 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/aa4cbd72-a11c-4dab-b2e2-29fe10493931/disk.config"/>
Aug 16 22:25:24 user nova-compute[72773]:       <target dev="sdb" bus="scsi"/>
Aug 16 22:25:24 user nova-compute[72773]:       <address type="drive" controller="0" unit="1"/>
Aug 16 22:25:24 user nova-compute[72773]:     </disk>
Aug 16 22:25:24 user nova-compute[72773]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 16 22:25:24 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:25:24 user nova-compute[72773]:       <mac address="fa:16:3e:19:53:af"/>
Aug 16 22:25:24 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:25:24 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:25:24 user nova-compute[72773]:       <target dev="tapc0ab5700-b8"/>
Aug 16 22:25:24 user nova-compute[72773]:     </interface>
Aug 16 22:25:24 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:25:24 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/aa4cbd72-a11c-4dab-b2e2-29fe10493931/console.log" append="off"/>
Aug 16 22:25:24 user nova-compute[72773]:     </serial>
Aug 16 22:25:24 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:25:24 user nova-compute[72773]:     <video>
Aug 16 22:25:24 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:25:24 user nova-compute[72773]:     </video>
Aug 16 22:25:24 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:25:24 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:25:24 user nova-compute[72773]:     </rng>
Aug 16 22:25:24 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:25:24 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:25:24 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:25:24 user nova-compute[72773]:     </memballoon>
Aug 16 22:25:24 user nova-compute[72773]:   </devices>
Aug 16 22:25:24 user nova-compute[72773]: </domain>
Aug 16 22:25:24 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:25:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-746378066',display_name='tempest-AttachSCSIVolumeTestJSON-server-746378066',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-746378066',id=7,image_ref='9e426ed0-4ff6-486b-b1d1-cbe7b9263905',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGK0Gwr1cE4s9SCf2MyvVFkEYgrkfLF28DejcAaX+XTTMVNBYt/JM5oTmiSbyJ43fEpvHckCm9aXpHl6+jLHKBYXqubFEinZkrnlQFL1v+Emqll/C2MfqevylzENFPV5Cw==',key_name='tempest-keypair-1212077302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc901cb159c84701b71722d227c56baf',ramdisk_id='',reservation_id='r-39mxluxs',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9e426ed0-4ff6-486b-b1d1-cbe7b9263905',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-445128069',owner_user_name='tempest-AttachSCSIVolumeTestJSON-445128069-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:25:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec229d21f9ca4d6db7758eb42579f4e9',uuid=aa4cbd72-a11c-4dab-b2e2-29fe10493931,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0ab5700-b895-412c-acca-e116a216cc89", "address": "fa:16:3e:19:53:af", "network": {"id": "03be4829-78f7-42b1-8d1d-742719d2e16d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-503860176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc901cb159c84701b71722d227c56baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ab5700-b8", "ovs_interfaceid": "c0ab5700-b895-412c-acca-e116a216cc89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Converting VIF {"id": "c0ab5700-b895-412c-acca-e116a216cc89", "address": "fa:16:3e:19:53:af", "network": {"id": "03be4829-78f7-42b1-8d1d-742719d2e16d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-503860176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc901cb159c84701b71722d227c56baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ab5700-b8", "ovs_interfaceid": "c0ab5700-b895-412c-acca-e116a216cc89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:53:af,bridge_name='br-int',has_traffic_filtering=True,id=c0ab5700-b895-412c-acca-e116a216cc89,network=Network(03be4829-78f7-42b1-8d1d-742719d2e16d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ab5700-b8') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG os_vif [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:53:af,bridge_name='br-int',has_traffic_filtering=True,id=c0ab5700-b895-412c-acca-e116a216cc89,network=Network(03be4829-78f7-42b1-8d1d-742719d2e16d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ab5700-b8') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0ab5700-b8, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc0ab5700-b8, col_values=(('external_ids', {'iface-id': 'c0ab5700-b895-412c-acca-e116a216cc89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:53:af', 'vm-uuid': 'aa4cbd72-a11c-4dab-b2e2-29fe10493931'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:24 user nova-compute[72773]: INFO os_vif [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:53:af,bridge_name='br-int',has_traffic_filtering=True,id=c0ab5700-b895-412c-acca-e116a216cc89,network=Network(03be4829-78f7-42b1-8d1d-742719d2e16d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ab5700-b8')
Aug 16 22:25:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] No BDM found with device name sda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] No VIF found with MAC fa:16:3e:19:53:af, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:25:24 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Using config drive
Aug 16 22:25:24 user nova-compute[72773]: DEBUG nova.network.neutron [req-830659cd-9ce5-4dc9-ba03-066a8451815a req-bd7cf17e-1746-4478-a52d-3d5764597711 service nova] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Updated VIF entry in instance network info cache for port 813736f3-3cf2-4d52-9bf5-239b93647ee2. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG nova.network.neutron [req-830659cd-9ce5-4dc9-ba03-066a8451815a req-bd7cf17e-1746-4478-a52d-3d5764597711 service nova] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Updating instance_info_cache with network_info: [{"id": "813736f3-3cf2-4d52-9bf5-239b93647ee2", "address": "fa:16:3e:55:99:4d", "network": {"id": "db5b9d7a-8d3c-409c-961b-9bd7d882664c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1507737858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9086072338454300bb7a455bff6d0757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813736f3-3c", "ovs_interfaceid": "813736f3-3cf2-4d52-9bf5-239b93647ee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-830659cd-9ce5-4dc9-ba03-066a8451815a req-bd7cf17e-1746-4478-a52d-3d5764597711 service nova] Releasing lock "refresh_cache-c6adfa95-47ac-40d3-abc1-0c6027507f07" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:24 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Creating config drive at /opt/stack/data/nova/instances/aa4cbd72-a11c-4dab-b2e2-29fe10493931/disk.config
Aug 16 22:25:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/aa4cbd72-a11c-4dab-b2e2-29fe10493931/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmps20kx2cp {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/aa4cbd72-a11c-4dab-b2e2-29fe10493931/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmps20kx2cp" returned: 0 in 0.059s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG nova.network.neutron [req-fca795ab-522b-466a-83c3-0883c3e75bf2 req-41c8875b-5dcf-4e44-8565-8c7739babe19 service nova] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Updated VIF entry in instance network info cache for port c0ab5700-b895-412c-acca-e116a216cc89. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG nova.network.neutron [req-fca795ab-522b-466a-83c3-0883c3e75bf2 req-41c8875b-5dcf-4e44-8565-8c7739babe19 service nova] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Updating instance_info_cache with network_info: [{"id": "c0ab5700-b895-412c-acca-e116a216cc89", "address": "fa:16:3e:19:53:af", "network": {"id": "03be4829-78f7-42b1-8d1d-742719d2e16d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-503860176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc901cb159c84701b71722d227c56baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ab5700-b8", "ovs_interfaceid": "c0ab5700-b895-412c-acca-e116a216cc89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:25:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fca795ab-522b-466a-83c3-0883c3e75bf2 req-41c8875b-5dcf-4e44-8565-8c7739babe19 service nova] Releasing lock "refresh_cache-aa4cbd72-a11c-4dab-b2e2-29fe10493931" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:25:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Acquiring lock "8bbb196d-e352-47a5-86fb-a819723c2ce8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Lock "8bbb196d-e352-47a5-86fb-a819723c2ce8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:25 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:25:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:25 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:25:25 user nova-compute[72773]: INFO nova.compute.claims [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Claim successful on node user
Aug 16 22:25:25 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:25:25 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:25:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.632s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:25 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:25:25 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:25:25 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:25:25 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:25:25 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:25:26 user nova-compute[72773]: DEBUG nova.policy [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da019859d25d4bc7851a549f35e3dadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b8b05cdb54990b21e671e31fb51ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:25:26 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:25:26 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:25:26 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Creating image(s)
Aug 16 22:25:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Acquiring lock "/opt/stack/data/nova/instances/8bbb196d-e352-47a5-86fb-a819723c2ce8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Lock "/opt/stack/data/nova/instances/8bbb196d-e352-47a5-86fb-a819723c2ce8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Lock "/opt/stack/data/nova/instances/8bbb196d-e352-47a5-86fb-a819723c2ce8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.205s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.258s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/8bbb196d-e352-47a5-86fb-a819723c2ce8/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/8bbb196d-e352-47a5-86fb-a819723c2ce8/disk 1073741824" returned: 0 in 0.061s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.242s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:26 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8bbb196d-e352-47a5-86fb-a819723c2ce8/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:25:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbb196d-e352-47a5-86fb-a819723c2ce8/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbb196d-e352-47a5-86fb-a819723c2ce8/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:27 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Cannot resize image /opt/stack/data/nova/instances/8bbb196d-e352-47a5-86fb-a819723c2ce8/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:25:27 user nova-compute[72773]: DEBUG nova.objects.instance [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Lazy-loading 'migration_context' on Instance uuid 8bbb196d-e352-47a5-86fb-a819723c2ce8 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:25:27 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:25:27 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Ensure instance console log exists: /opt/stack/data/nova/instances/8bbb196d-e352-47a5-86fb-a819723c2ce8/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:25:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:27 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Successfully created port: 8fabc876-8281-4305-8c4e-94cf1e316cf5 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:25:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Successfully updated port: 8fabc876-8281-4305-8c4e-94cf1e316cf5 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Acquiring lock "refresh_cache-8bbb196d-e352-47a5-86fb-a819723c2ce8" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Acquired lock "refresh_cache-8bbb196d-e352-47a5-86fb-a819723c2ce8" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.compute.manager [req-98a4363f-e791-494f-8072-9131f328e60c req-49987296-cf1f-4709-b2e4-389471e7a5a9 service nova] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Received event network-changed-8fabc876-8281-4305-8c4e-94cf1e316cf5 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.compute.manager [req-98a4363f-e791-494f-8072-9131f328e60c req-49987296-cf1f-4709-b2e4-389471e7a5a9 service nova] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Refreshing instance network info cache due to event network-changed-8fabc876-8281-4305-8c4e-94cf1e316cf5. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-98a4363f-e791-494f-8072-9131f328e60c req-49987296-cf1f-4709-b2e4-389471e7a5a9 service nova] Acquiring lock "refresh_cache-8bbb196d-e352-47a5-86fb-a819723c2ce8" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.compute.manager [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224728.551039, 4387131d-7a86-477a-a231-69713b2d965d => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:25:28 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 4387131d-7a86-477a-a231-69713b2d965d] VM Resumed (Lifecycle Event)
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:25:28 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Instance spawned successfully.
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:25:28 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 4387131d-7a86-477a-a231-69713b2d965d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224728.5612464, 4387131d-7a86-477a-a231-69713b2d965d => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:25:28 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 4387131d-7a86-477a-a231-69713b2d965d] VM Started (Lifecycle Event)
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:25:28 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 4387131d-7a86-477a-a231-69713b2d965d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Updating instance_info_cache with network_info: [{"id": "8fabc876-8281-4305-8c4e-94cf1e316cf5", "address": "fa:16:3e:54:d7:ac", "network": {"id": "3b558f9d-f82f-4407-8a9d-59e024e4c7a6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-974724272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228b8b05cdb54990b21e671e31fb51ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fabc876-82", "ovs_interfaceid": "8fabc876-8281-4305-8c4e-94cf1e316cf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Releasing lock "refresh_cache-8bbb196d-e352-47a5-86fb-a819723c2ce8" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Instance network_info: |[{"id": "8fabc876-8281-4305-8c4e-94cf1e316cf5", "address": "fa:16:3e:54:d7:ac", "network": {"id": "3b558f9d-f82f-4407-8a9d-59e024e4c7a6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-974724272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228b8b05cdb54990b21e671e31fb51ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fabc876-82", "ovs_interfaceid": "8fabc876-8281-4305-8c4e-94cf1e316cf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-98a4363f-e791-494f-8072-9131f328e60c req-49987296-cf1f-4709-b2e4-389471e7a5a9 service nova] Acquired lock "refresh_cache-8bbb196d-e352-47a5-86fb-a819723c2ce8" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.network.neutron [req-98a4363f-e791-494f-8072-9131f328e60c req-49987296-cf1f-4709-b2e4-389471e7a5a9 service nova] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Refreshing network info cache for port 8fabc876-8281-4305-8c4e-94cf1e316cf5 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Start _get_guest_xml network_info=[{"id": "8fabc876-8281-4305-8c4e-94cf1e316cf5", "address": "fa:16:3e:54:d7:ac", "network": {"id": "3b558f9d-f82f-4407-8a9d-59e024e4c7a6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-974724272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228b8b05cdb54990b21e671e31fb51ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fabc876-82", "ovs_interfaceid": "8fabc876-8281-4305-8c4e-94cf1e316cf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:25:28 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:25:28 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:25:28 user nova-compute[72773]: INFO nova.compute.manager [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Took 10.37 seconds to spawn the instance on the hypervisor.
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.compute.manager [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:25:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2109003385',display_name='tempest-TestVolumeSwap-server-2109003385',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2109003385',id=8,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhGvwzUQvzE0hv787F07q+EM989/AxpcxUxTKwwep+vVOp7IXuws1pgQodlZr0ljJlsRCC8Je/Zp1aJmEwnTWb/EJA6jL6eR09GcsNTE33X3QIcpYVCTyZHPk6wTwEa3A==',key_name='tempest-keypair-192268623',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='228b8b05cdb54990b21e671e31fb51ff',ramdisk_id='',reservation_id='r-a50uu0mm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2095876552',owner_user_name='tempest-TestVolumeSwap-2095876552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:25:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da019859d25d4bc7851a549f35e3dadd',uuid=8bbb196d-e352-47a5-86fb-a819723c2ce8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fabc876-8281-4305-8c4e-94cf1e316cf5", "address": "fa:16:3e:54:d7:ac", "network": {"id": "3b558f9d-f82f-4407-8a9d-59e024e4c7a6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-974724272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228b8b05cdb54990b21e671e31fb51ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fabc876-82", "ovs_interfaceid": "8fabc876-8281-4305-8c4e-94cf1e316cf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Converting VIF {"id": "8fabc876-8281-4305-8c4e-94cf1e316cf5", "address": "fa:16:3e:54:d7:ac", "network": {"id": "3b558f9d-f82f-4407-8a9d-59e024e4c7a6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-974724272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228b8b05cdb54990b21e671e31fb51ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fabc876-82", "ovs_interfaceid": "8fabc876-8281-4305-8c4e-94cf1e316cf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:d7:ac,bridge_name='br-int',has_traffic_filtering=True,id=8fabc876-8281-4305-8c4e-94cf1e316cf5,network=Network(3b558f9d-f82f-4407-8a9d-59e024e4c7a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fabc876-82') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.objects.instance [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Lazy-loading 'pci_devices' on Instance uuid 8bbb196d-e352-47a5-86fb-a819723c2ce8 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:25:28 user nova-compute[72773]:   <uuid>8bbb196d-e352-47a5-86fb-a819723c2ce8</uuid>
Aug 16 22:25:28 user nova-compute[72773]:   <name>instance-00000008</name>
Aug 16 22:25:28 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:25:28 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:25:28 user nova-compute[72773]:   <metadata>
Aug 16 22:25:28 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:25:28 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:25:28 user nova-compute[72773]:       <nova:name>tempest-TestVolumeSwap-server-2109003385</nova:name>
Aug 16 22:25:28 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:25:28</nova:creationTime>
Aug 16 22:25:28 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:25:28 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:25:28 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:25:28 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:25:28 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:25:28 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:25:28 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:25:28 user nova-compute[72773]:       <nova:owner>
Aug 16 22:25:28 user nova-compute[72773]:         <nova:user uuid="da019859d25d4bc7851a549f35e3dadd">tempest-TestVolumeSwap-2095876552-project-member</nova:user>
Aug 16 22:25:28 user nova-compute[72773]:         <nova:project uuid="228b8b05cdb54990b21e671e31fb51ff">tempest-TestVolumeSwap-2095876552</nova:project>
Aug 16 22:25:28 user nova-compute[72773]:       </nova:owner>
Aug 16 22:25:28 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:25:28 user nova-compute[72773]:       <nova:ports>
Aug 16 22:25:28 user nova-compute[72773]:         <nova:port uuid="8fabc876-8281-4305-8c4e-94cf1e316cf5">
Aug 16 22:25:28 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 22:25:28 user nova-compute[72773]:         </nova:port>
Aug 16 22:25:28 user nova-compute[72773]:       </nova:ports>
Aug 16 22:25:28 user nova-compute[72773]:     </nova:instance>
Aug 16 22:25:28 user nova-compute[72773]:   </metadata>
Aug 16 22:25:28 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:25:28 user nova-compute[72773]:     <system>
Aug 16 22:25:28 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:25:28 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:25:28 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:25:28 user nova-compute[72773]:       <entry name="serial">8bbb196d-e352-47a5-86fb-a819723c2ce8</entry>
Aug 16 22:25:28 user nova-compute[72773]:       <entry name="uuid">8bbb196d-e352-47a5-86fb-a819723c2ce8</entry>
Aug 16 22:25:28 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:25:28 user nova-compute[72773]:     </system>
Aug 16 22:25:28 user nova-compute[72773]:   </sysinfo>
Aug 16 22:25:28 user nova-compute[72773]:   <os>
Aug 16 22:25:28 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:25:28 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:25:28 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:25:28 user nova-compute[72773]:   </os>
Aug 16 22:25:28 user nova-compute[72773]:   <features>
Aug 16 22:25:28 user nova-compute[72773]:     <acpi/>
Aug 16 22:25:28 user nova-compute[72773]:     <apic/>
Aug 16 22:25:28 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:25:28 user nova-compute[72773]:   </features>
Aug 16 22:25:28 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:25:28 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:25:28 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:25:28 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:25:28 user nova-compute[72773]:   </clock>
Aug 16 22:25:28 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:25:28 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:25:28 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:25:28 user nova-compute[72773]:   </cpu>
Aug 16 22:25:28 user nova-compute[72773]:   <devices>
Aug 16 22:25:28 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:25:28 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:25:28 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/8bbb196d-e352-47a5-86fb-a819723c2ce8/disk"/>
Aug 16 22:25:28 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:25:28 user nova-compute[72773]:     </disk>
Aug 16 22:25:28 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:25:28 user nova-compute[72773]:       <mac address="fa:16:3e:54:d7:ac"/>
Aug 16 22:25:28 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:25:28 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:25:28 user nova-compute[72773]:       <target dev="tap8fabc876-82"/>
Aug 16 22:25:28 user nova-compute[72773]:     </interface>
Aug 16 22:25:28 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:25:28 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/8bbb196d-e352-47a5-86fb-a819723c2ce8/console.log" append="off"/>
Aug 16 22:25:28 user nova-compute[72773]:     </serial>
Aug 16 22:25:28 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:25:28 user nova-compute[72773]:     <video>
Aug 16 22:25:28 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:25:28 user nova-compute[72773]:     </video>
Aug 16 22:25:28 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:25:28 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:25:28 user nova-compute[72773]:     </rng>
Aug 16 22:25:28 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:25:28 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:25:28 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:25:28 user nova-compute[72773]:     </memballoon>
Aug 16 22:25:28 user nova-compute[72773]:   </devices>
Aug 16 22:25:28 user nova-compute[72773]: </domain>
Aug 16 22:25:28 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:25:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2109003385',display_name='tempest-TestVolumeSwap-server-2109003385',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2109003385',id=8,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhGvwzUQvzE0hv787F07q+EM989/AxpcxUxTKwwep+vVOp7IXuws1pgQodlZr0ljJlsRCC8Je/Zp1aJmEwnTWb/EJA6jL6eR09GcsNTE33X3QIcpYVCTyZHPk6wTwEa3A==',key_name='tempest-keypair-192268623',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='228b8b05cdb54990b21e671e31fb51ff',ramdisk_id='',reservation_id='r-a50uu0mm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2095876552',owner_user_name='tempest-TestVolumeSwap-2095876552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:25:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da019859d25d4bc7851a549f35e3dadd',uuid=8bbb196d-e352-47a5-86fb-a819723c2ce8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fabc876-8281-4305-8c4e-94cf1e316cf5", "address": "fa:16:3e:54:d7:ac", "network": {"id": "3b558f9d-f82f-4407-8a9d-59e024e4c7a6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-974724272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228b8b05cdb54990b21e671e31fb51ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fabc876-82", "ovs_interfaceid": "8fabc876-8281-4305-8c4e-94cf1e316cf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Converting VIF {"id": "8fabc876-8281-4305-8c4e-94cf1e316cf5", "address": "fa:16:3e:54:d7:ac", "network": {"id": "3b558f9d-f82f-4407-8a9d-59e024e4c7a6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-974724272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228b8b05cdb54990b21e671e31fb51ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fabc876-82", "ovs_interfaceid": "8fabc876-8281-4305-8c4e-94cf1e316cf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:d7:ac,bridge_name='br-int',has_traffic_filtering=True,id=8fabc876-8281-4305-8c4e-94cf1e316cf5,network=Network(3b558f9d-f82f-4407-8a9d-59e024e4c7a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fabc876-82') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG os_vif [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:d7:ac,bridge_name='br-int',has_traffic_filtering=True,id=8fabc876-8281-4305-8c4e-94cf1e316cf5,network=Network(3b558f9d-f82f-4407-8a9d-59e024e4c7a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fabc876-82') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:25:28 user nova-compute[72773]: INFO nova.compute.manager [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Took 11.77 seconds to build instance.
Aug 16 22:25:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fabc876-82, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8fabc876-82, col_values=(('external_ids', {'iface-id': '8fabc876-8281-4305-8c4e-94cf1e316cf5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:d7:ac', 'vm-uuid': '8bbb196d-e352-47a5-86fb-a819723c2ce8'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-117b5ebf-7f53-4d71-91e0-1148f84daf20 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Lock "4387131d-7a86-477a-a231-69713b2d965d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.953s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:28 user nova-compute[72773]: INFO os_vif [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:d7:ac,bridge_name='br-int',has_traffic_filtering=True,id=8fabc876-8281-4305-8c4e-94cf1e316cf5,network=Network(3b558f9d-f82f-4407-8a9d-59e024e4c7a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fabc876-82')
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:25:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] No VIF found with MAC fa:16:3e:54:d7:ac, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:25:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:29 user nova-compute[72773]: DEBUG nova.network.neutron [req-98a4363f-e791-494f-8072-9131f328e60c req-49987296-cf1f-4709-b2e4-389471e7a5a9 service nova] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Updated VIF entry in instance network info cache for port 8fabc876-8281-4305-8c4e-94cf1e316cf5. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:25:29 user nova-compute[72773]: DEBUG nova.network.neutron [req-98a4363f-e791-494f-8072-9131f328e60c req-49987296-cf1f-4709-b2e4-389471e7a5a9 service nova] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Updating instance_info_cache with network_info: [{"id": "8fabc876-8281-4305-8c4e-94cf1e316cf5", "address": "fa:16:3e:54:d7:ac", "network": {"id": "3b558f9d-f82f-4407-8a9d-59e024e4c7a6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-974724272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228b8b05cdb54990b21e671e31fb51ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fabc876-82", "ovs_interfaceid": "8fabc876-8281-4305-8c4e-94cf1e316cf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:25:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-98a4363f-e791-494f-8072-9131f328e60c req-49987296-cf1f-4709-b2e4-389471e7a5a9 service nova] Releasing lock "refresh_cache-8bbb196d-e352-47a5-86fb-a819723c2ce8" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:25:30 user nova-compute[72773]: DEBUG nova.compute.manager [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:25:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:25:30 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224730.0561073, c6adfa95-47ac-40d3-abc1-0c6027507f07 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:25:30 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] VM Resumed (Lifecycle Event)
Aug 16 22:25:30 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Instance spawned successfully.
Aug 16 22:25:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:25:30 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:25:30 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:25:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:30 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:25:30 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224730.0577178, c6adfa95-47ac-40d3-abc1-0c6027507f07 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:25:30 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] VM Started (Lifecycle Event)
Aug 16 22:25:30 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:25:30 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:25:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:25:30 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:25:30 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Instance spawned successfully.
Aug 16 22:25:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:25:30 user nova-compute[72773]: INFO nova.compute.manager [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Took 10.36 seconds to spawn the instance on the hypervisor.
Aug 16 22:25:30 user nova-compute[72773]: DEBUG nova.compute.manager [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:25:30 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:25:30 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224730.190009, aa4cbd72-a11c-4dab-b2e2-29fe10493931 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:25:30 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] VM Resumed (Lifecycle Event)
Aug 16 22:25:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:30 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:25:30 user nova-compute[72773]: DEBUG nova.compute.manager [req-e8876d7e-28c7-4d63-8a81-8d1a07883492 req-9337237e-007d-4ef2-b7be-3d0a0f7af198 service nova] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Received event network-vif-plugged-f3bb17a2-593d-46be-92bc-9b4b64a48174 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:25:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e8876d7e-28c7-4d63-8a81-8d1a07883492 req-9337237e-007d-4ef2-b7be-3d0a0f7af198 service nova] Acquiring lock "02235c77-0c2a-4317-8526-7bd5096694a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e8876d7e-28c7-4d63-8a81-8d1a07883492 req-9337237e-007d-4ef2-b7be-3d0a0f7af198 service nova] Lock "02235c77-0c2a-4317-8526-7bd5096694a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e8876d7e-28c7-4d63-8a81-8d1a07883492 req-9337237e-007d-4ef2-b7be-3d0a0f7af198 service nova] Lock "02235c77-0c2a-4317-8526-7bd5096694a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:30 user nova-compute[72773]: DEBUG nova.compute.manager [req-e8876d7e-28c7-4d63-8a81-8d1a07883492 req-9337237e-007d-4ef2-b7be-3d0a0f7af198 service nova] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] No waiting events found dispatching network-vif-plugged-f3bb17a2-593d-46be-92bc-9b4b64a48174 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:25:30 user nova-compute[72773]: WARNING nova.compute.manager [req-e8876d7e-28c7-4d63-8a81-8d1a07883492 req-9337237e-007d-4ef2-b7be-3d0a0f7af198 service nova] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Received unexpected event network-vif-plugged-f3bb17a2-593d-46be-92bc-9b4b64a48174 for instance with vm_state active and task_state None.
Aug 16 22:25:30 user nova-compute[72773]: DEBUG nova.compute.manager [req-e8876d7e-28c7-4d63-8a81-8d1a07883492 req-9337237e-007d-4ef2-b7be-3d0a0f7af198 service nova] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Received event network-vif-plugged-f3bb17a2-593d-46be-92bc-9b4b64a48174 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:25:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e8876d7e-28c7-4d63-8a81-8d1a07883492 req-9337237e-007d-4ef2-b7be-3d0a0f7af198 service nova] Acquiring lock "02235c77-0c2a-4317-8526-7bd5096694a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e8876d7e-28c7-4d63-8a81-8d1a07883492 req-9337237e-007d-4ef2-b7be-3d0a0f7af198 service nova] Lock "02235c77-0c2a-4317-8526-7bd5096694a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e8876d7e-28c7-4d63-8a81-8d1a07883492 req-9337237e-007d-4ef2-b7be-3d0a0f7af198 service nova] Lock "02235c77-0c2a-4317-8526-7bd5096694a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:30 user nova-compute[72773]: DEBUG nova.compute.manager [req-e8876d7e-28c7-4d63-8a81-8d1a07883492 req-9337237e-007d-4ef2-b7be-3d0a0f7af198 service nova] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] No waiting events found dispatching network-vif-plugged-f3bb17a2-593d-46be-92bc-9b4b64a48174 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:25:30 user nova-compute[72773]: WARNING nova.compute.manager [req-e8876d7e-28c7-4d63-8a81-8d1a07883492 req-9337237e-007d-4ef2-b7be-3d0a0f7af198 service nova] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Received unexpected event network-vif-plugged-f3bb17a2-593d-46be-92bc-9b4b64a48174 for instance with vm_state active and task_state None.
Aug 16 22:25:30 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:25:30 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:25:30 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224730.1901834, aa4cbd72-a11c-4dab-b2e2-29fe10493931 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:25:30 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] VM Started (Lifecycle Event)
Aug 16 22:25:30 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:25:30 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:25:30 user nova-compute[72773]: INFO nova.compute.manager [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Took 9.83 seconds to spawn the instance on the hypervisor.
Aug 16 22:25:30 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:25:30 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:25:30 user nova-compute[72773]: INFO nova.compute.manager [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Took 11.73 seconds to build instance.
Aug 16 22:25:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1a9cef12-f71b-495e-b172-ef0be61bb32b tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "c6adfa95-47ac-40d3-abc1-0c6027507f07" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.961s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:30 user nova-compute[72773]: INFO nova.compute.manager [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Took 11.17 seconds to build instance.
Aug 16 22:25:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7cea9993-e711-482c-9e29-9288ac89ad5d tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lock "aa4cbd72-a11c-4dab-b2e2-29fe10493931" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.374s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:33 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224733.5233357, 8bbb196d-e352-47a5-86fb-a819723c2ce8 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:25:33 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] VM Resumed (Lifecycle Event)
Aug 16 22:25:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:25:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:25:33 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Instance spawned successfully.
Aug 16 22:25:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:25:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:25:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:25:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:25:33 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:25:33 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224733.5249908, 8bbb196d-e352-47a5-86fb-a819723c2ce8 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:25:33 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] VM Started (Lifecycle Event)
Aug 16 22:25:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:25:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:25:33 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:25:33 user nova-compute[72773]: INFO nova.compute.manager [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Took 7.53 seconds to spawn the instance on the hypervisor.
Aug 16 22:25:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:25:33 user nova-compute[72773]: INFO nova.compute.manager [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Took 8.67 seconds to build instance.
Aug 16 22:25:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a238afde-2607-48f9-b661-e138c49e2524 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Lock "8bbb196d-e352-47a5-86fb-a819723c2ce8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.780s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:36 user nova-compute[72773]: DEBUG nova.compute.manager [req-63845342-8ca6-4119-87b0-a37bf1715684 req-e8a40106-b449-4030-be14-9ac50b1bc9d3 service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Received event network-vif-plugged-26ca6ee6-83b5-4553-b31c-d1b135b219e9 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:25:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-63845342-8ca6-4119-87b0-a37bf1715684 req-e8a40106-b449-4030-be14-9ac50b1bc9d3 service nova] Acquiring lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-63845342-8ca6-4119-87b0-a37bf1715684 req-e8a40106-b449-4030-be14-9ac50b1bc9d3 service nova] Lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-63845342-8ca6-4119-87b0-a37bf1715684 req-e8a40106-b449-4030-be14-9ac50b1bc9d3 service nova] Lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:36 user nova-compute[72773]: DEBUG nova.compute.manager [req-63845342-8ca6-4119-87b0-a37bf1715684 req-e8a40106-b449-4030-be14-9ac50b1bc9d3 service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] No waiting events found dispatching network-vif-plugged-26ca6ee6-83b5-4553-b31c-d1b135b219e9 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:25:36 user nova-compute[72773]: WARNING nova.compute.manager [req-63845342-8ca6-4119-87b0-a37bf1715684 req-e8a40106-b449-4030-be14-9ac50b1bc9d3 service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Received unexpected event network-vif-plugged-26ca6ee6-83b5-4553-b31c-d1b135b219e9 for instance with vm_state active and task_state None.
Aug 16 22:25:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:38 user nova-compute[72773]: DEBUG nova.compute.manager [req-e548f3f5-b974-4241-976a-2a645cde140c req-5ca29f60-2725-4e77-bf4c-5ac415f24001 service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Received event network-vif-plugged-26ca6ee6-83b5-4553-b31c-d1b135b219e9 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:25:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e548f3f5-b974-4241-976a-2a645cde140c req-5ca29f60-2725-4e77-bf4c-5ac415f24001 service nova] Acquiring lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e548f3f5-b974-4241-976a-2a645cde140c req-5ca29f60-2725-4e77-bf4c-5ac415f24001 service nova] Lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e548f3f5-b974-4241-976a-2a645cde140c req-5ca29f60-2725-4e77-bf4c-5ac415f24001 service nova] Lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:38 user nova-compute[72773]: DEBUG nova.compute.manager [req-e548f3f5-b974-4241-976a-2a645cde140c req-5ca29f60-2725-4e77-bf4c-5ac415f24001 service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] No waiting events found dispatching network-vif-plugged-26ca6ee6-83b5-4553-b31c-d1b135b219e9 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:25:38 user nova-compute[72773]: WARNING nova.compute.manager [req-e548f3f5-b974-4241-976a-2a645cde140c req-5ca29f60-2725-4e77-bf4c-5ac415f24001 service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Received unexpected event network-vif-plugged-26ca6ee6-83b5-4553-b31c-d1b135b219e9 for instance with vm_state active and task_state None.
Aug 16 22:25:38 user nova-compute[72773]: DEBUG nova.compute.manager [req-e548f3f5-b974-4241-976a-2a645cde140c req-5ca29f60-2725-4e77-bf4c-5ac415f24001 service nova] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Received event network-vif-plugged-b757c921-b63d-4724-874a-2b9bd0710124 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:25:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e548f3f5-b974-4241-976a-2a645cde140c req-5ca29f60-2725-4e77-bf4c-5ac415f24001 service nova] Acquiring lock "4387131d-7a86-477a-a231-69713b2d965d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e548f3f5-b974-4241-976a-2a645cde140c req-5ca29f60-2725-4e77-bf4c-5ac415f24001 service nova] Lock "4387131d-7a86-477a-a231-69713b2d965d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e548f3f5-b974-4241-976a-2a645cde140c req-5ca29f60-2725-4e77-bf4c-5ac415f24001 service nova] Lock "4387131d-7a86-477a-a231-69713b2d965d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:38 user nova-compute[72773]: DEBUG nova.compute.manager [req-e548f3f5-b974-4241-976a-2a645cde140c req-5ca29f60-2725-4e77-bf4c-5ac415f24001 service nova] [instance: 4387131d-7a86-477a-a231-69713b2d965d] No waiting events found dispatching network-vif-plugged-b757c921-b63d-4724-874a-2b9bd0710124 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:25:38 user nova-compute[72773]: WARNING nova.compute.manager [req-e548f3f5-b974-4241-976a-2a645cde140c req-5ca29f60-2725-4e77-bf4c-5ac415f24001 service nova] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Received unexpected event network-vif-plugged-b757c921-b63d-4724-874a-2b9bd0710124 for instance with vm_state active and task_state None.
Aug 16 22:25:38 user nova-compute[72773]: DEBUG nova.compute.manager [req-e548f3f5-b974-4241-976a-2a645cde140c req-5ca29f60-2725-4e77-bf4c-5ac415f24001 service nova] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Received event network-vif-plugged-b757c921-b63d-4724-874a-2b9bd0710124 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:25:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e548f3f5-b974-4241-976a-2a645cde140c req-5ca29f60-2725-4e77-bf4c-5ac415f24001 service nova] Acquiring lock "4387131d-7a86-477a-a231-69713b2d965d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e548f3f5-b974-4241-976a-2a645cde140c req-5ca29f60-2725-4e77-bf4c-5ac415f24001 service nova] Lock "4387131d-7a86-477a-a231-69713b2d965d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e548f3f5-b974-4241-976a-2a645cde140c req-5ca29f60-2725-4e77-bf4c-5ac415f24001 service nova] Lock "4387131d-7a86-477a-a231-69713b2d965d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:38 user nova-compute[72773]: DEBUG nova.compute.manager [req-e548f3f5-b974-4241-976a-2a645cde140c req-5ca29f60-2725-4e77-bf4c-5ac415f24001 service nova] [instance: 4387131d-7a86-477a-a231-69713b2d965d] No waiting events found dispatching network-vif-plugged-b757c921-b63d-4724-874a-2b9bd0710124 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:25:38 user nova-compute[72773]: WARNING nova.compute.manager [req-e548f3f5-b974-4241-976a-2a645cde140c req-5ca29f60-2725-4e77-bf4c-5ac415f24001 service nova] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Received unexpected event network-vif-plugged-b757c921-b63d-4724-874a-2b9bd0710124 for instance with vm_state active and task_state None.
Aug 16 22:25:38 user nova-compute[72773]: DEBUG nova.compute.manager [req-e548f3f5-b974-4241-976a-2a645cde140c req-5ca29f60-2725-4e77-bf4c-5ac415f24001 service nova] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Received event network-vif-plugged-8fabc876-8281-4305-8c4e-94cf1e316cf5 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:25:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e548f3f5-b974-4241-976a-2a645cde140c req-5ca29f60-2725-4e77-bf4c-5ac415f24001 service nova] Acquiring lock "8bbb196d-e352-47a5-86fb-a819723c2ce8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e548f3f5-b974-4241-976a-2a645cde140c req-5ca29f60-2725-4e77-bf4c-5ac415f24001 service nova] Lock "8bbb196d-e352-47a5-86fb-a819723c2ce8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e548f3f5-b974-4241-976a-2a645cde140c req-5ca29f60-2725-4e77-bf4c-5ac415f24001 service nova] Lock "8bbb196d-e352-47a5-86fb-a819723c2ce8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:38 user nova-compute[72773]: DEBUG nova.compute.manager [req-e548f3f5-b974-4241-976a-2a645cde140c req-5ca29f60-2725-4e77-bf4c-5ac415f24001 service nova] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] No waiting events found dispatching network-vif-plugged-8fabc876-8281-4305-8c4e-94cf1e316cf5 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:25:38 user nova-compute[72773]: WARNING nova.compute.manager [req-e548f3f5-b974-4241-976a-2a645cde140c req-5ca29f60-2725-4e77-bf4c-5ac415f24001 service nova] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Received unexpected event network-vif-plugged-8fabc876-8281-4305-8c4e-94cf1e316cf5 for instance with vm_state active and task_state None.
Aug 16 22:25:38 user nova-compute[72773]: DEBUG nova.compute.manager [req-e548f3f5-b974-4241-976a-2a645cde140c req-5ca29f60-2725-4e77-bf4c-5ac415f24001 service nova] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Received event network-vif-plugged-8fabc876-8281-4305-8c4e-94cf1e316cf5 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:25:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e548f3f5-b974-4241-976a-2a645cde140c req-5ca29f60-2725-4e77-bf4c-5ac415f24001 service nova] Acquiring lock "8bbb196d-e352-47a5-86fb-a819723c2ce8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e548f3f5-b974-4241-976a-2a645cde140c req-5ca29f60-2725-4e77-bf4c-5ac415f24001 service nova] Lock "8bbb196d-e352-47a5-86fb-a819723c2ce8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e548f3f5-b974-4241-976a-2a645cde140c req-5ca29f60-2725-4e77-bf4c-5ac415f24001 service nova] Lock "8bbb196d-e352-47a5-86fb-a819723c2ce8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:38 user nova-compute[72773]: DEBUG nova.compute.manager [req-e548f3f5-b974-4241-976a-2a645cde140c req-5ca29f60-2725-4e77-bf4c-5ac415f24001 service nova] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] No waiting events found dispatching network-vif-plugged-8fabc876-8281-4305-8c4e-94cf1e316cf5 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:25:38 user nova-compute[72773]: WARNING nova.compute.manager [req-e548f3f5-b974-4241-976a-2a645cde140c req-5ca29f60-2725-4e77-bf4c-5ac415f24001 service nova] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Received unexpected event network-vif-plugged-8fabc876-8281-4305-8c4e-94cf1e316cf5 for instance with vm_state active and task_state None.
Aug 16 22:25:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:40 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:25:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:25:40 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:25:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Cleaning up deleted instances {{(pid=72773) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 22:25:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] There are 0 instances to clean {{(pid=72773) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 22:25:40 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:25:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Cleaning up deleted instances with incomplete migration  {{(pid=72773) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 22:25:40 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:25:41 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:25:42 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:25:43 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:25:43 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:25:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:44 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:25:44 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:25:44 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Rebuilding the list of instances to heal {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 22:25:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-956d334e-f190-4625-b144-ab44d2f3321a" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:25:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-956d334e-f190-4625-b144-ab44d2f3321a" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:25:44 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 22:25:44 user nova-compute[72773]: DEBUG nova.objects.instance [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lazy-loading 'info_cache' on Instance uuid 956d334e-f190-4625-b144-ab44d2f3321a {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:25:44 user nova-compute[72773]: DEBUG nova.compute.manager [req-8cd1354a-3483-4228-b011-a7685d24f9e7 req-569d634d-4cb5-466e-98df-d0c31d5ad6f9 service nova] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Received event network-vif-plugged-94d9c8c3-7857-42d7-8e92-2b983bdd3dc6 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:25:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-8cd1354a-3483-4228-b011-a7685d24f9e7 req-569d634d-4cb5-466e-98df-d0c31d5ad6f9 service nova] Acquiring lock "4efab321-f2aa-456c-a1ae-b32f399f694d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-8cd1354a-3483-4228-b011-a7685d24f9e7 req-569d634d-4cb5-466e-98df-d0c31d5ad6f9 service nova] Lock "4efab321-f2aa-456c-a1ae-b32f399f694d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-8cd1354a-3483-4228-b011-a7685d24f9e7 req-569d634d-4cb5-466e-98df-d0c31d5ad6f9 service nova] Lock "4efab321-f2aa-456c-a1ae-b32f399f694d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:44 user nova-compute[72773]: DEBUG nova.compute.manager [req-8cd1354a-3483-4228-b011-a7685d24f9e7 req-569d634d-4cb5-466e-98df-d0c31d5ad6f9 service nova] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] No waiting events found dispatching network-vif-plugged-94d9c8c3-7857-42d7-8e92-2b983bdd3dc6 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:25:44 user nova-compute[72773]: WARNING nova.compute.manager [req-8cd1354a-3483-4228-b011-a7685d24f9e7 req-569d634d-4cb5-466e-98df-d0c31d5ad6f9 service nova] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Received unexpected event network-vif-plugged-94d9c8c3-7857-42d7-8e92-2b983bdd3dc6 for instance with vm_state active and task_state None.
Aug 16 22:25:45 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Updating instance_info_cache with network_info: [{"id": "d1807881-ec54-4e55-8f2e-6f8046efd351", "address": "fa:16:3e:b5:0f:ad", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1807881-ec", "ovs_interfaceid": "d1807881-ec54-4e55-8f2e-6f8046efd351", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:25:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-956d334e-f190-4625-b144-ab44d2f3321a" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:25:45 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 22:25:45 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:25:45 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:25:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:45 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:25:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02235c77-0c2a-4317-8526-7bd5096694a2/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02235c77-0c2a-4317-8526-7bd5096694a2/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02235c77-0c2a-4317-8526-7bd5096694a2/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02235c77-0c2a-4317-8526-7bd5096694a2/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbb196d-e352-47a5-86fb-a819723c2ce8/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbb196d-e352-47a5-86fb-a819723c2ce8/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbb196d-e352-47a5-86fb-a819723c2ce8/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbb196d-e352-47a5-86fb-a819723c2ce8/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:46 user nova-compute[72773]: DEBUG nova.compute.manager [req-9563154c-6869-4c3b-9e55-b406cfd6df9b req-0d7961c6-4cf5-4ed2-89df-13bf3973c15c service nova] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Received event network-vif-plugged-94d9c8c3-7857-42d7-8e92-2b983bdd3dc6 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:25:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9563154c-6869-4c3b-9e55-b406cfd6df9b req-0d7961c6-4cf5-4ed2-89df-13bf3973c15c service nova] Acquiring lock "4efab321-f2aa-456c-a1ae-b32f399f694d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9563154c-6869-4c3b-9e55-b406cfd6df9b req-0d7961c6-4cf5-4ed2-89df-13bf3973c15c service nova] Lock "4efab321-f2aa-456c-a1ae-b32f399f694d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9563154c-6869-4c3b-9e55-b406cfd6df9b req-0d7961c6-4cf5-4ed2-89df-13bf3973c15c service nova] Lock "4efab321-f2aa-456c-a1ae-b32f399f694d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:46 user nova-compute[72773]: DEBUG nova.compute.manager [req-9563154c-6869-4c3b-9e55-b406cfd6df9b req-0d7961c6-4cf5-4ed2-89df-13bf3973c15c service nova] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] No waiting events found dispatching network-vif-plugged-94d9c8c3-7857-42d7-8e92-2b983bdd3dc6 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:25:46 user nova-compute[72773]: WARNING nova.compute.manager [req-9563154c-6869-4c3b-9e55-b406cfd6df9b req-0d7961c6-4cf5-4ed2-89df-13bf3973c15c service nova] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Received unexpected event network-vif-plugged-94d9c8c3-7857-42d7-8e92-2b983bdd3dc6 for instance with vm_state active and task_state None.
Aug 16 22:25:46 user nova-compute[72773]: DEBUG nova.compute.manager [req-9563154c-6869-4c3b-9e55-b406cfd6df9b req-0d7961c6-4cf5-4ed2-89df-13bf3973c15c service nova] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Received event network-vif-plugged-813736f3-3cf2-4d52-9bf5-239b93647ee2 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:25:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9563154c-6869-4c3b-9e55-b406cfd6df9b req-0d7961c6-4cf5-4ed2-89df-13bf3973c15c service nova] Acquiring lock "c6adfa95-47ac-40d3-abc1-0c6027507f07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9563154c-6869-4c3b-9e55-b406cfd6df9b req-0d7961c6-4cf5-4ed2-89df-13bf3973c15c service nova] Lock "c6adfa95-47ac-40d3-abc1-0c6027507f07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9563154c-6869-4c3b-9e55-b406cfd6df9b req-0d7961c6-4cf5-4ed2-89df-13bf3973c15c service nova] Lock "c6adfa95-47ac-40d3-abc1-0c6027507f07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:46 user nova-compute[72773]: DEBUG nova.compute.manager [req-9563154c-6869-4c3b-9e55-b406cfd6df9b req-0d7961c6-4cf5-4ed2-89df-13bf3973c15c service nova] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] No waiting events found dispatching network-vif-plugged-813736f3-3cf2-4d52-9bf5-239b93647ee2 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:25:46 user nova-compute[72773]: WARNING nova.compute.manager [req-9563154c-6869-4c3b-9e55-b406cfd6df9b req-0d7961c6-4cf5-4ed2-89df-13bf3973c15c service nova] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Received unexpected event network-vif-plugged-813736f3-3cf2-4d52-9bf5-239b93647ee2 for instance with vm_state active and task_state None.
Aug 16 22:25:46 user nova-compute[72773]: DEBUG nova.compute.manager [req-9563154c-6869-4c3b-9e55-b406cfd6df9b req-0d7961c6-4cf5-4ed2-89df-13bf3973c15c service nova] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Received event network-vif-plugged-813736f3-3cf2-4d52-9bf5-239b93647ee2 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:25:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9563154c-6869-4c3b-9e55-b406cfd6df9b req-0d7961c6-4cf5-4ed2-89df-13bf3973c15c service nova] Acquiring lock "c6adfa95-47ac-40d3-abc1-0c6027507f07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9563154c-6869-4c3b-9e55-b406cfd6df9b req-0d7961c6-4cf5-4ed2-89df-13bf3973c15c service nova] Lock "c6adfa95-47ac-40d3-abc1-0c6027507f07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9563154c-6869-4c3b-9e55-b406cfd6df9b req-0d7961c6-4cf5-4ed2-89df-13bf3973c15c service nova] Lock "c6adfa95-47ac-40d3-abc1-0c6027507f07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:46 user nova-compute[72773]: DEBUG nova.compute.manager [req-9563154c-6869-4c3b-9e55-b406cfd6df9b req-0d7961c6-4cf5-4ed2-89df-13bf3973c15c service nova] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] No waiting events found dispatching network-vif-plugged-813736f3-3cf2-4d52-9bf5-239b93647ee2 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:25:46 user nova-compute[72773]: WARNING nova.compute.manager [req-9563154c-6869-4c3b-9e55-b406cfd6df9b req-0d7961c6-4cf5-4ed2-89df-13bf3973c15c service nova] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Received unexpected event network-vif-plugged-813736f3-3cf2-4d52-9bf5-239b93647ee2 for instance with vm_state active and task_state None.
Aug 16 22:25:46 user nova-compute[72773]: DEBUG nova.compute.manager [req-9563154c-6869-4c3b-9e55-b406cfd6df9b req-0d7961c6-4cf5-4ed2-89df-13bf3973c15c service nova] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Received event network-vif-plugged-c0ab5700-b895-412c-acca-e116a216cc89 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:25:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9563154c-6869-4c3b-9e55-b406cfd6df9b req-0d7961c6-4cf5-4ed2-89df-13bf3973c15c service nova] Acquiring lock "aa4cbd72-a11c-4dab-b2e2-29fe10493931-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9563154c-6869-4c3b-9e55-b406cfd6df9b req-0d7961c6-4cf5-4ed2-89df-13bf3973c15c service nova] Lock "aa4cbd72-a11c-4dab-b2e2-29fe10493931-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9563154c-6869-4c3b-9e55-b406cfd6df9b req-0d7961c6-4cf5-4ed2-89df-13bf3973c15c service nova] Lock "aa4cbd72-a11c-4dab-b2e2-29fe10493931-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:46 user nova-compute[72773]: DEBUG nova.compute.manager [req-9563154c-6869-4c3b-9e55-b406cfd6df9b req-0d7961c6-4cf5-4ed2-89df-13bf3973c15c service nova] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] No waiting events found dispatching network-vif-plugged-c0ab5700-b895-412c-acca-e116a216cc89 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:25:46 user nova-compute[72773]: WARNING nova.compute.manager [req-9563154c-6869-4c3b-9e55-b406cfd6df9b req-0d7961c6-4cf5-4ed2-89df-13bf3973c15c service nova] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Received unexpected event network-vif-plugged-c0ab5700-b895-412c-acca-e116a216cc89 for instance with vm_state active and task_state None.
Aug 16 22:25:46 user nova-compute[72773]: DEBUG nova.compute.manager [req-9563154c-6869-4c3b-9e55-b406cfd6df9b req-0d7961c6-4cf5-4ed2-89df-13bf3973c15c service nova] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Received event network-vif-plugged-c0ab5700-b895-412c-acca-e116a216cc89 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:25:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9563154c-6869-4c3b-9e55-b406cfd6df9b req-0d7961c6-4cf5-4ed2-89df-13bf3973c15c service nova] Acquiring lock "aa4cbd72-a11c-4dab-b2e2-29fe10493931-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9563154c-6869-4c3b-9e55-b406cfd6df9b req-0d7961c6-4cf5-4ed2-89df-13bf3973c15c service nova] Lock "aa4cbd72-a11c-4dab-b2e2-29fe10493931-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9563154c-6869-4c3b-9e55-b406cfd6df9b req-0d7961c6-4cf5-4ed2-89df-13bf3973c15c service nova] Lock "aa4cbd72-a11c-4dab-b2e2-29fe10493931-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:46 user nova-compute[72773]: DEBUG nova.compute.manager [req-9563154c-6869-4c3b-9e55-b406cfd6df9b req-0d7961c6-4cf5-4ed2-89df-13bf3973c15c service nova] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] No waiting events found dispatching network-vif-plugged-c0ab5700-b895-412c-acca-e116a216cc89 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:25:46 user nova-compute[72773]: WARNING nova.compute.manager [req-9563154c-6869-4c3b-9e55-b406cfd6df9b req-0d7961c6-4cf5-4ed2-89df-13bf3973c15c service nova] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Received unexpected event network-vif-plugged-c0ab5700-b895-412c-acca-e116a216cc89 for instance with vm_state active and task_state None.
Aug 16 22:25:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4387131d-7a86-477a-a231-69713b2d965d/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4387131d-7a86-477a-a231-69713b2d965d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4387131d-7a86-477a-a231-69713b2d965d/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4387131d-7a86-477a-a231-69713b2d965d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa4cbd72-a11c-4dab-b2e2-29fe10493931/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa4cbd72-a11c-4dab-b2e2-29fe10493931/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa4cbd72-a11c-4dab-b2e2-29fe10493931/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:25:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa4cbd72-a11c-4dab-b2e2-29fe10493931/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:25:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:25:49 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:25:49 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:25:49 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=7373MB free_disk=25.98798370361328GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:25:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:25:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:25:49 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 956d334e-f190-4625-b144-ab44d2f3321a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:25:49 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 02235c77-0c2a-4317-8526-7bd5096694a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:25:49 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 4efab321-f2aa-456c-a1ae-b32f399f694d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:25:49 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 02227d9f-5ddf-42fe-91a8-ce56d76aa274 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:25:49 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 4387131d-7a86-477a-a231-69713b2d965d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:25:49 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance c6adfa95-47ac-40d3-abc1-0c6027507f07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:25:49 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance aa4cbd72-a11c-4dab-b2e2-29fe10493931 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:25:49 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 8bbb196d-e352-47a5-86fb-a819723c2ce8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:25:49 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:25:49 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:25:49 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Refreshing inventories for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 22:25:49 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Updating ProviderTree inventory for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 22:25:49 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Updating inventory in ProviderTree for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 22:25:49 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Refreshing aggregate associations for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e, aggregates: None {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 22:25:49 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Refreshing trait associations for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 22:25:49 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:25:49 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:25:50 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:25:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.691s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:25:51 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:25:54 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:54 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:25:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:04 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:04 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:04 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Acquiring lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:26:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:26:08 user nova-compute[72773]: DEBUG nova.compute.manager [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:26:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:26:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:26:08 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:26:08 user nova-compute[72773]: INFO nova.compute.claims [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Claim successful on node user
Aug 16 22:26:09 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:26:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:09 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:26:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.356s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:26:09 user nova-compute[72773]: DEBUG nova.compute.manager [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:26:09 user nova-compute[72773]: DEBUG nova.compute.manager [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:26:09 user nova-compute[72773]: DEBUG nova.network.neutron [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:26:09 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:26:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:09 user nova-compute[72773]: DEBUG nova.compute.manager [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:26:09 user nova-compute[72773]: INFO nova.virt.block_device [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Booting with volume fb687b38-4616-4b0b-bee3-4ff1da040b18 at /dev/vda
Aug 16 22:26:09 user nova-compute[72773]: DEBUG nova.policy [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '317d00f05a4649c2888f6d30e0a140b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a863da00c62473b9f3726f45900be0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:26:09 user nova-compute[72773]: DEBUG os_brick.utils [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:26:09 user nova-compute[72773]: INFO oslo.privsep.daemon [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp5twhysai/privsep.sock']
Aug 16 22:26:09 user sudo[83946]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp5twhysai/privsep.sock
Aug 16 22:26:09 user sudo[83946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 16 22:26:10 user nova-compute[72773]: DEBUG nova.network.neutron [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Successfully created port: 6e021e1c-b583-4ddf-ad9a-f215484ff208 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:26:10 user nova-compute[72773]: DEBUG nova.network.neutron [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Successfully updated port: 6e021e1c-b583-4ddf-ad9a-f215484ff208 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:26:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Acquiring lock "refresh_cache-2c1c948f-c541-41ea-ba51-23ff78d1c0db" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:26:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Acquired lock "refresh_cache-2c1c948f-c541-41ea-ba51-23ff78d1c0db" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:26:10 user nova-compute[72773]: DEBUG nova.network.neutron [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:26:10 user nova-compute[72773]: DEBUG nova.compute.manager [req-16953064-fc39-4720-ae7f-e0135377b822 req-3c6c424d-0ca0-4195-90d2-3bb940849f56 service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Received event network-changed-6e021e1c-b583-4ddf-ad9a-f215484ff208 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:26:10 user nova-compute[72773]: DEBUG nova.compute.manager [req-16953064-fc39-4720-ae7f-e0135377b822 req-3c6c424d-0ca0-4195-90d2-3bb940849f56 service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Refreshing instance network info cache due to event network-changed-6e021e1c-b583-4ddf-ad9a-f215484ff208. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:26:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-16953064-fc39-4720-ae7f-e0135377b822 req-3c6c424d-0ca0-4195-90d2-3bb940849f56 service nova] Acquiring lock "refresh_cache-2c1c948f-c541-41ea-ba51-23ff78d1c0db" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:26:10 user nova-compute[72773]: DEBUG nova.network.neutron [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:26:11 user nova-compute[72773]: DEBUG nova.network.neutron [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Updating instance_info_cache with network_info: [{"id": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "address": "fa:16:3e:48:cc:48", "network": {"id": "a399052b-0f9b-4c24-a176-7b59221e92a1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-679236513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a863da00c62473b9f3726f45900be0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e021e1c-b5", "ovs_interfaceid": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:26:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Releasing lock "refresh_cache-2c1c948f-c541-41ea-ba51-23ff78d1c0db" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:26:11 user nova-compute[72773]: DEBUG nova.compute.manager [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Instance network_info: |[{"id": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "address": "fa:16:3e:48:cc:48", "network": {"id": "a399052b-0f9b-4c24-a176-7b59221e92a1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-679236513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a863da00c62473b9f3726f45900be0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e021e1c-b5", "ovs_interfaceid": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:26:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-16953064-fc39-4720-ae7f-e0135377b822 req-3c6c424d-0ca0-4195-90d2-3bb940849f56 service nova] Acquired lock "refresh_cache-2c1c948f-c541-41ea-ba51-23ff78d1c0db" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:26:11 user nova-compute[72773]: DEBUG nova.network.neutron [req-16953064-fc39-4720-ae7f-e0135377b822 req-3c6c424d-0ca0-4195-90d2-3bb940849f56 service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Refreshing network info cache for port 6e021e1c-b583-4ddf-ad9a-f215484ff208 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:26:11 user sudo[83946]: pam_unix(sudo:session): session closed for user root
Aug 16 22:26:11 user nova-compute[72773]: INFO oslo.privsep.daemon [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Spawned new privsep daemon via rootwrap
Aug 16 22:26:11 user nova-compute[72773]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 16 22:26:11 user nova-compute[72773]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 16 22:26:11 user nova-compute[72773]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 16 22:26:11 user nova-compute[72773]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83955
Aug 16 22:26:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26d06d4-15ab-4839-8c3d-43a6b374ff5a]: (2,) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09bb6b2-8d6d-4d85-a971-dc53dcac0e8c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:11 user nova-compute[72773]: WARNING os_brick.initiator.connectors.nvmeof [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 16 22:26:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[552cbba1-d55f-4b18-813e-8dfe4fc7679f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd3ce9c-3d8e-446d-a005-1782d859b4b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[403e03b9-93a8-4756-a42a-f08a7ff2bd86]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:26:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:26:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:26:11 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:26:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[766d6220-38da-4c68-a22d-f8c196164732]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:26:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:26:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:26:11 user nova-compute[72773]: DEBUG os_brick.utils [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] <== get_connector_properties: return (2142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:26:11 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Updating existing volume attachment record: cdb84ad8-8b9b-471f-bd77-6419fb359c81 {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:26:11 user nova-compute[72773]: DEBUG nova.network.neutron [req-16953064-fc39-4720-ae7f-e0135377b822 req-3c6c424d-0ca0-4195-90d2-3bb940849f56 service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Updated VIF entry in instance network info cache for port 6e021e1c-b583-4ddf-ad9a-f215484ff208. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:26:11 user nova-compute[72773]: DEBUG nova.network.neutron [req-16953064-fc39-4720-ae7f-e0135377b822 req-3c6c424d-0ca0-4195-90d2-3bb940849f56 service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Updating instance_info_cache with network_info: [{"id": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "address": "fa:16:3e:48:cc:48", "network": {"id": "a399052b-0f9b-4c24-a176-7b59221e92a1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-679236513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a863da00c62473b9f3726f45900be0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e021e1c-b5", "ovs_interfaceid": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:26:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-16953064-fc39-4720-ae7f-e0135377b822 req-3c6c424d-0ca0-4195-90d2-3bb940849f56 service nova] Releasing lock "refresh_cache-2c1c948f-c541-41ea-ba51-23ff78d1c0db" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:26:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Acquiring lock "dbfa3908-7c4c-4c7d-a04f-672a8c52ca89" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:26:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Lock "dbfa3908-7c4c-4c7d-a04f-672a8c52ca89" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:26:13 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:26:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:26:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:26:13 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:26:13 user nova-compute[72773]: INFO nova.compute.claims [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Claim successful on node user
Aug 16 22:26:13 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:26:13 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:26:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.384s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:26:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:26:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:26:14 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:26:14 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:26:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:26:14 user nova-compute[72773]: DEBUG nova.policy [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c35e2d6fa19149818d643673a3506401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48facceddcd84885acb1d719ee6b6fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:26:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:26:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:26:14 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Creating image(s)
Aug 16 22:26:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Acquiring lock "/opt/stack/data/nova/instances/dbfa3908-7c4c-4c7d-a04f-672a8c52ca89/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:26:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Lock "/opt/stack/data/nova/instances/dbfa3908-7c4c-4c7d-a04f-672a8c52ca89/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:26:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Lock "/opt/stack/data/nova/instances/dbfa3908-7c4c-4c7d-a04f-672a8c52ca89/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:26:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.170s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:26:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:26:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.177s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/dbfa3908-7c4c-4c7d-a04f-672a8c52ca89/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/dbfa3908-7c4c-4c7d-a04f-672a8c52ca89/disk 1073741824" returned: 0 in 0.047s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:26:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:14 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Successfully created port: ca6a5116-be17-41d1-82be-140d0b6df7d7 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:26:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.218s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:14 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dbfa3908-7c4c-4c7d-a04f-672a8c52ca89/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:26:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbfa3908-7c4c-4c7d-a04f-672a8c52ca89/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbfa3908-7c4c-4c7d-a04f-672a8c52ca89/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:15 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Cannot resize image /opt/stack/data/nova/instances/dbfa3908-7c4c-4c7d-a04f-672a8c52ca89/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:26:15 user nova-compute[72773]: DEBUG nova.objects.instance [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Lazy-loading 'migration_context' on Instance uuid dbfa3908-7c4c-4c7d-a04f-672a8c52ca89 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:26:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:26:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Ensure instance console log exists: /opt/stack/data/nova/instances/dbfa3908-7c4c-4c7d-a04f-672a8c52ca89/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:26:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:26:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:26:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Successfully updated port: ca6a5116-be17-41d1-82be-140d0b6df7d7 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Acquiring lock "refresh_cache-dbfa3908-7c4c-4c7d-a04f-672a8c52ca89" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Acquired lock "refresh_cache-dbfa3908-7c4c-4c7d-a04f-672a8c52ca89" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG nova.compute.manager [req-8cd177d4-7774-4df8-8f89-7e1976f92a29 req-ab72f24a-5ab6-448d-8848-5821d8348703 service nova] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Received event network-changed-ca6a5116-be17-41d1-82be-140d0b6df7d7 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG nova.compute.manager [req-8cd177d4-7774-4df8-8f89-7e1976f92a29 req-ab72f24a-5ab6-448d-8848-5821d8348703 service nova] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Refreshing instance network info cache due to event network-changed-ca6a5116-be17-41d1-82be-140d0b6df7d7. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-8cd177d4-7774-4df8-8f89-7e1976f92a29 req-ab72f24a-5ab6-448d-8848-5821d8348703 service nova] Acquiring lock "refresh_cache-dbfa3908-7c4c-4c7d-a04f-672a8c52ca89" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Updating instance_info_cache with network_info: [{"id": "ca6a5116-be17-41d1-82be-140d0b6df7d7", "address": "fa:16:3e:ad:a8:58", "network": {"id": "8f06d9ea-90a9-4ade-9b5e-25eb1f1c6ca5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2137341653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48facceddcd84885acb1d719ee6b6fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca6a5116-be", "ovs_interfaceid": "ca6a5116-be17-41d1-82be-140d0b6df7d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Releasing lock "refresh_cache-dbfa3908-7c4c-4c7d-a04f-672a8c52ca89" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Instance network_info: |[{"id": "ca6a5116-be17-41d1-82be-140d0b6df7d7", "address": "fa:16:3e:ad:a8:58", "network": {"id": "8f06d9ea-90a9-4ade-9b5e-25eb1f1c6ca5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2137341653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48facceddcd84885acb1d719ee6b6fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca6a5116-be", "ovs_interfaceid": "ca6a5116-be17-41d1-82be-140d0b6df7d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-8cd177d4-7774-4df8-8f89-7e1976f92a29 req-ab72f24a-5ab6-448d-8848-5821d8348703 service nova] Acquired lock "refresh_cache-dbfa3908-7c4c-4c7d-a04f-672a8c52ca89" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG nova.network.neutron [req-8cd177d4-7774-4df8-8f89-7e1976f92a29 req-ab72f24a-5ab6-448d-8848-5821d8348703 service nova] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Refreshing network info cache for port ca6a5116-be17-41d1-82be-140d0b6df7d7 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Start _get_guest_xml network_info=[{"id": "ca6a5116-be17-41d1-82be-140d0b6df7d7", "address": "fa:16:3e:ad:a8:58", "network": {"id": "8f06d9ea-90a9-4ade-9b5e-25eb1f1c6ca5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2137341653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48facceddcd84885acb1d719ee6b6fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca6a5116-be", "ovs_interfaceid": "ca6a5116-be17-41d1-82be-140d0b6df7d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:26:16 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:26:16 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:26:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:26:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-356436697',display_name='tempest-VolumesActionsTest-instance-356436697',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-356436697',id=10,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48facceddcd84885acb1d719ee6b6fe4',ramdisk_id='',reservation_id='r-llefm4um',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1396899120',owner_user_name='tempest-VolumesActionsTest-1396899120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:26:14Z,user_data=None,user_id='c35e2d6fa19149818d643673a3506401',uuid=dbfa3908-7c4c-4c7d-a04f-672a8c52ca89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca6a5116-be17-41d1-82be-140d0b6df7d7", "address": "fa:16:3e:ad:a8:58", "network": {"id": "8f06d9ea-90a9-4ade-9b5e-25eb1f1c6ca5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2137341653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48facceddcd84885acb1d719ee6b6fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca6a5116-be", "ovs_interfaceid": "ca6a5116-be17-41d1-82be-140d0b6df7d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Converting VIF {"id": "ca6a5116-be17-41d1-82be-140d0b6df7d7", "address": "fa:16:3e:ad:a8:58", "network": {"id": "8f06d9ea-90a9-4ade-9b5e-25eb1f1c6ca5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2137341653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48facceddcd84885acb1d719ee6b6fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca6a5116-be", "ovs_interfaceid": "ca6a5116-be17-41d1-82be-140d0b6df7d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:a8:58,bridge_name='br-int',has_traffic_filtering=True,id=ca6a5116-be17-41d1-82be-140d0b6df7d7,network=Network(8f06d9ea-90a9-4ade-9b5e-25eb1f1c6ca5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca6a5116-be') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG nova.objects.instance [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Lazy-loading 'pci_devices' on Instance uuid dbfa3908-7c4c-4c7d-a04f-672a8c52ca89 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:26:16 user nova-compute[72773]:   <uuid>dbfa3908-7c4c-4c7d-a04f-672a8c52ca89</uuid>
Aug 16 22:26:16 user nova-compute[72773]:   <name>instance-0000000a</name>
Aug 16 22:26:16 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:26:16 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:26:16 user nova-compute[72773]:   <metadata>
Aug 16 22:26:16 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:26:16 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:26:16 user nova-compute[72773]:       <nova:name>tempest-VolumesActionsTest-instance-356436697</nova:name>
Aug 16 22:26:16 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:26:16</nova:creationTime>
Aug 16 22:26:16 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:26:16 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:26:16 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:26:16 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:26:16 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:26:16 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:26:16 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:26:16 user nova-compute[72773]:       <nova:owner>
Aug 16 22:26:16 user nova-compute[72773]:         <nova:user uuid="c35e2d6fa19149818d643673a3506401">tempest-VolumesActionsTest-1396899120-project-member</nova:user>
Aug 16 22:26:16 user nova-compute[72773]:         <nova:project uuid="48facceddcd84885acb1d719ee6b6fe4">tempest-VolumesActionsTest-1396899120</nova:project>
Aug 16 22:26:16 user nova-compute[72773]:       </nova:owner>
Aug 16 22:26:16 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:26:16 user nova-compute[72773]:       <nova:ports>
Aug 16 22:26:16 user nova-compute[72773]:         <nova:port uuid="ca6a5116-be17-41d1-82be-140d0b6df7d7">
Aug 16 22:26:16 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 22:26:16 user nova-compute[72773]:         </nova:port>
Aug 16 22:26:16 user nova-compute[72773]:       </nova:ports>
Aug 16 22:26:16 user nova-compute[72773]:     </nova:instance>
Aug 16 22:26:16 user nova-compute[72773]:   </metadata>
Aug 16 22:26:16 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:26:16 user nova-compute[72773]:     <system>
Aug 16 22:26:16 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:26:16 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:26:16 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:26:16 user nova-compute[72773]:       <entry name="serial">dbfa3908-7c4c-4c7d-a04f-672a8c52ca89</entry>
Aug 16 22:26:16 user nova-compute[72773]:       <entry name="uuid">dbfa3908-7c4c-4c7d-a04f-672a8c52ca89</entry>
Aug 16 22:26:16 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:26:16 user nova-compute[72773]:     </system>
Aug 16 22:26:16 user nova-compute[72773]:   </sysinfo>
Aug 16 22:26:16 user nova-compute[72773]:   <os>
Aug 16 22:26:16 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:26:16 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:26:16 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:26:16 user nova-compute[72773]:   </os>
Aug 16 22:26:16 user nova-compute[72773]:   <features>
Aug 16 22:26:16 user nova-compute[72773]:     <acpi/>
Aug 16 22:26:16 user nova-compute[72773]:     <apic/>
Aug 16 22:26:16 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:26:16 user nova-compute[72773]:   </features>
Aug 16 22:26:16 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:26:16 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:26:16 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:26:16 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:26:16 user nova-compute[72773]:   </clock>
Aug 16 22:26:16 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:26:16 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:26:16 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:26:16 user nova-compute[72773]:   </cpu>
Aug 16 22:26:16 user nova-compute[72773]:   <devices>
Aug 16 22:26:16 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:26:16 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:26:16 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/dbfa3908-7c4c-4c7d-a04f-672a8c52ca89/disk"/>
Aug 16 22:26:16 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:26:16 user nova-compute[72773]:     </disk>
Aug 16 22:26:16 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:26:16 user nova-compute[72773]:       <mac address="fa:16:3e:ad:a8:58"/>
Aug 16 22:26:16 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:26:16 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:26:16 user nova-compute[72773]:       <target dev="tapca6a5116-be"/>
Aug 16 22:26:16 user nova-compute[72773]:     </interface>
Aug 16 22:26:16 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:26:16 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/dbfa3908-7c4c-4c7d-a04f-672a8c52ca89/console.log" append="off"/>
Aug 16 22:26:16 user nova-compute[72773]:     </serial>
Aug 16 22:26:16 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:26:16 user nova-compute[72773]:     <video>
Aug 16 22:26:16 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:26:16 user nova-compute[72773]:     </video>
Aug 16 22:26:16 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:26:16 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:26:16 user nova-compute[72773]:     </rng>
Aug 16 22:26:16 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:26:16 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:26:16 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:26:16 user nova-compute[72773]:     </memballoon>
Aug 16 22:26:16 user nova-compute[72773]:   </devices>
Aug 16 22:26:16 user nova-compute[72773]: </domain>
Aug 16 22:26:16 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:26:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-356436697',display_name='tempest-VolumesActionsTest-instance-356436697',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-356436697',id=10,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48facceddcd84885acb1d719ee6b6fe4',ramdisk_id='',reservation_id='r-llefm4um',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1396899120',owner_user_name='tempest-VolumesActionsTest-1396899120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:26:14Z,user_data=None,user_id='c35e2d6fa19149818d643673a3506401',uuid=dbfa3908-7c4c-4c7d-a04f-672a8c52ca89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca6a5116-be17-41d1-82be-140d0b6df7d7", "address": "fa:16:3e:ad:a8:58", "network": {"id": "8f06d9ea-90a9-4ade-9b5e-25eb1f1c6ca5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2137341653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48facceddcd84885acb1d719ee6b6fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca6a5116-be", "ovs_interfaceid": "ca6a5116-be17-41d1-82be-140d0b6df7d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Converting VIF {"id": "ca6a5116-be17-41d1-82be-140d0b6df7d7", "address": "fa:16:3e:ad:a8:58", "network": {"id": "8f06d9ea-90a9-4ade-9b5e-25eb1f1c6ca5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2137341653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48facceddcd84885acb1d719ee6b6fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca6a5116-be", "ovs_interfaceid": "ca6a5116-be17-41d1-82be-140d0b6df7d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:a8:58,bridge_name='br-int',has_traffic_filtering=True,id=ca6a5116-be17-41d1-82be-140d0b6df7d7,network=Network(8f06d9ea-90a9-4ade-9b5e-25eb1f1c6ca5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca6a5116-be') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG os_vif [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:a8:58,bridge_name='br-int',has_traffic_filtering=True,id=ca6a5116-be17-41d1-82be-140d0b6df7d7,network=Network(8f06d9ea-90a9-4ade-9b5e-25eb1f1c6ca5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca6a5116-be') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca6a5116-be, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapca6a5116-be, col_values=(('external_ids', {'iface-id': 'ca6a5116-be17-41d1-82be-140d0b6df7d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:a8:58', 'vm-uuid': 'dbfa3908-7c4c-4c7d-a04f-672a8c52ca89'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:16 user nova-compute[72773]: INFO os_vif [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:a8:58,bridge_name='br-int',has_traffic_filtering=True,id=ca6a5116-be17-41d1-82be-140d0b6df7d7,network=Network(8f06d9ea-90a9-4ade-9b5e-25eb1f1c6ca5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca6a5116-be')
Aug 16 22:26:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:26:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] No VIF found with MAC fa:16:3e:ad:a8:58, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:26:17 user nova-compute[72773]: DEBUG nova.network.neutron [req-8cd177d4-7774-4df8-8f89-7e1976f92a29 req-ab72f24a-5ab6-448d-8848-5821d8348703 service nova] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Updated VIF entry in instance network info cache for port ca6a5116-be17-41d1-82be-140d0b6df7d7. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:26:17 user nova-compute[72773]: DEBUG nova.network.neutron [req-8cd177d4-7774-4df8-8f89-7e1976f92a29 req-ab72f24a-5ab6-448d-8848-5821d8348703 service nova] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Updating instance_info_cache with network_info: [{"id": "ca6a5116-be17-41d1-82be-140d0b6df7d7", "address": "fa:16:3e:ad:a8:58", "network": {"id": "8f06d9ea-90a9-4ade-9b5e-25eb1f1c6ca5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2137341653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48facceddcd84885acb1d719ee6b6fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca6a5116-be", "ovs_interfaceid": "ca6a5116-be17-41d1-82be-140d0b6df7d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:26:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-8cd177d4-7774-4df8-8f89-7e1976f92a29 req-ab72f24a-5ab6-448d-8848-5821d8348703 service nova] Releasing lock "refresh_cache-dbfa3908-7c4c-4c7d-a04f-672a8c52ca89" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:26:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:18 user nova-compute[72773]: DEBUG nova.compute.manager [req-251160ea-a313-469b-aba9-3f1d2414fc9e req-3e432d10-acf0-4472-8695-4bd8a06b2f99 service nova] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Received event network-vif-plugged-ca6a5116-be17-41d1-82be-140d0b6df7d7 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:26:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-251160ea-a313-469b-aba9-3f1d2414fc9e req-3e432d10-acf0-4472-8695-4bd8a06b2f99 service nova] Acquiring lock "dbfa3908-7c4c-4c7d-a04f-672a8c52ca89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:26:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-251160ea-a313-469b-aba9-3f1d2414fc9e req-3e432d10-acf0-4472-8695-4bd8a06b2f99 service nova] Lock "dbfa3908-7c4c-4c7d-a04f-672a8c52ca89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:26:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-251160ea-a313-469b-aba9-3f1d2414fc9e req-3e432d10-acf0-4472-8695-4bd8a06b2f99 service nova] Lock "dbfa3908-7c4c-4c7d-a04f-672a8c52ca89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:26:18 user nova-compute[72773]: DEBUG nova.compute.manager [req-251160ea-a313-469b-aba9-3f1d2414fc9e req-3e432d10-acf0-4472-8695-4bd8a06b2f99 service nova] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] No waiting events found dispatching network-vif-plugged-ca6a5116-be17-41d1-82be-140d0b6df7d7 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:26:18 user nova-compute[72773]: WARNING nova.compute.manager [req-251160ea-a313-469b-aba9-3f1d2414fc9e req-3e432d10-acf0-4472-8695-4bd8a06b2f99 service nova] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Received unexpected event network-vif-plugged-ca6a5116-be17-41d1-82be-140d0b6df7d7 for instance with vm_state building and task_state spawning.
Aug 16 22:26:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:20 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224780.229083, dbfa3908-7c4c-4c7d-a04f-672a8c52ca89 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:26:20 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] VM Resumed (Lifecycle Event)
Aug 16 22:26:20 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:26:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:26:20 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Instance spawned successfully.
Aug 16 22:26:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:26:20 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:26:20 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:26:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:26:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:26:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:26:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:26:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:26:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:26:20 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:26:20 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224780.232797, dbfa3908-7c4c-4c7d-a04f-672a8c52ca89 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:26:20 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] VM Started (Lifecycle Event)
Aug 16 22:26:20 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:26:20 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:26:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-a894aae3-d6db-4bbe-9f80-9b240447b36c req-d727c985-e85e-4096-83bc-ebb68338341c service nova] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Received event network-vif-plugged-ca6a5116-be17-41d1-82be-140d0b6df7d7 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:26:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a894aae3-d6db-4bbe-9f80-9b240447b36c req-d727c985-e85e-4096-83bc-ebb68338341c service nova] Acquiring lock "dbfa3908-7c4c-4c7d-a04f-672a8c52ca89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:26:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a894aae3-d6db-4bbe-9f80-9b240447b36c req-d727c985-e85e-4096-83bc-ebb68338341c service nova] Lock "dbfa3908-7c4c-4c7d-a04f-672a8c52ca89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:26:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a894aae3-d6db-4bbe-9f80-9b240447b36c req-d727c985-e85e-4096-83bc-ebb68338341c service nova] Lock "dbfa3908-7c4c-4c7d-a04f-672a8c52ca89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:26:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-a894aae3-d6db-4bbe-9f80-9b240447b36c req-d727c985-e85e-4096-83bc-ebb68338341c service nova] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] No waiting events found dispatching network-vif-plugged-ca6a5116-be17-41d1-82be-140d0b6df7d7 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:26:20 user nova-compute[72773]: WARNING nova.compute.manager [req-a894aae3-d6db-4bbe-9f80-9b240447b36c req-d727c985-e85e-4096-83bc-ebb68338341c service nova] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Received unexpected event network-vif-plugged-ca6a5116-be17-41d1-82be-140d0b6df7d7 for instance with vm_state building and task_state spawning.
Aug 16 22:26:20 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:26:20 user nova-compute[72773]: INFO nova.compute.manager [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Took 6.13 seconds to spawn the instance on the hypervisor.
Aug 16 22:26:20 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:26:20 user nova-compute[72773]: INFO nova.compute.manager [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Took 6.83 seconds to build instance.
Aug 16 22:26:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7765df43-7784-40a0-b41e-33b6430270bc tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Lock "dbfa3908-7c4c-4c7d-a04f-672a8c52ca89" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.922s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:26:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:26:29 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Creating image(s)
Aug 16 22:26:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Did not create local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Ensure instance console log exists: /opt/stack/data/nova/instances/2c1c948f-c541-41ea-ba51-23ff78d1c0db/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Start _get_guest_xml network_info=[{"id": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "address": "fa:16:3e:48:cc:48", "network": {"id": "a399052b-0f9b-4c24-a176-7b59221e92a1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-679236513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a863da00c62473b9f3726f45900be0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e021e1c-b5", "ovs_interfaceid": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'cdb84ad8-8b9b-471f-bd77-6419fb359c81', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abPpkSTl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2c1c948f-c541-41ea-ba51-23ff78d1c0db', 'attached_at': '', 'detached_at': '', 'volume_id': 'fb687b38-4616-4b0b-bee3-4ff1da040b18', 'serial': 'fb687b38-4616-4b0b-bee3-4ff1da040b18'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:26:29 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:26:29 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:26:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG os_brick.initiator.connector [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Factory for ISCSI on None {{(pid=72773) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abPpkSTl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:26:29 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:26:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:26:29 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:26:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:26:29 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72629f2-6f65-4ea2-997f-4221e1324ac4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:26:29 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3e3e61-09a0-4a15-ae68-0519ec139638]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18] added
Aug 16 22:26:29 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.090s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5579efa-19c6-4c9a-9a89-813a09eece77]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[018461fb-6241-4614-9243-4e928a77bb39]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v abPpkSTl {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v abPpkSTl" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfcba23-9ea3-4a13-81aa-d52be7700b9b]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'abPpkSTl'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.015s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b8abe6-fe92-41a9-8795-99a472760612]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.014s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[03597ad8-b159-40da-b778-6e5539b218dc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 22:26:29 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 22:26:29 user nova-compute[72773]:  {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:26:29 user nova-compute[72773]: WARNING os_brick.initiator.connectors.iscsi [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 22:26:29 user nova-compute[72773]: 
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac719501-439a-4025-9826-9be329661d45]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18, portal: 172.16.0.220,3260]
Aug 16 22:26:29 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18, portal: 172.16.0.220,3260] successful.
Aug 16 22:26:29 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64fa0b5-19a3-4b5b-8d6f-9f6d11508527]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2706ccf-4741-47fd-a1aa-795724dcba6d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:26:29 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:26:29 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[596c68a4-ca27-4116-ab38-d511ad8da69c]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:26:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abPpkSTl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:26:30 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:26:30 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23639383362376532', 'path': '/dev/sdb'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:26:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639383362376532', 'path': '/dev/sdb'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:26:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:26:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1140763264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1140763264',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBA6wXj+pYizM4fJfGUIvhwgan4ub6F4+mEVSZeYo3UraSfwK8dHO9ZRWzHCA/0MsTcW4Way+QQ3ZkahEVK/6hRQ7Z4hPQl0XcQMQn6OttJ3+biiwE/FDTRdP2/DP4bJ/g==',key_name='tempest-keypair-1083426637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a863da00c62473b9f3726f45900be0c',ramdisk_id='',reservation_id='r-kdsmsxtr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1773237892',owner_user_name='tempest-ServerActionsV293TestJSON-1773237892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:26:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='317d00f05a4649c2888f6d30e0a140b8',uuid=2c1c948f-c541-41ea-ba51-23ff78d1c0db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "address": "fa:16:3e:48:cc:48", "network": {"id": "a399052b-0f9b-4c24-a176-7b59221e92a1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-679236513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a863da00c62473b9f3726f45900be0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e021e1c-b5", "ovs_interfaceid": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:26:30 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Converting VIF {"id": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "address": "fa:16:3e:48:cc:48", "network": {"id": "a399052b-0f9b-4c24-a176-7b59221e92a1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-679236513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a863da00c62473b9f3726f45900be0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e021e1c-b5", "ovs_interfaceid": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:26:30 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:cc:48,bridge_name='br-int',has_traffic_filtering=True,id=6e021e1c-b583-4ddf-ad9a-f215484ff208,network=Network(a399052b-0f9b-4c24-a176-7b59221e92a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e021e1c-b5') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:26:30 user nova-compute[72773]: DEBUG nova.objects.instance [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c1c948f-c541-41ea-ba51-23ff78d1c0db {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:26:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:26:30 user nova-compute[72773]:   <uuid>2c1c948f-c541-41ea-ba51-23ff78d1c0db</uuid>
Aug 16 22:26:30 user nova-compute[72773]:   <name>instance-00000009</name>
Aug 16 22:26:30 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:26:30 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:26:30 user nova-compute[72773]:   <metadata>
Aug 16 22:26:30 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:26:30 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:26:30 user nova-compute[72773]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1140763264</nova:name>
Aug 16 22:26:30 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:26:29</nova:creationTime>
Aug 16 22:26:30 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:26:30 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:26:30 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:26:30 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:26:30 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:26:30 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:26:30 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:26:30 user nova-compute[72773]:       <nova:owner>
Aug 16 22:26:30 user nova-compute[72773]:         <nova:user uuid="317d00f05a4649c2888f6d30e0a140b8">tempest-ServerActionsV293TestJSON-1773237892-project-member</nova:user>
Aug 16 22:26:30 user nova-compute[72773]:         <nova:project uuid="8a863da00c62473b9f3726f45900be0c">tempest-ServerActionsV293TestJSON-1773237892</nova:project>
Aug 16 22:26:30 user nova-compute[72773]:       </nova:owner>
Aug 16 22:26:30 user nova-compute[72773]:       <nova:ports>
Aug 16 22:26:30 user nova-compute[72773]:         <nova:port uuid="6e021e1c-b583-4ddf-ad9a-f215484ff208">
Aug 16 22:26:30 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 22:26:30 user nova-compute[72773]:         </nova:port>
Aug 16 22:26:30 user nova-compute[72773]:       </nova:ports>
Aug 16 22:26:30 user nova-compute[72773]:     </nova:instance>
Aug 16 22:26:30 user nova-compute[72773]:   </metadata>
Aug 16 22:26:30 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:26:30 user nova-compute[72773]:     <system>
Aug 16 22:26:30 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:26:30 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:26:30 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:26:30 user nova-compute[72773]:       <entry name="serial">2c1c948f-c541-41ea-ba51-23ff78d1c0db</entry>
Aug 16 22:26:30 user nova-compute[72773]:       <entry name="uuid">2c1c948f-c541-41ea-ba51-23ff78d1c0db</entry>
Aug 16 22:26:30 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:26:30 user nova-compute[72773]:     </system>
Aug 16 22:26:30 user nova-compute[72773]:   </sysinfo>
Aug 16 22:26:30 user nova-compute[72773]:   <os>
Aug 16 22:26:30 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:26:30 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:26:30 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:26:30 user nova-compute[72773]:   </os>
Aug 16 22:26:30 user nova-compute[72773]:   <features>
Aug 16 22:26:30 user nova-compute[72773]:     <acpi/>
Aug 16 22:26:30 user nova-compute[72773]:     <apic/>
Aug 16 22:26:30 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:26:30 user nova-compute[72773]:   </features>
Aug 16 22:26:30 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:26:30 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:26:30 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:26:30 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:26:30 user nova-compute[72773]:   </clock>
Aug 16 22:26:30 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:26:30 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:26:30 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:26:30 user nova-compute[72773]:   </cpu>
Aug 16 22:26:30 user nova-compute[72773]:   <devices>
Aug 16 22:26:30 user nova-compute[72773]:     <disk type="block" device="disk">
Aug 16 22:26:30 user nova-compute[72773]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:26:30 user nova-compute[72773]:       <source dev="/dev/sdb"/>
Aug 16 22:26:30 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:26:30 user nova-compute[72773]:       <serial>fb687b38-4616-4b0b-bee3-4ff1da040b18</serial>
Aug 16 22:26:30 user nova-compute[72773]:     </disk>
Aug 16 22:26:30 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:26:30 user nova-compute[72773]:       <mac address="fa:16:3e:48:cc:48"/>
Aug 16 22:26:30 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:26:30 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:26:30 user nova-compute[72773]:       <target dev="tap6e021e1c-b5"/>
Aug 16 22:26:30 user nova-compute[72773]:     </interface>
Aug 16 22:26:30 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:26:30 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/2c1c948f-c541-41ea-ba51-23ff78d1c0db/console.log" append="off"/>
Aug 16 22:26:30 user nova-compute[72773]:     </serial>
Aug 16 22:26:30 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:26:30 user nova-compute[72773]:     <video>
Aug 16 22:26:30 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:26:30 user nova-compute[72773]:     </video>
Aug 16 22:26:30 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:26:30 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:26:30 user nova-compute[72773]:     </rng>
Aug 16 22:26:30 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:26:30 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:26:30 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:26:30 user nova-compute[72773]:     </memballoon>
Aug 16 22:26:30 user nova-compute[72773]:   </devices>
Aug 16 22:26:30 user nova-compute[72773]: </domain>
Aug 16 22:26:30 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:26:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:26:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1140763264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1140763264',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBA6wXj+pYizM4fJfGUIvhwgan4ub6F4+mEVSZeYo3UraSfwK8dHO9ZRWzHCA/0MsTcW4Way+QQ3ZkahEVK/6hRQ7Z4hPQl0XcQMQn6OttJ3+biiwE/FDTRdP2/DP4bJ/g==',key_name='tempest-keypair-1083426637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a863da00c62473b9f3726f45900be0c',ramdisk_id='',reservation_id='r-kdsmsxtr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1773237892',owner_user_name='tempest-ServerActionsV293TestJSON-1773237892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:26:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='317d00f05a4649c2888f6d30e0a140b8',uuid=2c1c948f-c541-41ea-ba51-23ff78d1c0db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "address": "fa:16:3e:48:cc:48", "network": {"id": "a399052b-0f9b-4c24-a176-7b59221e92a1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-679236513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a863da00c62473b9f3726f45900be0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e021e1c-b5", "ovs_interfaceid": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:26:30 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Converting VIF {"id": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "address": "fa:16:3e:48:cc:48", "network": {"id": "a399052b-0f9b-4c24-a176-7b59221e92a1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-679236513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a863da00c62473b9f3726f45900be0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e021e1c-b5", "ovs_interfaceid": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:26:30 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:cc:48,bridge_name='br-int',has_traffic_filtering=True,id=6e021e1c-b583-4ddf-ad9a-f215484ff208,network=Network(a399052b-0f9b-4c24-a176-7b59221e92a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e021e1c-b5') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:26:30 user nova-compute[72773]: DEBUG os_vif [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:cc:48,bridge_name='br-int',has_traffic_filtering=True,id=6e021e1c-b583-4ddf-ad9a-f215484ff208,network=Network(a399052b-0f9b-4c24-a176-7b59221e92a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e021e1c-b5') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:26:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:26:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:26:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e021e1c-b5, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:26:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6e021e1c-b5, col_values=(('external_ids', {'iface-id': '6e021e1c-b583-4ddf-ad9a-f215484ff208', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:cc:48', 'vm-uuid': '2c1c948f-c541-41ea-ba51-23ff78d1c0db'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:26:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:26:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:30 user nova-compute[72773]: INFO os_vif [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:cc:48,bridge_name='br-int',has_traffic_filtering=True,id=6e021e1c-b583-4ddf-ad9a-f215484ff208,network=Network(a399052b-0f9b-4c24-a176-7b59221e92a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e021e1c-b5')
Aug 16 22:26:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:26:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] No VIF found with MAC fa:16:3e:48:cc:48, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:26:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:32 user nova-compute[72773]: DEBUG nova.compute.manager [req-377700a7-08bf-4f52-a7aa-5d394b600b88 req-06747110-8751-4b94-871b-e111b5b16559 service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Received event network-vif-plugged-6e021e1c-b583-4ddf-ad9a-f215484ff208 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:26:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-377700a7-08bf-4f52-a7aa-5d394b600b88 req-06747110-8751-4b94-871b-e111b5b16559 service nova] Acquiring lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:26:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-377700a7-08bf-4f52-a7aa-5d394b600b88 req-06747110-8751-4b94-871b-e111b5b16559 service nova] Lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:26:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-377700a7-08bf-4f52-a7aa-5d394b600b88 req-06747110-8751-4b94-871b-e111b5b16559 service nova] Lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:26:32 user nova-compute[72773]: DEBUG nova.compute.manager [req-377700a7-08bf-4f52-a7aa-5d394b600b88 req-06747110-8751-4b94-871b-e111b5b16559 service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] No waiting events found dispatching network-vif-plugged-6e021e1c-b583-4ddf-ad9a-f215484ff208 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:26:32 user nova-compute[72773]: WARNING nova.compute.manager [req-377700a7-08bf-4f52-a7aa-5d394b600b88 req-06747110-8751-4b94-871b-e111b5b16559 service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Received unexpected event network-vif-plugged-6e021e1c-b583-4ddf-ad9a-f215484ff208 for instance with vm_state building and task_state spawning.
Aug 16 22:26:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:34 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224794.333524, 2c1c948f-c541-41ea-ba51-23ff78d1c0db => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:26:34 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] VM Resumed (Lifecycle Event)
Aug 16 22:26:34 user nova-compute[72773]: DEBUG nova.compute.manager [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:26:34 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:26:34 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Instance spawned successfully.
Aug 16 22:26:34 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:26:34 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:26:34 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:26:34 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:26:34 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:26:34 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:26:34 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:26:34 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:26:34 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:26:34 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:26:34 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224794.3351495, 2c1c948f-c541-41ea-ba51-23ff78d1c0db => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:26:34 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] VM Started (Lifecycle Event)
Aug 16 22:26:34 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:26:34 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:26:34 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:26:34 user nova-compute[72773]: INFO nova.compute.manager [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Took 5.14 seconds to spawn the instance on the hypervisor.
Aug 16 22:26:34 user nova-compute[72773]: DEBUG nova.compute.manager [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:26:34 user nova-compute[72773]: INFO nova.compute.manager [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Took 25.69 seconds to build instance.
Aug 16 22:26:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d17dca59-6792-4df9-a674-6b7e2fdb61c2 tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.816s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:26:34 user nova-compute[72773]: DEBUG nova.compute.manager [req-3808726b-f521-4ee7-ab17-93cf86df4cc5 req-f2583a8c-c29d-4084-97ee-37a83695327b service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Received event network-vif-plugged-6e021e1c-b583-4ddf-ad9a-f215484ff208 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:26:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3808726b-f521-4ee7-ab17-93cf86df4cc5 req-f2583a8c-c29d-4084-97ee-37a83695327b service nova] Acquiring lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:26:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3808726b-f521-4ee7-ab17-93cf86df4cc5 req-f2583a8c-c29d-4084-97ee-37a83695327b service nova] Lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:26:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3808726b-f521-4ee7-ab17-93cf86df4cc5 req-f2583a8c-c29d-4084-97ee-37a83695327b service nova] Lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:26:34 user nova-compute[72773]: DEBUG nova.compute.manager [req-3808726b-f521-4ee7-ab17-93cf86df4cc5 req-f2583a8c-c29d-4084-97ee-37a83695327b service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] No waiting events found dispatching network-vif-plugged-6e021e1c-b583-4ddf-ad9a-f215484ff208 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:26:34 user nova-compute[72773]: WARNING nova.compute.manager [req-3808726b-f521-4ee7-ab17-93cf86df4cc5 req-f2583a8c-c29d-4084-97ee-37a83695327b service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Received unexpected event network-vif-plugged-6e021e1c-b583-4ddf-ad9a-f215484ff208 for instance with vm_state active and task_state None.
Aug 16 22:26:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:40 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:26:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:26:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:41 user nova-compute[72773]: DEBUG nova.compute.manager [None req-f3108e1f-4f77-48a9-8b13-8d7481ebb3d3 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:26:41 user nova-compute[72773]: INFO nova.compute.manager [None req-f3108e1f-4f77-48a9-8b13-8d7481ebb3d3 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] instance snapshotting
Aug 16 22:26:41 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-f3108e1f-4f77-48a9-8b13-8d7481ebb3d3 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Beginning live snapshot process
Aug 16 22:26:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-f3108e1f-4f77-48a9-8b13-8d7481ebb3d3 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json -f qcow2 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-f3108e1f-4f77-48a9-8b13-8d7481ebb3d3 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json -f qcow2" returned: 0 in 0.195s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-f3108e1f-4f77-48a9-8b13-8d7481ebb3d3 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json -f qcow2 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:42 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:26:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-f3108e1f-4f77-48a9-8b13-8d7481ebb3d3 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json -f qcow2" returned: 0 in 0.196s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-f3108e1f-4f77-48a9-8b13-8d7481ebb3d3 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-f3108e1f-4f77-48a9-8b13-8d7481ebb3d3 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.232s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-f3108e1f-4f77-48a9-8b13-8d7481ebb3d3 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpc15g_x5c/e7bff5bbd4214975becabf4c556a016e.delta 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-f3108e1f-4f77-48a9-8b13-8d7481ebb3d3 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpc15g_x5c/e7bff5bbd4214975becabf4c556a016e.delta 1073741824" returned: 0 in 0.050s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:42 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-f3108e1f-4f77-48a9-8b13-8d7481ebb3d3 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 22:26:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-f3108e1f-4f77-48a9-8b13-8d7481ebb3d3 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72773) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 16 22:26:42 user nova-compute[72773]: INFO nova.virt.libvirt.host [None req-f3108e1f-4f77-48a9-8b13-8d7481ebb3d3 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] UEFI support detected
Aug 16 22:26:43 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:26:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-f3108e1f-4f77-48a9-8b13-8d7481ebb3d3 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72773) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 22:26:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-f3108e1f-4f77-48a9-8b13-8d7481ebb3d3 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72773) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 22:26:43 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-f3108e1f-4f77-48a9-8b13-8d7481ebb3d3 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 22:26:44 user nova-compute[72773]: DEBUG nova.privsep.utils [None req-f3108e1f-4f77-48a9-8b13-8d7481ebb3d3 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72773) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 22:26:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-f3108e1f-4f77-48a9-8b13-8d7481ebb3d3 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpc15g_x5c/e7bff5bbd4214975becabf4c556a016e.delta /opt/stack/data/nova/instances/snapshots/tmpc15g_x5c/e7bff5bbd4214975becabf4c556a016e {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-f3108e1f-4f77-48a9-8b13-8d7481ebb3d3 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpc15g_x5c/e7bff5bbd4214975becabf4c556a016e.delta /opt/stack/data/nova/instances/snapshots/tmpc15g_x5c/e7bff5bbd4214975becabf4c556a016e" returned: 0 in 0.269s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:44 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-f3108e1f-4f77-48a9-8b13-8d7481ebb3d3 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Snapshot extracted, beginning image upload
Aug 16 22:26:44 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:26:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Acquiring lock "df2acdf5-7c83-4129-8cab-da9882e1ac69" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:26:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:26:44 user nova-compute[72773]: DEBUG nova.compute.manager [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:26:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:26:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:26:44 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:26:44 user nova-compute[72773]: INFO nova.compute.claims [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Claim successful on node user
Aug 16 22:26:45 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:26:45 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:26:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:26:45 user nova-compute[72773]: DEBUG nova.compute.manager [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:26:45 user nova-compute[72773]: DEBUG nova.compute.manager [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:26:45 user nova-compute[72773]: DEBUG nova.network.neutron [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:26:45 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:26:45 user nova-compute[72773]: DEBUG nova.compute.manager [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:26:45 user nova-compute[72773]: INFO nova.virt.block_device [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Booting with volume ffd4a5d3-43a9-42f6-9e81-78036352413d at /dev/vda
Aug 16 22:26:45 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:26:45 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:26:45 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:26:45 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:26:45 user nova-compute[72773]: DEBUG nova.policy [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '270300fb94e04ed5823a0eeab40a4703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a1fa6998aa4972a3335aa78398e667', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:26:45 user nova-compute[72773]: DEBUG os_brick.utils [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:26:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2cbefe-c863-4cbd-8d61-79c38d8e2040]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.037s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b9a037-54e3-4115-8ebe-6b82b46fc482]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6294bccf-f050-4529-a557-3f385553edbf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1d8555-e231-43b7-897a-fc42ee0e1c46]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:26:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-02235c77-0c2a-4317-8526-7bd5096694a2" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:26:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-02235c77-0c2a-4317-8526-7bd5096694a2" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:26:45 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 22:26:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:26:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:26:45 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:26:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb912fc-0ab9-4e1c-b59d-35595a6c24fd]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:26:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:26:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:26:45 user nova-compute[72773]: DEBUG os_brick.utils [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:26:45 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Updating existing volume attachment record: cb55340f-f261-4f4e-9b2b-8b18525d48ad {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:26:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:46 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Updating instance_info_cache with network_info: [{"id": "f3bb17a2-593d-46be-92bc-9b4b64a48174", "address": "fa:16:3e:66:2d:a9", "network": {"id": "932581fe-de5a-42af-8214-9fc20f8e3038", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-982938001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4509d81443b499a8379f558bfad9338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bb17a2-59", "ovs_interfaceid": "f3bb17a2-593d-46be-92bc-9b4b64a48174", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:26:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-02235c77-0c2a-4317-8526-7bd5096694a2" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:26:46 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 22:26:46 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:26:46 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:26:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:26:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:26:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:26:46 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:26:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02235c77-0c2a-4317-8526-7bd5096694a2/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:46 user nova-compute[72773]: DEBUG nova.network.neutron [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Successfully created port: a2f04ed7-213b-4297-a13d-ad99a922f878 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:26:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02235c77-0c2a-4317-8526-7bd5096694a2/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02235c77-0c2a-4317-8526-7bd5096694a2/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02235c77-0c2a-4317-8526-7bd5096694a2/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbfa3908-7c4c-4c7d-a04f-672a8c52ca89/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:47 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-f3108e1f-4f77-48a9-8b13-8d7481ebb3d3 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Snapshot image upload complete
Aug 16 22:26:47 user nova-compute[72773]: INFO nova.compute.manager [None req-f3108e1f-4f77-48a9-8b13-8d7481ebb3d3 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Took 5.78 seconds to snapshot the instance on the hypervisor.
Aug 16 22:26:47 user nova-compute[72773]: DEBUG nova.network.neutron [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Successfully created port: 69942063-04a7-4cd3-87dd-42952e5fc667 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:26:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbfa3908-7c4c-4c7d-a04f-672a8c52ca89/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbfa3908-7c4c-4c7d-a04f-672a8c52ca89/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbfa3908-7c4c-4c7d-a04f-672a8c52ca89/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbb196d-e352-47a5-86fb-a819723c2ce8/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbb196d-e352-47a5-86fb-a819723c2ce8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbb196d-e352-47a5-86fb-a819723c2ce8/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbb196d-e352-47a5-86fb-a819723c2ce8/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:48 user nova-compute[72773]: DEBUG nova.network.neutron [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Successfully created port: 38eab1de-142b-4f98-a91e-bea564b65757 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:26:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:49 user nova-compute[72773]: DEBUG nova.network.neutron [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Successfully created port: f77f6c81-0377-4531-8c95-07be0a197bcc {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:26:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4387131d-7a86-477a-a231-69713b2d965d/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Acquiring lock "02235c77-0c2a-4317-8526-7bd5096694a2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:26:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Lock "02235c77-0c2a-4317-8526-7bd5096694a2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:26:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4387131d-7a86-477a-a231-69713b2d965d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4387131d-7a86-477a-a231-69713b2d965d/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:50 user nova-compute[72773]: DEBUG nova.objects.instance [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Lazy-loading 'flavor' on Instance uuid 02235c77-0c2a-4317-8526-7bd5096694a2 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:26:50 user nova-compute[72773]: DEBUG nova.network.neutron [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Successfully created port: 4b07374e-822f-4550-bcf1-c0259ca3624b {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:26:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Lock "02235c77-0c2a-4317-8526-7bd5096694a2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.132s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:26:50 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4387131d-7a86-477a-a231-69713b2d965d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:50 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa4cbd72-a11c-4dab-b2e2-29fe10493931/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:50 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa4cbd72-a11c-4dab-b2e2-29fe10493931/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:50 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa4cbd72-a11c-4dab-b2e2-29fe10493931/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:50 user nova-compute[72773]: DEBUG nova.compute.manager [req-12a4eb93-8083-4ddd-a7a8-60b58543534b req-5bba50ca-9bc6-4731-9b24-11c29477c1d9 service nova] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Received event network-changed-94d9c8c3-7857-42d7-8e92-2b983bdd3dc6 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:26:50 user nova-compute[72773]: DEBUG nova.compute.manager [req-12a4eb93-8083-4ddd-a7a8-60b58543534b req-5bba50ca-9bc6-4731-9b24-11c29477c1d9 service nova] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Refreshing instance network info cache due to event network-changed-94d9c8c3-7857-42d7-8e92-2b983bdd3dc6. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:26:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-12a4eb93-8083-4ddd-a7a8-60b58543534b req-5bba50ca-9bc6-4731-9b24-11c29477c1d9 service nova] Acquiring lock "refresh_cache-4efab321-f2aa-456c-a1ae-b32f399f694d" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:26:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-12a4eb93-8083-4ddd-a7a8-60b58543534b req-5bba50ca-9bc6-4731-9b24-11c29477c1d9 service nova] Acquired lock "refresh_cache-4efab321-f2aa-456c-a1ae-b32f399f694d" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:26:50 user nova-compute[72773]: DEBUG nova.network.neutron [req-12a4eb93-8083-4ddd-a7a8-60b58543534b req-5bba50ca-9bc6-4731-9b24-11c29477c1d9 service nova] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Refreshing network info cache for port 94d9c8c3-7857-42d7-8e92-2b983bdd3dc6 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:26:50 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa4cbd72-a11c-4dab-b2e2-29fe10493931/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:50 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG nova.network.neutron [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Successfully updated port: a2f04ed7-213b-4297-a13d-ad99a922f878 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG nova.compute.manager [req-5750dd47-1e4f-4f3e-a259-0c29b71638e3 req-d506c0d5-7918-4b52-beb0-46ec9774cb5c service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-changed-a2f04ed7-213b-4297-a13d-ad99a922f878 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG nova.compute.manager [req-5750dd47-1e4f-4f3e-a259-0c29b71638e3 req-d506c0d5-7918-4b52-beb0-46ec9774cb5c service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Refreshing instance network info cache due to event network-changed-a2f04ed7-213b-4297-a13d-ad99a922f878. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5750dd47-1e4f-4f3e-a259-0c29b71638e3 req-d506c0d5-7918-4b52-beb0-46ec9774cb5c service nova] Acquiring lock "refresh_cache-df2acdf5-7c83-4129-8cab-da9882e1ac69" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5750dd47-1e4f-4f3e-a259-0c29b71638e3 req-d506c0d5-7918-4b52-beb0-46ec9774cb5c service nova] Acquired lock "refresh_cache-df2acdf5-7c83-4129-8cab-da9882e1ac69" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG nova.network.neutron [req-5750dd47-1e4f-4f3e-a259-0c29b71638e3 req-d506c0d5-7918-4b52-beb0-46ec9774cb5c service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Refreshing network info cache for port a2f04ed7-213b-4297-a13d-ad99a922f878 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Acquiring lock "02235c77-0c2a-4317-8526-7bd5096694a2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Lock "02235c77-0c2a-4317-8526-7bd5096694a2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:26:51 user nova-compute[72773]: INFO nova.compute.manager [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Attaching volume afb3788f-0124-4356-8111-1af7c73788d0 to /dev/vdb
Aug 16 22:26:51 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:26:51 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:26:51 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=6926MB free_disk=25.831783294677734GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG os_brick.utils [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0efb618-61c6-4fd5-b3b3-38127f9e4bef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[13139d98-b3a3-41a4-afbe-7119eab82b68]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 956d334e-f190-4625-b144-ab44d2f3321a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 02235c77-0c2a-4317-8526-7bd5096694a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 4efab321-f2aa-456c-a1ae-b32f399f694d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 02227d9f-5ddf-42fe-91a8-ce56d76aa274 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 4387131d-7a86-477a-a231-69713b2d965d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance c6adfa95-47ac-40d3-abc1-0c6027507f07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance aa4cbd72-a11c-4dab-b2e2-29fe10493931 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 8bbb196d-e352-47a5-86fb-a819723c2ce8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 2c1c948f-c541-41ea-ba51-23ff78d1c0db actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance dbfa3908-7c4c-4c7d-a04f-672a8c52ca89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance df2acdf5-7c83-4129-8cab-da9882e1ac69 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG nova.network.neutron [req-5750dd47-1e4f-4f3e-a259-0c29b71638e3 req-d506c0d5-7918-4b52-beb0-46ec9774cb5c service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[052915d0-e797-4fee-821c-2328983caeec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a240891a-4a88-4fc2-960a-dc0e040a7d4d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:26:51 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:26:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c4fe2e-96f9-4e42-8cfe-140ee4876422]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG os_brick.utils [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Updating existing volume attachment record: 7d1800cf-a1f7-4653-80f2-381f354536ab {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.604s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG nova.network.neutron [req-5750dd47-1e4f-4f3e-a259-0c29b71638e3 req-d506c0d5-7918-4b52-beb0-46ec9774cb5c service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:26:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5750dd47-1e4f-4f3e-a259-0c29b71638e3 req-d506c0d5-7918-4b52-beb0-46ec9774cb5c service nova] Releasing lock "refresh_cache-df2acdf5-7c83-4129-8cab-da9882e1ac69" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:26:52 user nova-compute[72773]: DEBUG nova.network.neutron [req-12a4eb93-8083-4ddd-a7a8-60b58543534b req-5bba50ca-9bc6-4731-9b24-11c29477c1d9 service nova] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Updated VIF entry in instance network info cache for port 94d9c8c3-7857-42d7-8e92-2b983bdd3dc6. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:26:52 user nova-compute[72773]: DEBUG nova.network.neutron [req-12a4eb93-8083-4ddd-a7a8-60b58543534b req-5bba50ca-9bc6-4731-9b24-11c29477c1d9 service nova] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Updating instance_info_cache with network_info: [{"id": "94d9c8c3-7857-42d7-8e92-2b983bdd3dc6", "address": "fa:16:3e:05:f5:f1", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d9c8c3-78", "ovs_interfaceid": "94d9c8c3-7857-42d7-8e92-2b983bdd3dc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:26:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-12a4eb93-8083-4ddd-a7a8-60b58543534b req-5bba50ca-9bc6-4731-9b24-11c29477c1d9 service nova] Releasing lock "refresh_cache-4efab321-f2aa-456c-a1ae-b32f399f694d" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:26:52 user nova-compute[72773]: DEBUG nova.network.neutron [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Successfully updated port: 213a2da6-430b-4976-b5f0-a18d8494f42c {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:26:52 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:26:53 user nova-compute[72773]: DEBUG nova.compute.manager [req-e8b41abe-fa10-4f87-9c79-a8057d2dd0c7 req-c12d9b6e-2071-4668-8990-f206fcafb787 service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Received event network-changed-26ca6ee6-83b5-4553-b31c-d1b135b219e9 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:26:53 user nova-compute[72773]: DEBUG nova.compute.manager [req-e8b41abe-fa10-4f87-9c79-a8057d2dd0c7 req-c12d9b6e-2071-4668-8990-f206fcafb787 service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Refreshing instance network info cache due to event network-changed-26ca6ee6-83b5-4553-b31c-d1b135b219e9. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:26:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e8b41abe-fa10-4f87-9c79-a8057d2dd0c7 req-c12d9b6e-2071-4668-8990-f206fcafb787 service nova] Acquiring lock "refresh_cache-02227d9f-5ddf-42fe-91a8-ce56d76aa274" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:26:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e8b41abe-fa10-4f87-9c79-a8057d2dd0c7 req-c12d9b6e-2071-4668-8990-f206fcafb787 service nova] Acquired lock "refresh_cache-02227d9f-5ddf-42fe-91a8-ce56d76aa274" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:26:53 user nova-compute[72773]: DEBUG nova.network.neutron [req-e8b41abe-fa10-4f87-9c79-a8057d2dd0c7 req-c12d9b6e-2071-4668-8990-f206fcafb787 service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Refreshing network info cache for port 26ca6ee6-83b5-4553-b31c-d1b135b219e9 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:26:53 user nova-compute[72773]: DEBUG nova.compute.manager [req-baaa21f2-bc71-420d-a46d-cf28516193fd req-183f3620-f4f1-4c6f-a964-8f428593cc88 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-changed-213a2da6-430b-4976-b5f0-a18d8494f42c {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:26:53 user nova-compute[72773]: DEBUG nova.compute.manager [req-baaa21f2-bc71-420d-a46d-cf28516193fd req-183f3620-f4f1-4c6f-a964-8f428593cc88 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Refreshing instance network info cache due to event network-changed-213a2da6-430b-4976-b5f0-a18d8494f42c. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:26:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-baaa21f2-bc71-420d-a46d-cf28516193fd req-183f3620-f4f1-4c6f-a964-8f428593cc88 service nova] Acquiring lock "refresh_cache-df2acdf5-7c83-4129-8cab-da9882e1ac69" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:26:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-baaa21f2-bc71-420d-a46d-cf28516193fd req-183f3620-f4f1-4c6f-a964-8f428593cc88 service nova] Acquired lock "refresh_cache-df2acdf5-7c83-4129-8cab-da9882e1ac69" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:26:53 user nova-compute[72773]: DEBUG nova.network.neutron [req-baaa21f2-bc71-420d-a46d-cf28516193fd req-183f3620-f4f1-4c6f-a964-8f428593cc88 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Refreshing network info cache for port 213a2da6-430b-4976-b5f0-a18d8494f42c {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:26:53 user nova-compute[72773]: DEBUG nova.network.neutron [req-baaa21f2-bc71-420d-a46d-cf28516193fd req-183f3620-f4f1-4c6f-a964-8f428593cc88 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:26:53 user nova-compute[72773]: DEBUG nova.network.neutron [req-baaa21f2-bc71-420d-a46d-cf28516193fd req-183f3620-f4f1-4c6f-a964-8f428593cc88 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:26:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-baaa21f2-bc71-420d-a46d-cf28516193fd req-183f3620-f4f1-4c6f-a964-8f428593cc88 service nova] Releasing lock "refresh_cache-df2acdf5-7c83-4129-8cab-da9882e1ac69" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:26:53 user nova-compute[72773]: DEBUG nova.network.neutron [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Successfully updated port: c27765c1-ae78-4b0b-8abf-2514be5599a4 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:26:53 user nova-compute[72773]: DEBUG nova.network.neutron [req-e8b41abe-fa10-4f87-9c79-a8057d2dd0c7 req-c12d9b6e-2071-4668-8990-f206fcafb787 service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Updated VIF entry in instance network info cache for port 26ca6ee6-83b5-4553-b31c-d1b135b219e9. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:26:53 user nova-compute[72773]: DEBUG nova.network.neutron [req-e8b41abe-fa10-4f87-9c79-a8057d2dd0c7 req-c12d9b6e-2071-4668-8990-f206fcafb787 service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Updating instance_info_cache with network_info: [{"id": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "address": "fa:16:3e:4a:54:e0", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ca6ee6-83", "ovs_interfaceid": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:26:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e8b41abe-fa10-4f87-9c79-a8057d2dd0c7 req-c12d9b6e-2071-4668-8990-f206fcafb787 service nova] Releasing lock "refresh_cache-02227d9f-5ddf-42fe-91a8-ce56d76aa274" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:26:54 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:54 user nova-compute[72773]: DEBUG nova.network.neutron [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Successfully updated port: 69942063-04a7-4cd3-87dd-42952e5fc667 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:26:55 user nova-compute[72773]: DEBUG nova.compute.manager [req-355de4ac-9460-47a6-94fb-e1749cd32be3 req-74a2c0de-d271-46bd-8fc5-ea4dba9c5763 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-changed-c27765c1-ae78-4b0b-8abf-2514be5599a4 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:26:55 user nova-compute[72773]: DEBUG nova.compute.manager [req-355de4ac-9460-47a6-94fb-e1749cd32be3 req-74a2c0de-d271-46bd-8fc5-ea4dba9c5763 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Refreshing instance network info cache due to event network-changed-c27765c1-ae78-4b0b-8abf-2514be5599a4. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:26:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-355de4ac-9460-47a6-94fb-e1749cd32be3 req-74a2c0de-d271-46bd-8fc5-ea4dba9c5763 service nova] Acquiring lock "refresh_cache-df2acdf5-7c83-4129-8cab-da9882e1ac69" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:26:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-355de4ac-9460-47a6-94fb-e1749cd32be3 req-74a2c0de-d271-46bd-8fc5-ea4dba9c5763 service nova] Acquired lock "refresh_cache-df2acdf5-7c83-4129-8cab-da9882e1ac69" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:26:55 user nova-compute[72773]: DEBUG nova.network.neutron [req-355de4ac-9460-47a6-94fb-e1749cd32be3 req-74a2c0de-d271-46bd-8fc5-ea4dba9c5763 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Refreshing network info cache for port c27765c1-ae78-4b0b-8abf-2514be5599a4 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:26:55 user nova-compute[72773]: DEBUG nova.network.neutron [req-355de4ac-9460-47a6-94fb-e1749cd32be3 req-74a2c0de-d271-46bd-8fc5-ea4dba9c5763 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:26:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "4efab321-f2aa-456c-a1ae-b32f399f694d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:26:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "4efab321-f2aa-456c-a1ae-b32f399f694d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:26:55 user nova-compute[72773]: DEBUG nova.objects.instance [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lazy-loading 'flavor' on Instance uuid 4efab321-f2aa-456c-a1ae-b32f399f694d {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:26:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "4efab321-f2aa-456c-a1ae-b32f399f694d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:26:55 user nova-compute[72773]: DEBUG nova.network.neutron [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Successfully updated port: 38eab1de-142b-4f98-a91e-bea564b65757 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:26:55 user nova-compute[72773]: DEBUG nova.network.neutron [req-355de4ac-9460-47a6-94fb-e1749cd32be3 req-74a2c0de-d271-46bd-8fc5-ea4dba9c5763 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:26:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-355de4ac-9460-47a6-94fb-e1749cd32be3 req-74a2c0de-d271-46bd-8fc5-ea4dba9c5763 service nova] Releasing lock "refresh_cache-df2acdf5-7c83-4129-8cab-da9882e1ac69" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:26:55 user nova-compute[72773]: DEBUG nova.compute.manager [req-355de4ac-9460-47a6-94fb-e1749cd32be3 req-74a2c0de-d271-46bd-8fc5-ea4dba9c5763 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-changed-69942063-04a7-4cd3-87dd-42952e5fc667 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:26:55 user nova-compute[72773]: DEBUG nova.compute.manager [req-355de4ac-9460-47a6-94fb-e1749cd32be3 req-74a2c0de-d271-46bd-8fc5-ea4dba9c5763 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Refreshing instance network info cache due to event network-changed-69942063-04a7-4cd3-87dd-42952e5fc667. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:26:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-355de4ac-9460-47a6-94fb-e1749cd32be3 req-74a2c0de-d271-46bd-8fc5-ea4dba9c5763 service nova] Acquiring lock "refresh_cache-df2acdf5-7c83-4129-8cab-da9882e1ac69" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:26:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-355de4ac-9460-47a6-94fb-e1749cd32be3 req-74a2c0de-d271-46bd-8fc5-ea4dba9c5763 service nova] Acquired lock "refresh_cache-df2acdf5-7c83-4129-8cab-da9882e1ac69" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:26:55 user nova-compute[72773]: DEBUG nova.network.neutron [req-355de4ac-9460-47a6-94fb-e1749cd32be3 req-74a2c0de-d271-46bd-8fc5-ea4dba9c5763 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Refreshing network info cache for port 69942063-04a7-4cd3-87dd-42952e5fc667 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:26:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "4efab321-f2aa-456c-a1ae-b32f399f694d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:26:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "4efab321-f2aa-456c-a1ae-b32f399f694d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:26:55 user nova-compute[72773]: INFO nova.compute.manager [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Attaching volume c6852443-e1d9-4227-bfa5-a9179c28be11 to /dev/vdb
Aug 16 22:26:55 user nova-compute[72773]: DEBUG os_brick.utils [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:26:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:56 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79c7903-e396-437e-84ce-14273b6cfef1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:56 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc2c053-24f6-47c7-9301-4bfb420eeca4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:56 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab43375-5d5a-4463-846f-07a301cf7c61]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:56 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[19aae8b9-bd8a-4dfd-a1f4-7680388fc3d4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:26:56 user nova-compute[72773]: DEBUG nova.network.neutron [req-355de4ac-9460-47a6-94fb-e1749cd32be3 req-74a2c0de-d271-46bd-8fc5-ea4dba9c5763 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:26:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:26:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:26:56 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:26:56 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[702f44bc-1450-4817-9d89-96f25dcf0252]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:26:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:26:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:26:56 user nova-compute[72773]: DEBUG os_brick.utils [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:26:56 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Updating existing volume attachment record: c49371df-36c5-4fda-bf5c-9220cf8c3404 {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:26:56 user nova-compute[72773]: DEBUG nova.network.neutron [req-355de4ac-9460-47a6-94fb-e1749cd32be3 req-74a2c0de-d271-46bd-8fc5-ea4dba9c5763 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:26:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-355de4ac-9460-47a6-94fb-e1749cd32be3 req-74a2c0de-d271-46bd-8fc5-ea4dba9c5763 service nova] Releasing lock "refresh_cache-df2acdf5-7c83-4129-8cab-da9882e1ac69" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:26:57 user nova-compute[72773]: DEBUG nova.network.neutron [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Successfully updated port: f77f6c81-0377-4531-8c95-07be0a197bcc {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:26:57 user nova-compute[72773]: DEBUG nova.compute.manager [req-59615e79-0fd2-4dba-98eb-dcc7cf03bf27 req-f3091367-3381-4809-a96f-537322a372be service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-changed-38eab1de-142b-4f98-a91e-bea564b65757 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:26:57 user nova-compute[72773]: DEBUG nova.compute.manager [req-59615e79-0fd2-4dba-98eb-dcc7cf03bf27 req-f3091367-3381-4809-a96f-537322a372be service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Refreshing instance network info cache due to event network-changed-38eab1de-142b-4f98-a91e-bea564b65757. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:26:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-59615e79-0fd2-4dba-98eb-dcc7cf03bf27 req-f3091367-3381-4809-a96f-537322a372be service nova] Acquiring lock "refresh_cache-df2acdf5-7c83-4129-8cab-da9882e1ac69" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:26:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-59615e79-0fd2-4dba-98eb-dcc7cf03bf27 req-f3091367-3381-4809-a96f-537322a372be service nova] Acquired lock "refresh_cache-df2acdf5-7c83-4129-8cab-da9882e1ac69" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:26:57 user nova-compute[72773]: DEBUG nova.network.neutron [req-59615e79-0fd2-4dba-98eb-dcc7cf03bf27 req-f3091367-3381-4809-a96f-537322a372be service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Refreshing network info cache for port 38eab1de-142b-4f98-a91e-bea564b65757 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:26:57 user nova-compute[72773]: DEBUG nova.network.neutron [req-59615e79-0fd2-4dba-98eb-dcc7cf03bf27 req-f3091367-3381-4809-a96f-537322a372be service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:26:57 user nova-compute[72773]: DEBUG nova.network.neutron [req-59615e79-0fd2-4dba-98eb-dcc7cf03bf27 req-f3091367-3381-4809-a96f-537322a372be service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:26:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-59615e79-0fd2-4dba-98eb-dcc7cf03bf27 req-f3091367-3381-4809-a96f-537322a372be service nova] Releasing lock "refresh_cache-df2acdf5-7c83-4129-8cab-da9882e1ac69" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:26:57 user nova-compute[72773]: DEBUG nova.compute.manager [req-59615e79-0fd2-4dba-98eb-dcc7cf03bf27 req-f3091367-3381-4809-a96f-537322a372be service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-changed-f77f6c81-0377-4531-8c95-07be0a197bcc {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:26:57 user nova-compute[72773]: DEBUG nova.compute.manager [req-59615e79-0fd2-4dba-98eb-dcc7cf03bf27 req-f3091367-3381-4809-a96f-537322a372be service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Refreshing instance network info cache due to event network-changed-f77f6c81-0377-4531-8c95-07be0a197bcc. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:26:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-59615e79-0fd2-4dba-98eb-dcc7cf03bf27 req-f3091367-3381-4809-a96f-537322a372be service nova] Acquiring lock "refresh_cache-df2acdf5-7c83-4129-8cab-da9882e1ac69" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:26:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-59615e79-0fd2-4dba-98eb-dcc7cf03bf27 req-f3091367-3381-4809-a96f-537322a372be service nova] Acquired lock "refresh_cache-df2acdf5-7c83-4129-8cab-da9882e1ac69" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:26:57 user nova-compute[72773]: DEBUG nova.network.neutron [req-59615e79-0fd2-4dba-98eb-dcc7cf03bf27 req-f3091367-3381-4809-a96f-537322a372be service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Refreshing network info cache for port f77f6c81-0377-4531-8c95-07be0a197bcc {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:26:57 user nova-compute[72773]: DEBUG nova.network.neutron [req-59615e79-0fd2-4dba-98eb-dcc7cf03bf27 req-f3091367-3381-4809-a96f-537322a372be service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:26:57 user nova-compute[72773]: INFO nova.virt.block_device [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Booting with volume c8469fb8-1df6-4bb2-be19-7878c4d4cd9d at /dev/vdb
Aug 16 22:26:58 user nova-compute[72773]: DEBUG os_brick.utils [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:26:58 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:58 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:58 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c34be22-2c78-495c-876f-7e3300476b41]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:58 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:58 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:58 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1a4b96-b4f0-4992-9441-0178aed1dce3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:58 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:58 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:26:58 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c8c38e-e07d-48ac-98a0-52bbcc712407]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:58 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40ae809-462c-4cd4-9c6a-be3070badbe0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:58 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:58 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:26:58 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:26:58 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:26:58 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:26:58 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:26:58 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c174acac-5847-4324-9dd2-c41dfeef0b20]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:26:58 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:26:58 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:26:58 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:26:58 user nova-compute[72773]: DEBUG os_brick.utils [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:26:58 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Updating existing volume attachment record: 14155e5c-c398-4881-a448-e1e70cda8a04 {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:26:58 user nova-compute[72773]: DEBUG nova.network.neutron [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Successfully updated port: 4b07374e-822f-4550-bcf1-c0259ca3624b {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:26:58 user nova-compute[72773]: DEBUG nova.network.neutron [req-59615e79-0fd2-4dba-98eb-dcc7cf03bf27 req-f3091367-3381-4809-a96f-537322a372be service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:26:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-59615e79-0fd2-4dba-98eb-dcc7cf03bf27 req-f3091367-3381-4809-a96f-537322a372be service nova] Releasing lock "refresh_cache-df2acdf5-7c83-4129-8cab-da9882e1ac69" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:26:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Acquiring lock "refresh_cache-df2acdf5-7c83-4129-8cab-da9882e1ac69" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:26:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Acquired lock "refresh_cache-df2acdf5-7c83-4129-8cab-da9882e1ac69" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:26:58 user nova-compute[72773]: DEBUG nova.network.neutron [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:26:58 user nova-compute[72773]: DEBUG nova.network.neutron [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:26:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-98b50614-7fe8-48a8-889f-6956372c80c0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:26:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-98b50614-7fe8-48a8-889f-6956372c80c0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:26:59 user nova-compute[72773]: INFO nova.compute.manager [None req-98b50614-7fe8-48a8-889f-6956372c80c0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Shelving
Aug 16 22:26:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:59 user nova-compute[72773]: DEBUG nova.compute.manager [req-df2d4cbe-1df6-4d9e-b85d-5e4512c07a5c req-8879662e-2bb2-4e8b-a7d3-406a96cb7a22 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-changed-4b07374e-822f-4550-bcf1-c0259ca3624b {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:26:59 user nova-compute[72773]: DEBUG nova.compute.manager [req-df2d4cbe-1df6-4d9e-b85d-5e4512c07a5c req-8879662e-2bb2-4e8b-a7d3-406a96cb7a22 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Refreshing instance network info cache due to event network-changed-4b07374e-822f-4550-bcf1-c0259ca3624b. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:26:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-df2d4cbe-1df6-4d9e-b85d-5e4512c07a5c req-8879662e-2bb2-4e8b-a7d3-406a96cb7a22 service nova] Acquiring lock "refresh_cache-df2acdf5-7c83-4129-8cab-da9882e1ac69" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:26:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:26:59 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Instance destroyed successfully.
Aug 16 22:26:59 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-98b50614-7fe8-48a8-889f-6956372c80c0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Beginning cold snapshot process
Aug 16 22:26:59 user nova-compute[72773]: DEBUG nova.privsep.utils [None req-98b50614-7fe8-48a8-889f-6956372c80c0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72773) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 22:26:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-98b50614-7fe8-48a8-889f-6956372c80c0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk /opt/stack/data/nova/instances/snapshots/tmp1b0oai_d/a58a496c8b9f40c2990df46c7a649cd8 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-98b50614-7fe8-48a8-889f-6956372c80c0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk /opt/stack/data/nova/instances/snapshots/tmp1b0oai_d/a58a496c8b9f40c2990df46c7a649cd8" returned: 0 in 0.712s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:00 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-98b50614-7fe8-48a8-889f-6956372c80c0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Snapshot extracted, beginning image upload
Aug 16 22:27:01 user nova-compute[72773]: DEBUG nova.network.neutron [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Updating instance_info_cache with network_info: [{"id": "a2f04ed7-213b-4297-a13d-ad99a922f878", "address": "fa:16:3e:ee:62:f5", "network": {"id": "78850332-7129-48d4-ad0f-222c6981d934", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-817612380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f04ed7-21", "ovs_interfaceid": "a2f04ed7-213b-4297-a13d-ad99a922f878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "213a2da6-430b-4976-b5f0-a18d8494f42c", "address": "fa:16:3e:62:39:b6", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213a2da6-43", "ovs_interfaceid": "213a2da6-430b-4976-b5f0-a18d8494f42c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c27765c1-ae78-4b0b-8abf-2514be5599a4", "address": "fa:16:3e:12:84:13", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc27765c1-ae", "ovs_interfaceid": "c27765c1-ae78-4b0b-8abf-2514be5599a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "69942063-04a7-4cd3-87dd-42952e5fc667", "address": "fa:16:3e:8c:1b:60", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69942063-04", "ovs_interfaceid": "69942063-04a7-4cd3-87dd-42952e5fc667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38eab1de-142b-4f98-a91e-bea564b65757", "address": "fa:16:3e:a8:88:1c", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38eab1de-14", "ovs_interfaceid": "38eab1de-142b-4f98-a91e-bea564b65757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f77f6c81-0377-4531-8c95-07be0a197bcc", "address": "fa:16:3e:f0:3c:4a", "network": {"id": "9e71d1ff-9a5b-4a29-ad7e-6b4da698415d", "bridge": "br-int", "label": "tempest-device-tagging-net2-584203226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f6c81-03", "ovs_interfaceid": "f77f6c81-0377-4531-8c95-07be0a197bcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b07374e-822f-4550-bcf1-c0259ca3624b", "address": "fa:16:3e:5f:15:a3", "network": {"id": "9e71d1ff-9a5b-4a29-ad7e-6b4da698415d", "bridge": "br-int", "label": "tempest-device-tagging-net2-584203226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b07374e-82", "ovs_interfaceid": "4b07374e-822f-4550-bcf1-c0259ca3624b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:27:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Releasing lock "refresh_cache-df2acdf5-7c83-4129-8cab-da9882e1ac69" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:27:01 user nova-compute[72773]: DEBUG nova.compute.manager [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Instance network_info: |[{"id": "a2f04ed7-213b-4297-a13d-ad99a922f878", "address": "fa:16:3e:ee:62:f5", "network": {"id": "78850332-7129-48d4-ad0f-222c6981d934", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-817612380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f04ed7-21", "ovs_interfaceid": "a2f04ed7-213b-4297-a13d-ad99a922f878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "213a2da6-430b-4976-b5f0-a18d8494f42c", "address": "fa:16:3e:62:39:b6", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213a2da6-43", "ovs_interfaceid": "213a2da6-430b-4976-b5f0-a18d8494f42c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c27765c1-ae78-4b0b-8abf-2514be5599a4", "address": "fa:16:3e:12:84:13", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc27765c1-ae", "ovs_interfaceid": "c27765c1-ae78-4b0b-8abf-2514be5599a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "69942063-04a7-4cd3-87dd-42952e5fc667", "address": "fa:16:3e:8c:1b:60", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69942063-04", "ovs_interfaceid": "69942063-04a7-4cd3-87dd-42952e5fc667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38eab1de-142b-4f98-a91e-bea564b65757", "address": "fa:16:3e:a8:88:1c", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38eab1de-14", "ovs_interfaceid": "38eab1de-142b-4f98-a91e-bea564b65757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f77f6c81-0377-4531-8c95-07be0a197bcc", "address": "fa:16:3e:f0:3c:4a", "network": {"id": "9e71d1ff-9a5b-4a29-ad7e-6b4da698415d", "bridge": "br-int", "label": "tempest-device-tagging-net2-584203226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f6c81-03", "ovs_interfaceid": "f77f6c81-0377-4531-8c95-07be0a197bcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b07374e-822f-4550-bcf1-c0259ca3624b", "address": "fa:16:3e:5f:15:a3", "network": {"id": "9e71d1ff-9a5b-4a29-ad7e-6b4da698415d", "bridge": "br-int", "label": "tempest-device-tagging-net2-584203226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b07374e-82", "ovs_interfaceid": "4b07374e-822f-4550-bcf1-c0259ca3624b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:27:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-df2d4cbe-1df6-4d9e-b85d-5e4512c07a5c req-8879662e-2bb2-4e8b-a7d3-406a96cb7a22 service nova] Acquired lock "refresh_cache-df2acdf5-7c83-4129-8cab-da9882e1ac69" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:27:01 user nova-compute[72773]: DEBUG nova.network.neutron [req-df2d4cbe-1df6-4d9e-b85d-5e4512c07a5c req-8879662e-2bb2-4e8b-a7d3-406a96cb7a22 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Refreshing network info cache for port 4b07374e-822f-4550-bcf1-c0259ca3624b {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:27:01 user nova-compute[72773]: DEBUG nova.compute.manager [req-bd7cbda7-0256-46f9-8a41-e7ce570360f1 req-64323fb4-1f39-4041-99c5-00a0db5e9cf9 service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Received event network-vif-unplugged-26ca6ee6-83b5-4553-b31c-d1b135b219e9 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:27:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-bd7cbda7-0256-46f9-8a41-e7ce570360f1 req-64323fb4-1f39-4041-99c5-00a0db5e9cf9 service nova] Acquiring lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-bd7cbda7-0256-46f9-8a41-e7ce570360f1 req-64323fb4-1f39-4041-99c5-00a0db5e9cf9 service nova] Lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-bd7cbda7-0256-46f9-8a41-e7ce570360f1 req-64323fb4-1f39-4041-99c5-00a0db5e9cf9 service nova] Lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:01 user nova-compute[72773]: DEBUG nova.compute.manager [req-bd7cbda7-0256-46f9-8a41-e7ce570360f1 req-64323fb4-1f39-4041-99c5-00a0db5e9cf9 service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] No waiting events found dispatching network-vif-unplugged-26ca6ee6-83b5-4553-b31c-d1b135b219e9 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:27:01 user nova-compute[72773]: WARNING nova.compute.manager [req-bd7cbda7-0256-46f9-8a41-e7ce570360f1 req-64323fb4-1f39-4041-99c5-00a0db5e9cf9 service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Received unexpected event network-vif-unplugged-26ca6ee6-83b5-4553-b31c-d1b135b219e9 for instance with vm_state active and task_state shelving_image_uploading.
Aug 16 22:27:01 user nova-compute[72773]: DEBUG nova.compute.manager [req-bd7cbda7-0256-46f9-8a41-e7ce570360f1 req-64323fb4-1f39-4041-99c5-00a0db5e9cf9 service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Received event network-vif-plugged-26ca6ee6-83b5-4553-b31c-d1b135b219e9 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:27:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-bd7cbda7-0256-46f9-8a41-e7ce570360f1 req-64323fb4-1f39-4041-99c5-00a0db5e9cf9 service nova] Acquiring lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-bd7cbda7-0256-46f9-8a41-e7ce570360f1 req-64323fb4-1f39-4041-99c5-00a0db5e9cf9 service nova] Lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-bd7cbda7-0256-46f9-8a41-e7ce570360f1 req-64323fb4-1f39-4041-99c5-00a0db5e9cf9 service nova] Lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:01 user nova-compute[72773]: DEBUG nova.compute.manager [req-bd7cbda7-0256-46f9-8a41-e7ce570360f1 req-64323fb4-1f39-4041-99c5-00a0db5e9cf9 service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] No waiting events found dispatching network-vif-plugged-26ca6ee6-83b5-4553-b31c-d1b135b219e9 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:27:01 user nova-compute[72773]: WARNING nova.compute.manager [req-bd7cbda7-0256-46f9-8a41-e7ce570360f1 req-64323fb4-1f39-4041-99c5-00a0db5e9cf9 service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Received unexpected event network-vif-plugged-26ca6ee6-83b5-4553-b31c-d1b135b219e9 for instance with vm_state active and task_state shelving_image_uploading.
Aug 16 22:27:01 user nova-compute[72773]: DEBUG nova.network.neutron [req-df2d4cbe-1df6-4d9e-b85d-5e4512c07a5c req-8879662e-2bb2-4e8b-a7d3-406a96cb7a22 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Updated VIF entry in instance network info cache for port 4b07374e-822f-4550-bcf1-c0259ca3624b. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:27:01 user nova-compute[72773]: DEBUG nova.network.neutron [req-df2d4cbe-1df6-4d9e-b85d-5e4512c07a5c req-8879662e-2bb2-4e8b-a7d3-406a96cb7a22 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Updating instance_info_cache with network_info: [{"id": "a2f04ed7-213b-4297-a13d-ad99a922f878", "address": "fa:16:3e:ee:62:f5", "network": {"id": "78850332-7129-48d4-ad0f-222c6981d934", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-817612380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f04ed7-21", "ovs_interfaceid": "a2f04ed7-213b-4297-a13d-ad99a922f878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "213a2da6-430b-4976-b5f0-a18d8494f42c", "address": "fa:16:3e:62:39:b6", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213a2da6-43", "ovs_interfaceid": "213a2da6-430b-4976-b5f0-a18d8494f42c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c27765c1-ae78-4b0b-8abf-2514be5599a4", "address": "fa:16:3e:12:84:13", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc27765c1-ae", "ovs_interfaceid": "c27765c1-ae78-4b0b-8abf-2514be5599a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "69942063-04a7-4cd3-87dd-42952e5fc667", "address": "fa:16:3e:8c:1b:60", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69942063-04", "ovs_interfaceid": "69942063-04a7-4cd3-87dd-42952e5fc667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38eab1de-142b-4f98-a91e-bea564b65757", "address": "fa:16:3e:a8:88:1c", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38eab1de-14", "ovs_interfaceid": "38eab1de-142b-4f98-a91e-bea564b65757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f77f6c81-0377-4531-8c95-07be0a197bcc", "address": "fa:16:3e:f0:3c:4a", "network": {"id": "9e71d1ff-9a5b-4a29-ad7e-6b4da698415d", "bridge": "br-int", "label": "tempest-device-tagging-net2-584203226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f6c81-03", "ovs_interfaceid": "f77f6c81-0377-4531-8c95-07be0a197bcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b07374e-822f-4550-bcf1-c0259ca3624b", "address": "fa:16:3e:5f:15:a3", "network": {"id": "9e71d1ff-9a5b-4a29-ad7e-6b4da698415d", "bridge": "br-int", "label": "tempest-device-tagging-net2-584203226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b07374e-82", "ovs_interfaceid": "4b07374e-822f-4550-bcf1-c0259ca3624b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:27:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-df2d4cbe-1df6-4d9e-b85d-5e4512c07a5c req-8879662e-2bb2-4e8b-a7d3-406a96cb7a22 service nova] Releasing lock "refresh_cache-df2acdf5-7c83-4129-8cab-da9882e1ac69" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:27:03 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-98b50614-7fe8-48a8-889f-6956372c80c0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Snapshot image upload complete
Aug 16 22:27:03 user nova-compute[72773]: DEBUG nova.compute.manager [None req-98b50614-7fe8-48a8-889f-6956372c80c0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TAaslNtZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:27:03 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:27:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:27:03 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:27:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:27:03 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:03 user nova-compute[72773]: INFO nova.compute.manager [None req-98b50614-7fe8-48a8-889f-6956372c80c0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Shelve offloading
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cff79f5-4004-440d-a18d-a2d3deb5fe0e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:27:03 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:03 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Instance destroyed successfully.
Aug 16 22:27:03 user nova-compute[72773]: DEBUG nova.compute.manager [None req-98b50614-7fe8-48a8-889f-6956372c80c0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-98b50614-7fe8-48a8-889f-6956372c80c0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "refresh_cache-02227d9f-5ddf-42fe-91a8-ce56d76aa274" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-98b50614-7fe8-48a8-889f-6956372c80c0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquired lock "refresh_cache-02227d9f-5ddf-42fe-91a8-ce56d76aa274" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG nova.network.neutron [None req-98b50614-7fe8-48a8-889f-6956372c80c0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a3af37-ae22-4188-99fb-0a5e733fac3b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0] added
Aug 16 22:27:03 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[729c9d96-69c9-45c1-aa30-4deece050422]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3161c8be-1511-4564-a927-e972a8f289fb]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TAaslNtZ {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TAaslNtZ" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce2e31b-9252-43de-91dc-9c7a7eafc7a1]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TAaslNtZ'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb71b668-d1cb-44d7-9f0e-5903d0fa7811]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad775bfe-5aab-4a06-872b-22974358be61]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:27:03 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:27:03 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80de9f0-9d1b-4e93-8b8d-cc2c573c1f62]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0, portal: 172.16.0.220,3260]
Aug 16 22:27:03 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0, portal: 172.16.0.220,3260] successful.
Aug 16 22:27:03 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[662895be-b74c-4a3a-adff-845dfc968fd9]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f146c3-e0ff-4a80-9a4a-fc4429e22357]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:27:03 user nova-compute[72773]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0 (non-flash)
Aug 16 22:27:03 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:27:03 user nova-compute[72773]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0 (non-flash)
Aug 16 22:27:03 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7295c3a6-1220-4a70-8261-88afc85b446f]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TAaslNtZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG nova.network.neutron [None req-98b50614-7fe8-48a8-889f-6956372c80c0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Updating instance_info_cache with network_info: [{"id": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "address": "fa:16:3e:4a:54:e0", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ca6ee6-83", "ovs_interfaceid": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:27:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-98b50614-7fe8-48a8-889f-6956372c80c0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Releasing lock "refresh_cache-02227d9f-5ddf-42fe-91a8-ce56d76aa274" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:27:04 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:04 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:27:04 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26239356162323536', 'path': '/dev/sdc'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:27:04 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239356162323536', 'path': '/dev/sdc'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:27:04 user nova-compute[72773]: DEBUG nova.objects.instance [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Lazy-loading 'flavor' on Instance uuid 02235c77-0c2a-4317-8526-7bd5096694a2 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:27:04 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 22:27:04 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:27:04 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 22:27:04 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:27:04 user nova-compute[72773]:   <serial>afb3788f-0124-4356-8111-1af7c73788d0</serial>
Aug 16 22:27:04 user nova-compute[72773]: </disk>
Aug 16 22:27:04 user nova-compute[72773]:  {{(pid=72773) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 22:27:04 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Instance destroyed successfully.
Aug 16 22:27:04 user nova-compute[72773]: DEBUG nova.objects.instance [None req-98b50614-7fe8-48a8-889f-6956372c80c0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lazy-loading 'resources' on Instance uuid 02227d9f-5ddf-42fe-91a8-ce56d76aa274 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:27:04 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-98b50614-7fe8-48a8-889f-6956372c80c0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-414068688',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-414068688',id=4,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGC6hdBcq53EaZ+ztnWCq9EEEmf6tlOudhff/uPCsPcoSF0txRuIbNZTZkFR19PxQuLSW0BQsR2r9cbeTZygr/GW6SXxJlq+Wnq0T9ugwZXHOdCCn9YF0qaQknT5h2D+7w==',key_name='tempest-keypair-1733371512',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:25:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a2ef6a37d79341d7a94e5b314efddab4',ramdisk_id='',reservation_id='r-fl923se9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-488184195',owner_user_name='tempest-AttachVolumeShelveTestJSON-488184195-project-member',shelved_at='2023-08-16T22:27:03.064276',shelved_host='user',shelved_image_id='5600fabf-f736-4764-be5b-d59aa75c3865'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:27:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71cd9d1142ec45e792219e8b789cf2a0',uuid=02227d9f-5ddf-42fe-91a8-ce56d76aa274,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "address": "fa:16:3e:4a:54:e0", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ca6ee6-83", "ovs_interfaceid": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:27:04 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-98b50614-7fe8-48a8-889f-6956372c80c0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Converting VIF {"id": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "address": "fa:16:3e:4a:54:e0", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ca6ee6-83", "ovs_interfaceid": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:27:04 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-98b50614-7fe8-48a8-889f-6956372c80c0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:54:e0,bridge_name='br-int',has_traffic_filtering=True,id=26ca6ee6-83b5-4553-b31c-d1b135b219e9,network=Network(9aa7e6bf-5a47-422d-b638-cff5a8429391),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26ca6ee6-83') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:27:04 user nova-compute[72773]: DEBUG os_vif [None req-98b50614-7fe8-48a8-889f-6956372c80c0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:54:e0,bridge_name='br-int',has_traffic_filtering=True,id=26ca6ee6-83b5-4553-b31c-d1b135b219e9,network=Network(9aa7e6bf-5a47-422d-b638-cff5a8429391),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26ca6ee6-83') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:27:04 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:04 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26ca6ee6-83, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:27:04 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:04 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:04 user nova-compute[72773]: DEBUG nova.compute.manager [req-e978e9cd-1e27-4181-bf42-b2b7bc26e52e req-bbca2557-1ae9-4494-8b8b-fcc75594608f service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Received event network-changed-26ca6ee6-83b5-4553-b31c-d1b135b219e9 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:27:04 user nova-compute[72773]: DEBUG nova.compute.manager [req-e978e9cd-1e27-4181-bf42-b2b7bc26e52e req-bbca2557-1ae9-4494-8b8b-fcc75594608f service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Refreshing instance network info cache due to event network-changed-26ca6ee6-83b5-4553-b31c-d1b135b219e9. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:27:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e978e9cd-1e27-4181-bf42-b2b7bc26e52e req-bbca2557-1ae9-4494-8b8b-fcc75594608f service nova] Acquiring lock "refresh_cache-02227d9f-5ddf-42fe-91a8-ce56d76aa274" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:27:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e978e9cd-1e27-4181-bf42-b2b7bc26e52e req-bbca2557-1ae9-4494-8b8b-fcc75594608f service nova] Acquired lock "refresh_cache-02227d9f-5ddf-42fe-91a8-ce56d76aa274" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:27:04 user nova-compute[72773]: DEBUG nova.network.neutron [req-e978e9cd-1e27-4181-bf42-b2b7bc26e52e req-bbca2557-1ae9-4494-8b8b-fcc75594608f service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Refreshing network info cache for port 26ca6ee6-83b5-4553-b31c-d1b135b219e9 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:27:04 user nova-compute[72773]: INFO os_vif [None req-98b50614-7fe8-48a8-889f-6956372c80c0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:54:e0,bridge_name='br-int',has_traffic_filtering=True,id=26ca6ee6-83b5-4553-b31c-d1b135b219e9,network=Network(9aa7e6bf-5a47-422d-b638-cff5a8429391),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26ca6ee6-83')
Aug 16 22:27:04 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-98b50614-7fe8-48a8-889f-6956372c80c0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Deleting instance files /opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274_del
Aug 16 22:27:04 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-98b50614-7fe8-48a8-889f-6956372c80c0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Deletion of /opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274_del complete
Aug 16 22:27:04 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-98b50614-7fe8-48a8-889f-6956372c80c0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Deleted allocations for instance 02227d9f-5ddf-42fe-91a8-ce56d76aa274
Aug 16 22:27:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-98b50614-7fe8-48a8-889f-6956372c80c0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-98b50614-7fe8-48a8-889f-6956372c80c0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:04 user nova-compute[72773]: DEBUG nova.objects.instance [None req-98b50614-7fe8-48a8-889f-6956372c80c0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lazy-loading 'numa_topology' on Instance uuid 02227d9f-5ddf-42fe-91a8-ce56d76aa274 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:27:05 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:27:05 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:27:05 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] No VIF found with MAC fa:16:3e:66:2d:a9, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:27:05 user nova-compute[72773]: DEBUG nova.network.neutron [req-e978e9cd-1e27-4181-bf42-b2b7bc26e52e req-bbca2557-1ae9-4494-8b8b-fcc75594608f service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Updated VIF entry in instance network info cache for port 26ca6ee6-83b5-4553-b31c-d1b135b219e9. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:27:05 user nova-compute[72773]: DEBUG nova.network.neutron [req-e978e9cd-1e27-4181-bf42-b2b7bc26e52e req-bbca2557-1ae9-4494-8b8b-fcc75594608f service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Updating instance_info_cache with network_info: [{"id": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "address": "fa:16:3e:4a:54:e0", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap26ca6ee6-83", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:27:05 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-98b50614-7fe8-48a8-889f-6956372c80c0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:27:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e978e9cd-1e27-4181-bf42-b2b7bc26e52e req-bbca2557-1ae9-4494-8b8b-fcc75594608f service nova] Releasing lock "refresh_cache-02227d9f-5ddf-42fe-91a8-ce56d76aa274" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:27:05 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-98b50614-7fe8-48a8-889f-6956372c80c0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:27:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-59e6a82c-5923-401b-b6c1-c1cfa29e2b27 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Lock "02235c77-0c2a-4317-8526-7bd5096694a2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.058s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-98b50614-7fe8-48a8-889f-6956372c80c0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-98b50614-7fe8-48a8-889f-6956372c80c0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.210s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Acquiring lock "02235c77-0c2a-4317-8526-7bd5096694a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Lock "02235c77-0c2a-4317-8526-7bd5096694a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Acquiring lock "02235c77-0c2a-4317-8526-7bd5096694a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Lock "02235c77-0c2a-4317-8526-7bd5096694a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Lock "02235c77-0c2a-4317-8526-7bd5096694a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:05 user nova-compute[72773]: INFO nova.compute.manager [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Terminating instance
Aug 16 22:27:05 user nova-compute[72773]: DEBUG nova.compute.manager [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:27:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:06 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Instance destroyed successfully.
Aug 16 22:27:06 user nova-compute[72773]: DEBUG nova.objects.instance [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Lazy-loading 'resources' on Instance uuid 02235c77-0c2a-4317-8526-7bd5096694a2 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-934748313',display_name='tempest-DeleteServersTestJSON-server-934748313',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-934748313',id=2,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:25:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4509d81443b499a8379f558bfad9338',ramdisk_id='',reservation_id='r-5cnhii1d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1769552369',owner_user_name='tempest-DeleteServersTestJSON-1769552369-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:25:09Z,user_data=None,user_id='2f8b29d1bc1748909dc34b421b798678',uuid=02235c77-0c2a-4317-8526-7bd5096694a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3bb17a2-593d-46be-92bc-9b4b64a48174", "address": "fa:16:3e:66:2d:a9", "network": {"id": "932581fe-de5a-42af-8214-9fc20f8e3038", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-982938001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4509d81443b499a8379f558bfad9338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bb17a2-59", "ovs_interfaceid": "f3bb17a2-593d-46be-92bc-9b4b64a48174", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Converting VIF {"id": "f3bb17a2-593d-46be-92bc-9b4b64a48174", "address": "fa:16:3e:66:2d:a9", "network": {"id": "932581fe-de5a-42af-8214-9fc20f8e3038", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-982938001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4509d81443b499a8379f558bfad9338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bb17a2-59", "ovs_interfaceid": "f3bb17a2-593d-46be-92bc-9b4b64a48174", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:2d:a9,bridge_name='br-int',has_traffic_filtering=True,id=f3bb17a2-593d-46be-92bc-9b4b64a48174,network=Network(932581fe-de5a-42af-8214-9fc20f8e3038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3bb17a2-59') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG os_vif [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:2d:a9,bridge_name='br-int',has_traffic_filtering=True,id=f3bb17a2-593d-46be-92bc-9b4b64a48174,network=Network(932581fe-de5a-42af-8214-9fc20f8e3038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3bb17a2-59') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3bb17a2-59, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:06 user nova-compute[72773]: INFO os_vif [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:2d:a9,bridge_name='br-int',has_traffic_filtering=True,id=f3bb17a2-593d-46be-92bc-9b4b64a48174,network=Network(932581fe-de5a-42af-8214-9fc20f8e3038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3bb17a2-59')
Aug 16 22:27:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TAaslNtZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:27:06 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:27:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d0f533-9602-4a3a-955c-dd0ded388e40]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[724eef00-5c01-4a86-ab09-4e75e98a7101]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:27:06 user nova-compute[72773]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0 (non-flash)
Aug 16 22:27:06 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:27:06 user nova-compute[72773]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0 (non-flash)
Aug 16 22:27:06 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef80585cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0'): ({'sdc'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Removing single pathed devices sdc {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e9aa11-bfa9-4207-9ac2-3524fb64d477]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0312db47-c260-4bf1-bf15-aa89aa9d38f7]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Flushing IO for device /dev/sdc {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0f9e9f-bcb4-441a-a19c-113b0a2dc4ed]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[66beec72-099a-4995-8066-67deaaa255c2]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f4c5cf-3bd0-457a-935c-c5bda04f2814]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG nova.compute.manager [req-c112b60d-1801-4810-9e9e-70f8801d600b req-c5d98a74-1606-4acb-a5a9-bbc2a117dbc8 service nova] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Received event network-vif-unplugged-f3bb17a2-593d-46be-92bc-9b4b64a48174 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c112b60d-1801-4810-9e9e-70f8801d600b req-c5d98a74-1606-4acb-a5a9-bbc2a117dbc8 service nova] Acquiring lock "02235c77-0c2a-4317-8526-7bd5096694a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c112b60d-1801-4810-9e9e-70f8801d600b req-c5d98a74-1606-4acb-a5a9-bbc2a117dbc8 service nova] Lock "02235c77-0c2a-4317-8526-7bd5096694a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c112b60d-1801-4810-9e9e-70f8801d600b req-c5d98a74-1606-4acb-a5a9-bbc2a117dbc8 service nova] Lock "02235c77-0c2a-4317-8526-7bd5096694a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG nova.compute.manager [req-c112b60d-1801-4810-9e9e-70f8801d600b req-c5d98a74-1606-4acb-a5a9-bbc2a117dbc8 service nova] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] No waiting events found dispatching network-vif-unplugged-f3bb17a2-593d-46be-92bc-9b4b64a48174 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG nova.compute.manager [req-c112b60d-1801-4810-9e9e-70f8801d600b req-c5d98a74-1606-4acb-a5a9-bbc2a117dbc8 service nova] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Received event network-vif-unplugged-f3bb17a2-593d-46be-92bc-9b4b64a48174 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG nova.compute.manager [req-c112b60d-1801-4810-9e9e-70f8801d600b req-c5d98a74-1606-4acb-a5a9-bbc2a117dbc8 service nova] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Received event network-vif-plugged-f3bb17a2-593d-46be-92bc-9b4b64a48174 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c112b60d-1801-4810-9e9e-70f8801d600b req-c5d98a74-1606-4acb-a5a9-bbc2a117dbc8 service nova] Acquiring lock "02235c77-0c2a-4317-8526-7bd5096694a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c112b60d-1801-4810-9e9e-70f8801d600b req-c5d98a74-1606-4acb-a5a9-bbc2a117dbc8 service nova] Lock "02235c77-0c2a-4317-8526-7bd5096694a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c112b60d-1801-4810-9e9e-70f8801d600b req-c5d98a74-1606-4acb-a5a9-bbc2a117dbc8 service nova] Lock "02235c77-0c2a-4317-8526-7bd5096694a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG nova.compute.manager [req-c112b60d-1801-4810-9e9e-70f8801d600b req-c5d98a74-1606-4acb-a5a9-bbc2a117dbc8 service nova] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] No waiting events found dispatching network-vif-plugged-f3bb17a2-593d-46be-92bc-9b4b64a48174 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:27:06 user nova-compute[72773]: WARNING nova.compute.manager [req-c112b60d-1801-4810-9e9e-70f8801d600b req-c5d98a74-1606-4acb-a5a9-bbc2a117dbc8 service nova] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Received unexpected event network-vif-plugged-f3bb17a2-593d-46be-92bc-9b4b64a48174 for instance with vm_state active and task_state deleting.
Aug 16 22:27:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7039d6-c9f4-4fc9-8299-c88ca19b00f1]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0, portal: 172.16.0.220,3260]
Aug 16 22:27:06 user nova-compute[72773]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0, portal: 172.16.0.220,3260] successful.
Aug 16 22:27:06 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb3788f-0124-4356-8111-1af7c73788d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ecfffe-7070-466e-a988-010ca31e05b5]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] <== disconnect_volume: return (288ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:27:06 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Deleting instance files /opt/stack/data/nova/instances/02235c77-0c2a-4317-8526-7bd5096694a2_del
Aug 16 22:27:06 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Deletion of /opt/stack/data/nova/instances/02235c77-0c2a-4317-8526-7bd5096694a2_del complete
Aug 16 22:27:06 user nova-compute[72773]: INFO nova.compute.manager [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 16 22:27:06 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:27:06 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:27:07 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:27:07 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Took 0.79 seconds to deallocate network for instance.
Aug 16 22:27:07 user nova-compute[72773]: DEBUG nova.compute.manager [req-e8b0f9f7-b341-4c54-91fc-8d54c54093fa req-6b240957-d3e2-4bff-945a-e18813e35e41 service nova] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Received event network-changed-b757c921-b63d-4724-874a-2b9bd0710124 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:27:07 user nova-compute[72773]: DEBUG nova.compute.manager [req-e8b0f9f7-b341-4c54-91fc-8d54c54093fa req-6b240957-d3e2-4bff-945a-e18813e35e41 service nova] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Refreshing instance network info cache due to event network-changed-b757c921-b63d-4724-874a-2b9bd0710124. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:27:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e8b0f9f7-b341-4c54-91fc-8d54c54093fa req-6b240957-d3e2-4bff-945a-e18813e35e41 service nova] Acquiring lock "refresh_cache-4387131d-7a86-477a-a231-69713b2d965d" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:27:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e8b0f9f7-b341-4c54-91fc-8d54c54093fa req-6b240957-d3e2-4bff-945a-e18813e35e41 service nova] Acquired lock "refresh_cache-4387131d-7a86-477a-a231-69713b2d965d" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:27:07 user nova-compute[72773]: DEBUG nova.network.neutron [req-e8b0f9f7-b341-4c54-91fc-8d54c54093fa req-6b240957-d3e2-4bff-945a-e18813e35e41 service nova] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Refreshing network info cache for port b757c921-b63d-4724-874a-2b9bd0710124 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:27:08 user nova-compute[72773]: DEBUG nova.network.neutron [req-e8b0f9f7-b341-4c54-91fc-8d54c54093fa req-6b240957-d3e2-4bff-945a-e18813e35e41 service nova] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Updated VIF entry in instance network info cache for port b757c921-b63d-4724-874a-2b9bd0710124. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:27:08 user nova-compute[72773]: DEBUG nova.network.neutron [req-e8b0f9f7-b341-4c54-91fc-8d54c54093fa req-6b240957-d3e2-4bff-945a-e18813e35e41 service nova] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Updating instance_info_cache with network_info: [{"id": "b757c921-b63d-4724-874a-2b9bd0710124", "address": "fa:16:3e:30:86:c9", "network": {"id": "5f00189e-3c15-4517-85ba-30c0d1de2ee7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-297270230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f27a55e197bd45cab4ca201a5a0b7b04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb757c921-b6", "ovs_interfaceid": "b757c921-b63d-4724-874a-2b9bd0710124", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:27:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e8b0f9f7-b341-4c54-91fc-8d54c54093fa req-6b240957-d3e2-4bff-945a-e18813e35e41 service nova] Releasing lock "refresh_cache-4387131d-7a86-477a-a231-69713b2d965d" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:27:08 user nova-compute[72773]: DEBUG nova.compute.manager [req-3c52bdc4-23a3-4db3-a453-6171d1f4b98c req-f1e25d1f-a3a4-415a-aa8d-8fea27230b52 service nova] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Received event network-vif-deleted-f3bb17a2-593d-46be-92bc-9b4b64a48174 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:27:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:09 user nova-compute[72773]: DEBUG nova.compute.manager [req-6c81a063-d812-4c0c-ada5-0af387be1e6d req-5385dd86-14ab-482b-a961-f311fc3fa98b service nova] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Received event network-changed-813736f3-3cf2-4d52-9bf5-239b93647ee2 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:27:09 user nova-compute[72773]: DEBUG nova.compute.manager [req-6c81a063-d812-4c0c-ada5-0af387be1e6d req-5385dd86-14ab-482b-a961-f311fc3fa98b service nova] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Refreshing instance network info cache due to event network-changed-813736f3-3cf2-4d52-9bf5-239b93647ee2. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:27:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6c81a063-d812-4c0c-ada5-0af387be1e6d req-5385dd86-14ab-482b-a961-f311fc3fa98b service nova] Acquiring lock "refresh_cache-c6adfa95-47ac-40d3-abc1-0c6027507f07" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:27:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6c81a063-d812-4c0c-ada5-0af387be1e6d req-5385dd86-14ab-482b-a961-f311fc3fa98b service nova] Acquired lock "refresh_cache-c6adfa95-47ac-40d3-abc1-0c6027507f07" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:27:09 user nova-compute[72773]: DEBUG nova.network.neutron [req-6c81a063-d812-4c0c-ada5-0af387be1e6d req-5385dd86-14ab-482b-a961-f311fc3fa98b service nova] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Refreshing network info cache for port 813736f3-3cf2-4d52-9bf5-239b93647ee2 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:27:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Acquiring lock "4387131d-7a86-477a-a231-69713b2d965d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Lock "4387131d-7a86-477a-a231-69713b2d965d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:10 user nova-compute[72773]: DEBUG nova.objects.instance [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Lazy-loading 'flavor' on Instance uuid 4387131d-7a86-477a-a231-69713b2d965d {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:27:10 user nova-compute[72773]: DEBUG nova.network.neutron [req-6c81a063-d812-4c0c-ada5-0af387be1e6d req-5385dd86-14ab-482b-a961-f311fc3fa98b service nova] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Updated VIF entry in instance network info cache for port 813736f3-3cf2-4d52-9bf5-239b93647ee2. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:27:10 user nova-compute[72773]: DEBUG nova.network.neutron [req-6c81a063-d812-4c0c-ada5-0af387be1e6d req-5385dd86-14ab-482b-a961-f311fc3fa98b service nova] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Updating instance_info_cache with network_info: [{"id": "813736f3-3cf2-4d52-9bf5-239b93647ee2", "address": "fa:16:3e:55:99:4d", "network": {"id": "db5b9d7a-8d3c-409c-961b-9bd7d882664c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1507737858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9086072338454300bb7a455bff6d0757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813736f3-3c", "ovs_interfaceid": "813736f3-3cf2-4d52-9bf5-239b93647ee2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:27:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6c81a063-d812-4c0c-ada5-0af387be1e6d req-5385dd86-14ab-482b-a961-f311fc3fa98b service nova] Releasing lock "refresh_cache-c6adfa95-47ac-40d3-abc1-0c6027507f07" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:27:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Lock "4387131d-7a86-477a-a231-69713b2d965d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:10 user nova-compute[72773]: INFO nova.virt.block_device [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Booting with volume 423d5c85-4fe4-454e-9164-709647d701f0 at /dev/vdc
Aug 16 22:27:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Acquiring lock "4387131d-7a86-477a-a231-69713b2d965d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Lock "4387131d-7a86-477a-a231-69713b2d965d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:10 user nova-compute[72773]: INFO nova.compute.manager [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Attaching volume 662f1abb-c712-47b6-b09b-9d8a776ad8ce to /dev/vdb
Aug 16 22:27:10 user nova-compute[72773]: DEBUG os_brick.utils [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:27:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:10 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab80c980-7bd5-44d4-ab2d-0707c53930df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:10 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32c9563-ac97-4a35-8a63-0f3e97444730]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:10 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa4435d-ff9b-4b73-a88e-e43c1dc7ef5c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:10 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda4a57a-7f09-43cb-b6c1-594b6af4dd4b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:27:10 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:27:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:27:11 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:27:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ab06b5-5342-4de4-98d3-3fe5e9491c3b]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:27:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:27:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:27:11 user nova-compute[72773]: DEBUG os_brick.utils [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:27:11 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Updating existing volume attachment record: a63c8f85-3dec-4b34-92ea-6517be1d4977 {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:27:11 user nova-compute[72773]: DEBUG nova.compute.manager [req-5f576967-7220-40db-a939-08d92fd519bf req-7ebbfaee-9b64-4689-8058-16dc5b7285cc service nova] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Received event network-changed-c0ab5700-b895-412c-acca-e116a216cc89 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:27:11 user nova-compute[72773]: DEBUG nova.compute.manager [req-5f576967-7220-40db-a939-08d92fd519bf req-7ebbfaee-9b64-4689-8058-16dc5b7285cc service nova] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Refreshing instance network info cache due to event network-changed-c0ab5700-b895-412c-acca-e116a216cc89. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:27:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5f576967-7220-40db-a939-08d92fd519bf req-7ebbfaee-9b64-4689-8058-16dc5b7285cc service nova] Acquiring lock "refresh_cache-aa4cbd72-a11c-4dab-b2e2-29fe10493931" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:27:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5f576967-7220-40db-a939-08d92fd519bf req-7ebbfaee-9b64-4689-8058-16dc5b7285cc service nova] Acquired lock "refresh_cache-aa4cbd72-a11c-4dab-b2e2-29fe10493931" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:27:11 user nova-compute[72773]: DEBUG nova.network.neutron [req-5f576967-7220-40db-a939-08d92fd519bf req-7ebbfaee-9b64-4689-8058-16dc5b7285cc service nova] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Refreshing network info cache for port c0ab5700-b895-412c-acca-e116a216cc89 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:27:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:11 user nova-compute[72773]: DEBUG nova.network.neutron [req-5f576967-7220-40db-a939-08d92fd519bf req-7ebbfaee-9b64-4689-8058-16dc5b7285cc service nova] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Updated VIF entry in instance network info cache for port c0ab5700-b895-412c-acca-e116a216cc89. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:27:11 user nova-compute[72773]: DEBUG nova.network.neutron [req-5f576967-7220-40db-a939-08d92fd519bf req-7ebbfaee-9b64-4689-8058-16dc5b7285cc service nova] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Updating instance_info_cache with network_info: [{"id": "c0ab5700-b895-412c-acca-e116a216cc89", "address": "fa:16:3e:19:53:af", "network": {"id": "03be4829-78f7-42b1-8d1d-742719d2e16d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-503860176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc901cb159c84701b71722d227c56baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ab5700-b8", "ovs_interfaceid": "c0ab5700-b895-412c-acca-e116a216cc89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:27:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5f576967-7220-40db-a939-08d92fd519bf req-7ebbfaee-9b64-4689-8058-16dc5b7285cc service nova] Releasing lock "refresh_cache-aa4cbd72-a11c-4dab-b2e2-29fe10493931" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:14 user nova-compute[72773]: INFO nova.compute.manager [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Took 7.05 seconds to detach 1 volumes for instance.
Aug 16 22:27:14 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692224819.676264, 02227d9f-5ddf-42fe-91a8-ce56d76aa274 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:27:14 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] VM Stopped (Lifecycle Event)
Aug 16 22:27:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-2a47cc59-ac6d-4e8d-8aca-c87aac138706 None None] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG os_brick.utils [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a600f33-7419-4e0a-b1df-b757988c8072]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1af27f-7d32-489a-a74f-fe910d8789cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6995d787-f748-409f-9b39-2dba375ab63c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d56bcb0-8947-4dc1-a8c4-215ac8e9c9bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:27:14 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:27:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YvhaHcTr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:27:14 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:27:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:27:14 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:27:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:27:14 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:27:14 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9290a1dd-2bee-4062-a880-08e500f0c0bf]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG os_brick.utils [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Updating existing volume attachment record: 62243608-6227-404f-9ed9-988ce9907fb2 {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[955f3a3b-6a80-4720-83d9-54732bb4133f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:27:14 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fab145e-c823-436b-9e48-5458753163b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11] added
Aug 16 22:27:14 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dab38d-2401-4188-a563-21a6a4353df1]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[567b0574-d7f3-41fc-ac06-e5253eb29226]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YvhaHcTr {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YvhaHcTr" returned: 0 in 0.027s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f8dd14-2014-4f0b-b65f-813d9245b938]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YvhaHcTr'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[53074313-faf6-479f-8b4b-e1bc6e193b16]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa02371-c9f0-4b04-88b4-45a27e46964d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:27:15 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:27:15 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21ea9b7-8a21-4939-8936-d06df610baf1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11, portal: 172.16.0.220,3260]
Aug 16 22:27:15 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11, portal: 172.16.0.220,3260] successful.
Aug 16 22:27:15 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26e95e5-2fc9-451f-8737-4e26b161f7d3]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Acquiring lock "c6adfa95-47ac-40d3-abc1-0c6027507f07" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "c6adfa95-47ac-40d3-abc1-0c6027507f07" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.470s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG nova.objects.instance [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lazy-loading 'flavor' on Instance uuid c6adfa95-47ac-40d3-abc1-0c6027507f07 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6f5939-2759-4776-a794-89ee1f523454]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:27:15 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:27:15 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:27:15 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:27:15 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:15 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Deleted allocations for instance 02235c77-0c2a-4317-8526-7bd5096694a2
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db92a16-5469-4432-8e68-87942b4945da]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YvhaHcTr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "c6adfa95-47ac-40d3-abc1-0c6027507f07" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-882eaba9-9322-4641-95ae-7f805dba08e9 tempest-DeleteServersTestJSON-1769552369 tempest-DeleteServersTestJSON-1769552369-project-member] Lock "02235c77-0c2a-4317-8526-7bd5096694a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.816s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Acquiring lock "c6adfa95-47ac-40d3-abc1-0c6027507f07" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "c6adfa95-47ac-40d3-abc1-0c6027507f07" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:15 user nova-compute[72773]: INFO nova.compute.manager [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Attaching volume 72cbff1f-2142-4f5c-9fae-ee21f058aede to /dev/vdb
Aug 16 22:27:15 user nova-compute[72773]: DEBUG os_brick.utils [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2c4016-30de-402a-9356-ad90c93e5c9c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[196c5f7b-362d-463b-b185-c82701f4ed7d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[870a2d66-8156-49b7-9461-ae605ddcf3ab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[db546099-3496-4618-aad1-a2caef350057]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:27:15 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:27:15 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[981f92d6-e4f4-45c8-9362-c38e3d1c3b40]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG os_brick.utils [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:27:15 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Updating existing volume attachment record: 2abe4684-36ea-452a-a6be-0127e0c4909a {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:27:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:27:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '23264363863623261', 'path': '/dev/sdc'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:27:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264363863623261', 'path': '/dev/sdc'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:27:16 user nova-compute[72773]: DEBUG nova.objects.instance [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lazy-loading 'flavor' on Instance uuid 4efab321-f2aa-456c-a1ae-b32f399f694d {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:27:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 22:27:16 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:27:16 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 22:27:16 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:27:16 user nova-compute[72773]:   <serial>c6852443-e1d9-4227-bfa5-a9179c28be11</serial>
Aug 16 22:27:16 user nova-compute[72773]: </disk>
Aug 16 22:27:16 user nova-compute[72773]:  {{(pid=72773) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 22:27:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:27:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:27:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] No VIF found with MAC fa:16:3e:05:f5:f1, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:27:17 user nova-compute[72773]: DEBUG nova.compute.manager [req-50922373-8e10-4b87-bb62-0f4e764764ab req-586930b1-db03-4c67-b624-ef4a2448e52c service nova] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Received event network-changed-8fabc876-8281-4305-8c4e-94cf1e316cf5 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:27:17 user nova-compute[72773]: DEBUG nova.compute.manager [req-50922373-8e10-4b87-bb62-0f4e764764ab req-586930b1-db03-4c67-b624-ef4a2448e52c service nova] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Refreshing instance network info cache due to event network-changed-8fabc876-8281-4305-8c4e-94cf1e316cf5. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:27:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-50922373-8e10-4b87-bb62-0f4e764764ab req-586930b1-db03-4c67-b624-ef4a2448e52c service nova] Acquiring lock "refresh_cache-8bbb196d-e352-47a5-86fb-a819723c2ce8" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:27:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-50922373-8e10-4b87-bb62-0f4e764764ab req-586930b1-db03-4c67-b624-ef4a2448e52c service nova] Acquired lock "refresh_cache-8bbb196d-e352-47a5-86fb-a819723c2ce8" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:27:17 user nova-compute[72773]: DEBUG nova.network.neutron [req-50922373-8e10-4b87-bb62-0f4e764764ab req-586930b1-db03-4c67-b624-ef4a2448e52c service nova] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Refreshing network info cache for port 8fabc876-8281-4305-8c4e-94cf1e316cf5 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:27:17 user nova-compute[72773]: DEBUG nova.network.neutron [req-50922373-8e10-4b87-bb62-0f4e764764ab req-586930b1-db03-4c67-b624-ef4a2448e52c service nova] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Updated VIF entry in instance network info cache for port 8fabc876-8281-4305-8c4e-94cf1e316cf5. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:27:17 user nova-compute[72773]: DEBUG nova.network.neutron [req-50922373-8e10-4b87-bb62-0f4e764764ab req-586930b1-db03-4c67-b624-ef4a2448e52c service nova] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Updating instance_info_cache with network_info: [{"id": "8fabc876-8281-4305-8c4e-94cf1e316cf5", "address": "fa:16:3e:54:d7:ac", "network": {"id": "3b558f9d-f82f-4407-8a9d-59e024e4c7a6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-974724272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228b8b05cdb54990b21e671e31fb51ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fabc876-82", "ovs_interfaceid": "8fabc876-8281-4305-8c4e-94cf1e316cf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:27:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-50922373-8e10-4b87-bb62-0f4e764764ab req-586930b1-db03-4c67-b624-ef4a2448e52c service nova] Releasing lock "refresh_cache-8bbb196d-e352-47a5-86fb-a819723c2ce8" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:27:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:21 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692224826.3964713, 02235c77-0c2a-4317-8526-7bd5096694a2 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:27:21 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] VM Stopped (Lifecycle Event)
Aug 16 22:27:21 user nova-compute[72773]: DEBUG nova.compute.manager [None req-5643401b-40ef-4302-a7f3-de7f6c527933 None None] [instance: 02235c77-0c2a-4317-8526-7bd5096694a2] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:27:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3208ffca-89d8-44a0-8588-e9cff091f327 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "4efab321-f2aa-456c-a1ae-b32f399f694d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 40.895s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Acquiring lock "8bbb196d-e352-47a5-86fb-a819723c2ce8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Lock "8bbb196d-e352-47a5-86fb-a819723c2ce8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG nova.objects.instance [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Lazy-loading 'flavor' on Instance uuid 8bbb196d-e352-47a5-86fb-a819723c2ce8 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Lock "8bbb196d-e352-47a5-86fb-a819723c2ce8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Acquiring lock "aa4cbd72-a11c-4dab-b2e2-29fe10493931" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lock "aa4cbd72-a11c-4dab-b2e2-29fe10493931" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG nova.compute.manager [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:27:36 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Creating image(s)
Aug 16 22:27:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Did not create local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Ensure instance console log exists: /opt/stack/data/nova/instances/df2acdf5-7c83-4129-8cab-da9882e1ac69/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Start _get_guest_xml network_info=[{"id": "a2f04ed7-213b-4297-a13d-ad99a922f878", "address": "fa:16:3e:ee:62:f5", "network": {"id": "78850332-7129-48d4-ad0f-222c6981d934", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-817612380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f04ed7-21", "ovs_interfaceid": "a2f04ed7-213b-4297-a13d-ad99a922f878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "213a2da6-430b-4976-b5f0-a18d8494f42c", "address": "fa:16:3e:62:39:b6", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213a2da6-43", "ovs_interfaceid": "213a2da6-430b-4976-b5f0-a18d8494f42c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c27765c1-ae78-4b0b-8abf-2514be5599a4", "address": "fa:16:3e:12:84:13", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc27765c1-ae", "ovs_interfaceid": "c27765c1-ae78-4b0b-8abf-2514be5599a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "69942063-04a7-4cd3-87dd-42952e5fc667", "address": "fa:16:3e:8c:1b:60", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69942063-04", "ovs_interfaceid": "69942063-04a7-4cd3-87dd-42952e5fc667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38eab1de-142b-4f98-a91e-bea564b65757", "address": "fa:16:3e:a8:88:1c", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38eab1de-14", "ovs_interfaceid": "38eab1de-142b-4f98-a91e-bea564b65757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f77f6c81-0377-4531-8c95-07be0a197bcc", "address": "fa:16:3e:f0:3c:4a", "network": {"id": "9e71d1ff-9a5b-4a29-ad7e-6b4da698415d", "bridge": "br-int", "label": "tempest-device-tagging-net2-584203226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f6c81-03", "ovs_interfaceid": "f77f6c81-0377-4531-8c95-07be0a197bcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b07374e-822f-4550-bcf1-c0259ca3624b", "address": "fa:16:3e:5f:15:a3", "network": {"id": "9e71d1ff-9a5b-4a29-ad7e-6b4da698415d", "bridge": "br-int", "label": "tempest-device-tagging-net2-584203226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b07374e-82", "ovs_interfaceid": "4b07374e-822f-4550-bcf1-c0259ca3624b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'cb55340f-f261-4f4e-9b2b-8b18525d48ad', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VrJFCIxz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'df2acdf5-7c83-4129-8cab-da9882e1ac69', 'attached_at': '', 'detached_at': '', 'volume_id': 'ffd4a5d3-43a9-42f6-9e81-78036352413d', 'serial': 'ffd4a5d3-43a9-42f6-9e81-78036352413d'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': '14155e5c-c398-4881-a448-e1e70cda8a04', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJPsTpKL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'df2acdf5-7c83-4129-8cab-da9882e1ac69', 'attached_at': '', 'detached_at': '', 'volume_id': 'c8469fb8-1df6-4bb2-be19-7878c4d4cd9d', 'serial': 'c8469fb8-1df6-4bb2-be19-7878c4d4cd9d'}, 'mount_device': '/dev/vdb', 'boot_index': 1, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': 'a63c8f85-3dec-4b34-92ea-6517be1d4977', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btrAaxGC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'df2acdf5-7c83-4129-8cab-da9882e1ac69', 'attached_at': '', 'detached_at': '', 'volume_id': '423d5c85-4fe4-454e-9164-709647d701f0', 'serial': '423d5c85-4fe4-454e-9164-709647d701f0'}, 'mount_device': '/dev/vdc', 'boot_index': 2, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG nova.objects.instance [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lazy-loading 'flavor' on Instance uuid aa4cbd72-a11c-4dab-b2e2-29fe10493931 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:27:36 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:27:36 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:27:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VrJFCIxz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:27:36 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:27:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:27:36 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:27:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:27:36 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:27:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lock "aa4cbd72-a11c-4dab-b2e2-29fe10493931" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.101s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb383c65-a79c-4689-8d8e-8e1ea1982457]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:27:36 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6154630b-93bb-42e3-ae34-0eeba6fde26b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d] added
Aug 16 22:27:36 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5127c86-b455-4e78-9dd9-a5ddc0f364b6]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[063e7e97-77cd-46a9-87be-d1115df2340d]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VrJFCIxz {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Acquiring lock "8bbb196d-e352-47a5-86fb-a819723c2ce8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Lock "8bbb196d-e352-47a5-86fb-a819723c2ce8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:37 user nova-compute[72773]: INFO nova.compute.manager [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Attaching volume 3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 to /dev/vdb
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VrJFCIxz" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a5ee9d-0da6-4a7a-9ab5-0616b01b468a]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VrJFCIxz'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b18a3b-e18e-4bc7-9fa1-b40799340fa1]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9fc2c1-f2cd-4aa4-b23f-e0f104b5658e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:27:37 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:27:37 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:27:37 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:27:37 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Acquiring lock "aa4cbd72-a11c-4dab-b2e2-29fe10493931" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lock "aa4cbd72-a11c-4dab-b2e2-29fe10493931" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:37 user nova-compute[72773]: INFO nova.compute.manager [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Attaching volume cd4f7346-d9ce-4561-9088-659ddc727c0a to /dev/sdc
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1df0b1-cfe0-47b8-95eb-5d293f7e71a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d, portal: 172.16.0.220,3260]
Aug 16 22:27:37 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d, portal: 172.16.0.220,3260] successful.
Aug 16 22:27:37 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8c5841-1b29-456d-a037-eec6aaf6095d]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1fa212-0a95-4965-a44d-43e41f9e854b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:27:37 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:27:37 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:27:37 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:27:37 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:27:37 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:27:37 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG os_brick.utils [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG os_brick.utils [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.115s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[336bb53e-3bfc-4a42-b0dc-425e0ef9aae0]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VrJFCIxz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e879f98-7abb-4e64-bd17-eafb4c2a9af9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1b3319-74cf-453f-9c44-44629b012d66]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a8acc7-f6f0-4848-9e17-47e8cffd01bd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed978fe6-6ea8-4a04-9dae-211e959eb929]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[04452492-35b9-4072-b36b-caccd5d5445d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[951540d7-b69e-49a7-9c87-096992b03f11]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb3f8af-46f9-4cbe-b89b-0833438e1a30]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[721825e2-c0b7-4119-a174-b0641186b458]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:27:37 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[56652381-9797-4d0a-8a08-016d262be542]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG os_brick.utils [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Updating existing volume attachment record: 6ddf8f08-d86e-4252-a432-0f9f715b3774 {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:27:37 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:27:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd16112-0671-4b54-b1b5-34d348429877]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG os_brick.utils [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] <== get_connector_properties: return (291ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:27:37 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Updating existing volume attachment record: bd0b705a-a54e-4c49-bffc-a16c8a6acd8e {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] <== connect_volume: return (1410ms) {'type': 'block', 'scsi_wwn': '26665656565363461', 'path': '/dev/sdd'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665656565363461', 'path': '/dev/sdd'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJPsTpKL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:27:38 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:27:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:27:38 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:27:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:27:38 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:27:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe9c301-38f5-4459-b0a7-c66aeb6be64a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:27:38 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0a5377-d6f8-4d1b-aeae-c5015069de26]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d] added
Aug 16 22:27:38 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7966a69d-a198-4cf7-93db-c9344e655634]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b571c6-a152-4c11-9ce0-d20d5e217ec0]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HJPsTpKL {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HJPsTpKL" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[606acf4c-6cbb-40ae-9ef0-8bfab490ac2e]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HJPsTpKL'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[13887d2f-a3bb-4214-ab64-a51bdbcc19f9]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbea1fe6-cebb-4a11-97b8-b3e84dda6c2c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:27:38 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:27:38 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:27:38 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:27:38 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:27:38 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:27:38 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[760e77ad-13ed-4856-87f4-c5702bc5441a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d, portal: 172.16.0.220,3260]
Aug 16 22:27:38 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d, portal: 172.16.0.220,3260] successful.
Aug 16 22:27:38 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4d26cb-05e6-47f4-acd8-ff4239dcc565]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea207d7-9135-4c31-8aa2-6d1d480c350d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:27:38 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:27:38 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:27:38 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:27:38 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:27:38 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:27:38 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:27:38 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:27:38 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1081a6-5d5b-4370-9511-cfcd8e7ece4d]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:27:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJPsTpKL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JFxefyzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:27:39 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:27:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23634366461333838', 'path': '/dev/sde'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634366461333838', 'path': '/dev/sde'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.140s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:27:39 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:27:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:27:39 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:27:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btrAaxGC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:27:39 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:27:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b4954e-34c8-4dbb-98e5-9c5395d9ef09]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:27:39 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7aed7d0-ef58-47fc-be60-396b0f63f5ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce] added
Aug 16 22:27:39 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9345db-1b22-4d4a-9018-9af8e25ebe8d]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c55188-ef80-4194-839c-5ceab878941f]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JFxefyzG {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JFxefyzG" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d807ddee-042e-4b64-a319-e221f4bce5ad]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JFxefyzG'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5fb4cf-c5f7-4edc-888c-c57237c0886c]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec87d544-9db9-4e45-9ed1-8ef1d7a1d344]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:27:39 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:27:39 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:27:39 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:27:39 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:27:39 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:27:39 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:27:39 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:27:39 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[82578f9e-7b30-4729-914c-7eff132c2706]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce, portal: 172.16.0.220,3260]
Aug 16 22:27:39 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce, portal: 172.16.0.220,3260] successful.
Aug 16 22:27:39 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22107a4-15ea-4cb5-96ff-964ceddf1954]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:40 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6d6a3c-b752-436b-afb2-390efbada00b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:40 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:27:40 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:27:40 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:27:40 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:27:40 user nova-compute[72773]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce (non-flash)
Aug 16 22:27:40 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:27:40 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:27:40 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:27:40 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:27:40 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:27:40 user nova-compute[72773]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce (non-flash)
Aug 16 22:27:40 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:27:40 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:27:40 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:27:40 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:27:40 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:27:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:40 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f41c1da-2c55-45a2-9882-cdfddaeb2a26]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:40 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:27:40 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JFxefyzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] <== connect_volume: return (1466ms) {'type': 'block', 'scsi_wwn': '26462313730313237', 'path': '/dev/sdf'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462313730313237', 'path': '/dev/sdf'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.302s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:27:41 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:27:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:27:41 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:27:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG nova.objects.instance [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Lazy-loading 'flavor' on Instance uuid 4387131d-7a86-477a-a231-69713b2d965d {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68bada3-65e6-42bb-9d1a-4c1b33b8f256]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:27:41 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[905d5801-406f-4420-9e43-d8a8bfb711c5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0] added
Aug 16 22:27:41 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] attach device xml: <disk type="block" device="disk">
Aug 16 22:27:41 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:27:41 user nova-compute[72773]:   <source dev="/dev/sdf"/>
Aug 16 22:27:41 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:27:41 user nova-compute[72773]:   <serial>662f1abb-c712-47b6-b09b-9d8a776ad8ce</serial>
Aug 16 22:27:41 user nova-compute[72773]: </disk>
Aug 16 22:27:41 user nova-compute[72773]:  {{(pid=72773) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4887eb2d-f4ad-4a45-b513-5aef1330f189]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c266110d-2504-4e41-9295-d3bc46b9fb28]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v btrAaxGC {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v btrAaxGC" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3fd199-3a20-49b2-8e0e-3eb55fdbab51]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'btrAaxGC'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ac7781-38fd-4fc7-8f90-773d3f988ae1]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] No VIF found with MAC fa:16:3e:30:86:c9, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9828d028-d2dc-4310-b339-66baa463ecc5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:27:41 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:27:41 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:27:41 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:27:41 user nova-compute[72773]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce (non-flash)
Aug 16 22:27:41 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:27:41 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:27:41 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:27:41 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:27:41 user nova-compute[72773]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce (non-flash)
Aug 16 22:27:41 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bc5984-6247-4e2b-989e-a37458f6169f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0, portal: 172.16.0.220,3260]
Aug 16 22:27:41 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0, portal: 172.16.0.220,3260] successful.
Aug 16 22:27:41 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bafbce-5802-41e2-b0c8-e6aa251806f4]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9d6485-82a8-4d85-8027-5b91442e7741]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:27:41 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:27:41 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:27:41 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:27:41 user nova-compute[72773]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce (non-flash)
Aug 16 22:27:41 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:27:41 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:27:41 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:27:41 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:27:41 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:27:41 user nova-compute[72773]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce (non-flash)
Aug 16 22:27:41 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:27:41 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.654s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae709c61-f9d9-4f41-8e15-fd16d4026ae4]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:27:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btrAaxGC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.689s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] <== connect_volume: return (2991ms) {'type': 'block', 'scsi_wwn': '26632343132323430', 'path': '/dev/sdg'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632343132323430', 'path': '/dev/sdg'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:26:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1052487575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1052487575',id=11,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMr61hRyHoiw7RLAcmFFbRkNzJ6KcXma/DRbPz67AtgnSN5y3RBjBLqcyKXMwTBi5sdTSeHxaM6LxiVQERZhG+rVcfO43p97rmIcySw2/GR43aK1f6KOgaRoN5sRtwVSVA==',key_name='tempest-keypair-1826579815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07a1fa6998aa4972a3335aa78398e667',ramdisk_id='',reservation_id='r-5u37r3nl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-186566092',owner_user_name='tempest-TaggedBootDevicesTest-186566092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:26:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='270300fb94e04ed5823a0eeab40a4703',uuid=df2acdf5-7c83-4129-8cab-da9882e1ac69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2f04ed7-213b-4297-a13d-ad99a922f878", "address": "fa:16:3e:ee:62:f5", "network": {"id": "78850332-7129-48d4-ad0f-222c6981d934", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-817612380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f04ed7-21", "ovs_interfaceid": "a2f04ed7-213b-4297-a13d-ad99a922f878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converting VIF {"id": "a2f04ed7-213b-4297-a13d-ad99a922f878", "address": "fa:16:3e:ee:62:f5", "network": {"id": "78850332-7129-48d4-ad0f-222c6981d934", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-817612380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f04ed7-21", "ovs_interfaceid": "a2f04ed7-213b-4297-a13d-ad99a922f878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:62:f5,bridge_name='br-int',has_traffic_filtering=True,id=a2f04ed7-213b-4297-a13d-ad99a922f878,network=Network(78850332-7129-48d4-ad0f-222c6981d934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2f04ed7-21') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:26:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1052487575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1052487575',id=11,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMr61hRyHoiw7RLAcmFFbRkNzJ6KcXma/DRbPz67AtgnSN5y3RBjBLqcyKXMwTBi5sdTSeHxaM6LxiVQERZhG+rVcfO43p97rmIcySw2/GR43aK1f6KOgaRoN5sRtwVSVA==',key_name='tempest-keypair-1826579815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07a1fa6998aa4972a3335aa78398e667',ramdisk_id='',reservation_id='r-5u37r3nl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-186566092',owner_user_name='tempest-TaggedBootDevicesTest-186566092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:26:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='270300fb94e04ed5823a0eeab40a4703',uuid=df2acdf5-7c83-4129-8cab-da9882e1ac69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "213a2da6-430b-4976-b5f0-a18d8494f42c", "address": "fa:16:3e:62:39:b6", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213a2da6-43", "ovs_interfaceid": "213a2da6-430b-4976-b5f0-a18d8494f42c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converting VIF {"id": "213a2da6-430b-4976-b5f0-a18d8494f42c", "address": "fa:16:3e:62:39:b6", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213a2da6-43", "ovs_interfaceid": "213a2da6-430b-4976-b5f0-a18d8494f42c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:39:b6,bridge_name='br-int',has_traffic_filtering=True,id=213a2da6-430b-4976-b5f0-a18d8494f42c,network=Network(a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap213a2da6-43') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:26:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1052487575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1052487575',id=11,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMr61hRyHoiw7RLAcmFFbRkNzJ6KcXma/DRbPz67AtgnSN5y3RBjBLqcyKXMwTBi5sdTSeHxaM6LxiVQERZhG+rVcfO43p97rmIcySw2/GR43aK1f6KOgaRoN5sRtwVSVA==',key_name='tempest-keypair-1826579815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07a1fa6998aa4972a3335aa78398e667',ramdisk_id='',reservation_id='r-5u37r3nl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-186566092',owner_user_name='tempest-TaggedBootDevicesTest-186566092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:26:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='270300fb94e04ed5823a0eeab40a4703',uuid=df2acdf5-7c83-4129-8cab-da9882e1ac69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c27765c1-ae78-4b0b-8abf-2514be5599a4", "address": "fa:16:3e:12:84:13", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc27765c1-ae", "ovs_interfaceid": "c27765c1-ae78-4b0b-8abf-2514be5599a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converting VIF {"id": "c27765c1-ae78-4b0b-8abf-2514be5599a4", "address": "fa:16:3e:12:84:13", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc27765c1-ae", "ovs_interfaceid": "c27765c1-ae78-4b0b-8abf-2514be5599a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:84:13,bridge_name='br-int',has_traffic_filtering=True,id=c27765c1-ae78-4b0b-8abf-2514be5599a4,network=Network(a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc27765c1-ae') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:26:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1052487575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1052487575',id=11,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMr61hRyHoiw7RLAcmFFbRkNzJ6KcXma/DRbPz67AtgnSN5y3RBjBLqcyKXMwTBi5sdTSeHxaM6LxiVQERZhG+rVcfO43p97rmIcySw2/GR43aK1f6KOgaRoN5sRtwVSVA==',key_name='tempest-keypair-1826579815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07a1fa6998aa4972a3335aa78398e667',ramdisk_id='',reservation_id='r-5u37r3nl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-186566092',owner_user_name='tempest-TaggedBootDevicesTest-186566092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:26:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='270300fb94e04ed5823a0eeab40a4703',uuid=df2acdf5-7c83-4129-8cab-da9882e1ac69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69942063-04a7-4cd3-87dd-42952e5fc667", "address": "fa:16:3e:8c:1b:60", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69942063-04", "ovs_interfaceid": "69942063-04a7-4cd3-87dd-42952e5fc667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converting VIF {"id": "69942063-04a7-4cd3-87dd-42952e5fc667", "address": "fa:16:3e:8c:1b:60", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69942063-04", "ovs_interfaceid": "69942063-04a7-4cd3-87dd-42952e5fc667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:1b:60,bridge_name='br-int',has_traffic_filtering=True,id=69942063-04a7-4cd3-87dd-42952e5fc667,network=Network(a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69942063-04') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:26:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1052487575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1052487575',id=11,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMr61hRyHoiw7RLAcmFFbRkNzJ6KcXma/DRbPz67AtgnSN5y3RBjBLqcyKXMwTBi5sdTSeHxaM6LxiVQERZhG+rVcfO43p97rmIcySw2/GR43aK1f6KOgaRoN5sRtwVSVA==',key_name='tempest-keypair-1826579815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07a1fa6998aa4972a3335aa78398e667',ramdisk_id='',reservation_id='r-5u37r3nl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-186566092',owner_user_name='tempest-TaggedBootDevicesTest-186566092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:26:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='270300fb94e04ed5823a0eeab40a4703',uuid=df2acdf5-7c83-4129-8cab-da9882e1ac69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38eab1de-142b-4f98-a91e-bea564b65757", "address": "fa:16:3e:a8:88:1c", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38eab1de-14", "ovs_interfaceid": "38eab1de-142b-4f98-a91e-bea564b65757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converting VIF {"id": "38eab1de-142b-4f98-a91e-bea564b65757", "address": "fa:16:3e:a8:88:1c", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38eab1de-14", "ovs_interfaceid": "38eab1de-142b-4f98-a91e-bea564b65757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:88:1c,bridge_name='br-int',has_traffic_filtering=True,id=38eab1de-142b-4f98-a91e-bea564b65757,network=Network(a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38eab1de-14') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:26:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1052487575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1052487575',id=11,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMr61hRyHoiw7RLAcmFFbRkNzJ6KcXma/DRbPz67AtgnSN5y3RBjBLqcyKXMwTBi5sdTSeHxaM6LxiVQERZhG+rVcfO43p97rmIcySw2/GR43aK1f6KOgaRoN5sRtwVSVA==',key_name='tempest-keypair-1826579815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07a1fa6998aa4972a3335aa78398e667',ramdisk_id='',reservation_id='r-5u37r3nl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-186566092',owner_user_name='tempest-TaggedBootDevicesTest-186566092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:26:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='270300fb94e04ed5823a0eeab40a4703',uuid=df2acdf5-7c83-4129-8cab-da9882e1ac69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f77f6c81-0377-4531-8c95-07be0a197bcc", "address": "fa:16:3e:f0:3c:4a", "network": {"id": "9e71d1ff-9a5b-4a29-ad7e-6b4da698415d", "bridge": "br-int", "label": "tempest-device-tagging-net2-584203226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f6c81-03", "ovs_interfaceid": "f77f6c81-0377-4531-8c95-07be0a197bcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converting VIF {"id": "f77f6c81-0377-4531-8c95-07be0a197bcc", "address": "fa:16:3e:f0:3c:4a", "network": {"id": "9e71d1ff-9a5b-4a29-ad7e-6b4da698415d", "bridge": "br-int", "label": "tempest-device-tagging-net2-584203226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f6c81-03", "ovs_interfaceid": "f77f6c81-0377-4531-8c95-07be0a197bcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:3c:4a,bridge_name='br-int',has_traffic_filtering=True,id=f77f6c81-0377-4531-8c95-07be0a197bcc,network=Network(9e71d1ff-9a5b-4a29-ad7e-6b4da698415d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf77f6c81-03') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:26:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1052487575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1052487575',id=11,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMr61hRyHoiw7RLAcmFFbRkNzJ6KcXma/DRbPz67AtgnSN5y3RBjBLqcyKXMwTBi5sdTSeHxaM6LxiVQERZhG+rVcfO43p97rmIcySw2/GR43aK1f6KOgaRoN5sRtwVSVA==',key_name='tempest-keypair-1826579815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07a1fa6998aa4972a3335aa78398e667',ramdisk_id='',reservation_id='r-5u37r3nl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-186566092',owner_user_name='tempest-TaggedBootDevicesTest-186566092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:26:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='270300fb94e04ed5823a0eeab40a4703',uuid=df2acdf5-7c83-4129-8cab-da9882e1ac69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b07374e-822f-4550-bcf1-c0259ca3624b", "address": "fa:16:3e:5f:15:a3", "network": {"id": "9e71d1ff-9a5b-4a29-ad7e-6b4da698415d", "bridge": "br-int", "label": "tempest-device-tagging-net2-584203226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b07374e-82", "ovs_interfaceid": "4b07374e-822f-4550-bcf1-c0259ca3624b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converting VIF {"id": "4b07374e-822f-4550-bcf1-c0259ca3624b", "address": "fa:16:3e:5f:15:a3", "network": {"id": "9e71d1ff-9a5b-4a29-ad7e-6b4da698415d", "bridge": "br-int", "label": "tempest-device-tagging-net2-584203226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b07374e-82", "ovs_interfaceid": "4b07374e-822f-4550-bcf1-c0259ca3624b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:15:a3,bridge_name='br-int',has_traffic_filtering=True,id=4b07374e-822f-4550-bcf1-c0259ca3624b,network=Network(9e71d1ff-9a5b-4a29-ad7e-6b4da698415d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b07374e-82') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.objects.instance [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Lazy-loading 'pci_devices' on Instance uuid df2acdf5-7c83-4129-8cab-da9882e1ac69 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:27:42 user nova-compute[72773]:   <uuid>df2acdf5-7c83-4129-8cab-da9882e1ac69</uuid>
Aug 16 22:27:42 user nova-compute[72773]:   <name>instance-0000000b</name>
Aug 16 22:27:42 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:27:42 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:27:42 user nova-compute[72773]:   <metadata>
Aug 16 22:27:42 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:27:42 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:27:42 user nova-compute[72773]:       <nova:name>tempest-device-tagging-server-1052487575</nova:name>
Aug 16 22:27:42 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:27:36</nova:creationTime>
Aug 16 22:27:42 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:27:42 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:27:42 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:27:42 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:27:42 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:27:42 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:27:42 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:27:42 user nova-compute[72773]:       <nova:owner>
Aug 16 22:27:42 user nova-compute[72773]:         <nova:user uuid="270300fb94e04ed5823a0eeab40a4703">tempest-TaggedBootDevicesTest-186566092-project-member</nova:user>
Aug 16 22:27:42 user nova-compute[72773]:         <nova:project uuid="07a1fa6998aa4972a3335aa78398e667">tempest-TaggedBootDevicesTest-186566092</nova:project>
Aug 16 22:27:42 user nova-compute[72773]:       </nova:owner>
Aug 16 22:27:42 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:27:42 user nova-compute[72773]:       <nova:ports>
Aug 16 22:27:42 user nova-compute[72773]:         <nova:port uuid="a2f04ed7-213b-4297-a13d-ad99a922f878">
Aug 16 22:27:42 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 22:27:42 user nova-compute[72773]:         </nova:port>
Aug 16 22:27:42 user nova-compute[72773]:         <nova:port uuid="213a2da6-430b-4976-b5f0-a18d8494f42c">
Aug 16 22:27:42 user nova-compute[72773]:           <nova:ip type="fixed" address="10.1.1.178" ipVersion="4"/>
Aug 16 22:27:42 user nova-compute[72773]:         </nova:port>
Aug 16 22:27:42 user nova-compute[72773]:         <nova:port uuid="c27765c1-ae78-4b0b-8abf-2514be5599a4">
Aug 16 22:27:42 user nova-compute[72773]:           <nova:ip type="fixed" address="10.1.1.177" ipVersion="4"/>
Aug 16 22:27:42 user nova-compute[72773]:         </nova:port>
Aug 16 22:27:42 user nova-compute[72773]:         <nova:port uuid="69942063-04a7-4cd3-87dd-42952e5fc667">
Aug 16 22:27:42 user nova-compute[72773]:           <nova:ip type="fixed" address="10.1.1.152" ipVersion="4"/>
Aug 16 22:27:42 user nova-compute[72773]:         </nova:port>
Aug 16 22:27:42 user nova-compute[72773]:         <nova:port uuid="38eab1de-142b-4f98-a91e-bea564b65757">
Aug 16 22:27:42 user nova-compute[72773]:           <nova:ip type="fixed" address="10.1.1.116" ipVersion="4"/>
Aug 16 22:27:42 user nova-compute[72773]:         </nova:port>
Aug 16 22:27:42 user nova-compute[72773]:         <nova:port uuid="f77f6c81-0377-4531-8c95-07be0a197bcc">
Aug 16 22:27:42 user nova-compute[72773]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 16 22:27:42 user nova-compute[72773]:         </nova:port>
Aug 16 22:27:42 user nova-compute[72773]:         <nova:port uuid="4b07374e-822f-4550-bcf1-c0259ca3624b">
Aug 16 22:27:42 user nova-compute[72773]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 16 22:27:42 user nova-compute[72773]:         </nova:port>
Aug 16 22:27:42 user nova-compute[72773]:       </nova:ports>
Aug 16 22:27:42 user nova-compute[72773]:     </nova:instance>
Aug 16 22:27:42 user nova-compute[72773]:   </metadata>
Aug 16 22:27:42 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:27:42 user nova-compute[72773]:     <system>
Aug 16 22:27:42 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:27:42 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:27:42 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:27:42 user nova-compute[72773]:       <entry name="serial">df2acdf5-7c83-4129-8cab-da9882e1ac69</entry>
Aug 16 22:27:42 user nova-compute[72773]:       <entry name="uuid">df2acdf5-7c83-4129-8cab-da9882e1ac69</entry>
Aug 16 22:27:42 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:27:42 user nova-compute[72773]:     </system>
Aug 16 22:27:42 user nova-compute[72773]:   </sysinfo>
Aug 16 22:27:42 user nova-compute[72773]:   <os>
Aug 16 22:27:42 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:27:42 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:27:42 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:27:42 user nova-compute[72773]:   </os>
Aug 16 22:27:42 user nova-compute[72773]:   <features>
Aug 16 22:27:42 user nova-compute[72773]:     <acpi/>
Aug 16 22:27:42 user nova-compute[72773]:     <apic/>
Aug 16 22:27:42 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:27:42 user nova-compute[72773]:   </features>
Aug 16 22:27:42 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:27:42 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:27:42 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:27:42 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:27:42 user nova-compute[72773]:   </clock>
Aug 16 22:27:42 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:27:42 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:27:42 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:27:42 user nova-compute[72773]:   </cpu>
Aug 16 22:27:42 user nova-compute[72773]:   <devices>
Aug 16 22:27:42 user nova-compute[72773]:     <disk type="file" device="cdrom">
Aug 16 22:27:42 user nova-compute[72773]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 22:27:42 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/df2acdf5-7c83-4129-8cab-da9882e1ac69/disk.config"/>
Aug 16 22:27:42 user nova-compute[72773]:       <target dev="hda" bus="ide"/>
Aug 16 22:27:42 user nova-compute[72773]:     </disk>
Aug 16 22:27:42 user nova-compute[72773]:     <disk type="block" device="disk">
Aug 16 22:27:42 user nova-compute[72773]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:27:42 user nova-compute[72773]:       <source dev="/dev/sdd"/>
Aug 16 22:27:42 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:27:42 user nova-compute[72773]:       <serial>ffd4a5d3-43a9-42f6-9e81-78036352413d</serial>
Aug 16 22:27:42 user nova-compute[72773]:     </disk>
Aug 16 22:27:42 user nova-compute[72773]:     <disk type="block" device="disk">
Aug 16 22:27:42 user nova-compute[72773]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:27:42 user nova-compute[72773]:       <source dev="/dev/sde"/>
Aug 16 22:27:42 user nova-compute[72773]:       <target dev="vdb" bus="virtio"/>
Aug 16 22:27:42 user nova-compute[72773]:       <serial>c8469fb8-1df6-4bb2-be19-7878c4d4cd9d</serial>
Aug 16 22:27:42 user nova-compute[72773]:     </disk>
Aug 16 22:27:42 user nova-compute[72773]:     <disk type="block" device="disk">
Aug 16 22:27:42 user nova-compute[72773]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:27:42 user nova-compute[72773]:       <source dev="/dev/sdg"/>
Aug 16 22:27:42 user nova-compute[72773]:       <target dev="vdc" bus="virtio"/>
Aug 16 22:27:42 user nova-compute[72773]:       <serial>423d5c85-4fe4-454e-9164-709647d701f0</serial>
Aug 16 22:27:42 user nova-compute[72773]:     </disk>
Aug 16 22:27:42 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:27:42 user nova-compute[72773]:       <mac address="fa:16:3e:ee:62:f5"/>
Aug 16 22:27:42 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:27:42 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:27:42 user nova-compute[72773]:       <target dev="tapa2f04ed7-21"/>
Aug 16 22:27:42 user nova-compute[72773]:     </interface>
Aug 16 22:27:42 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:27:42 user nova-compute[72773]:       <mac address="fa:16:3e:62:39:b6"/>
Aug 16 22:27:42 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:27:42 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:27:42 user nova-compute[72773]:       <target dev="tap213a2da6-43"/>
Aug 16 22:27:42 user nova-compute[72773]:     </interface>
Aug 16 22:27:42 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:27:42 user nova-compute[72773]:       <mac address="fa:16:3e:12:84:13"/>
Aug 16 22:27:42 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:27:42 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:27:42 user nova-compute[72773]:       <target dev="tapc27765c1-ae"/>
Aug 16 22:27:42 user nova-compute[72773]:     </interface>
Aug 16 22:27:42 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:27:42 user nova-compute[72773]:       <mac address="fa:16:3e:8c:1b:60"/>
Aug 16 22:27:42 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:27:42 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:27:42 user nova-compute[72773]:       <target dev="tap69942063-04"/>
Aug 16 22:27:42 user nova-compute[72773]:     </interface>
Aug 16 22:27:42 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:27:42 user nova-compute[72773]:       <mac address="fa:16:3e:a8:88:1c"/>
Aug 16 22:27:42 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:27:42 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:27:42 user nova-compute[72773]:       <target dev="tap38eab1de-14"/>
Aug 16 22:27:42 user nova-compute[72773]:     </interface>
Aug 16 22:27:42 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:27:42 user nova-compute[72773]:       <mac address="fa:16:3e:f0:3c:4a"/>
Aug 16 22:27:42 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:27:42 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:27:42 user nova-compute[72773]:       <target dev="tapf77f6c81-03"/>
Aug 16 22:27:42 user nova-compute[72773]:     </interface>
Aug 16 22:27:42 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:27:42 user nova-compute[72773]:       <mac address="fa:16:3e:5f:15:a3"/>
Aug 16 22:27:42 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:27:42 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:27:42 user nova-compute[72773]:       <target dev="tap4b07374e-82"/>
Aug 16 22:27:42 user nova-compute[72773]:     </interface>
Aug 16 22:27:42 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:27:42 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/df2acdf5-7c83-4129-8cab-da9882e1ac69/console.log" append="off"/>
Aug 16 22:27:42 user nova-compute[72773]:     </serial>
Aug 16 22:27:42 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:27:42 user nova-compute[72773]:     <video>
Aug 16 22:27:42 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:27:42 user nova-compute[72773]:     </video>
Aug 16 22:27:42 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:27:42 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:27:42 user nova-compute[72773]:     </rng>
Aug 16 22:27:42 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:27:42 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:27:42 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:27:42 user nova-compute[72773]:     </memballoon>
Aug 16 22:27:42 user nova-compute[72773]:   </devices>
Aug 16 22:27:42 user nova-compute[72773]: </domain>
Aug 16 22:27:42 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:26:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1052487575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1052487575',id=11,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMr61hRyHoiw7RLAcmFFbRkNzJ6KcXma/DRbPz67AtgnSN5y3RBjBLqcyKXMwTBi5sdTSeHxaM6LxiVQERZhG+rVcfO43p97rmIcySw2/GR43aK1f6KOgaRoN5sRtwVSVA==',key_name='tempest-keypair-1826579815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07a1fa6998aa4972a3335aa78398e667',ramdisk_id='',reservation_id='r-5u37r3nl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-186566092',owner_user_name='tempest-TaggedBootDevicesTest-186566092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:26:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='270300fb94e04ed5823a0eeab40a4703',uuid=df2acdf5-7c83-4129-8cab-da9882e1ac69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2f04ed7-213b-4297-a13d-ad99a922f878", "address": "fa:16:3e:ee:62:f5", "network": {"id": "78850332-7129-48d4-ad0f-222c6981d934", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-817612380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f04ed7-21", "ovs_interfaceid": "a2f04ed7-213b-4297-a13d-ad99a922f878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converting VIF {"id": "a2f04ed7-213b-4297-a13d-ad99a922f878", "address": "fa:16:3e:ee:62:f5", "network": {"id": "78850332-7129-48d4-ad0f-222c6981d934", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-817612380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f04ed7-21", "ovs_interfaceid": "a2f04ed7-213b-4297-a13d-ad99a922f878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:62:f5,bridge_name='br-int',has_traffic_filtering=True,id=a2f04ed7-213b-4297-a13d-ad99a922f878,network=Network(78850332-7129-48d4-ad0f-222c6981d934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2f04ed7-21') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG os_vif [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:62:f5,bridge_name='br-int',has_traffic_filtering=True,id=a2f04ed7-213b-4297-a13d-ad99a922f878,network=Network(78850332-7129-48d4-ad0f-222c6981d934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2f04ed7-21') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2f04ed7-21, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa2f04ed7-21, col_values=(('external_ids', {'iface-id': 'a2f04ed7-213b-4297-a13d-ad99a922f878', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:62:f5', 'vm-uuid': 'df2acdf5-7c83-4129-8cab-da9882e1ac69'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:42 user nova-compute[72773]: INFO os_vif [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:62:f5,bridge_name='br-int',has_traffic_filtering=True,id=a2f04ed7-213b-4297-a13d-ad99a922f878,network=Network(78850332-7129-48d4-ad0f-222c6981d934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2f04ed7-21')
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:26:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1052487575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1052487575',id=11,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMr61hRyHoiw7RLAcmFFbRkNzJ6KcXma/DRbPz67AtgnSN5y3RBjBLqcyKXMwTBi5sdTSeHxaM6LxiVQERZhG+rVcfO43p97rmIcySw2/GR43aK1f6KOgaRoN5sRtwVSVA==',key_name='tempest-keypair-1826579815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07a1fa6998aa4972a3335aa78398e667',ramdisk_id='',reservation_id='r-5u37r3nl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-186566092',owner_user_name='tempest-TaggedBootDevicesTest-186566092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:26:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='270300fb94e04ed5823a0eeab40a4703',uuid=df2acdf5-7c83-4129-8cab-da9882e1ac69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "213a2da6-430b-4976-b5f0-a18d8494f42c", "address": "fa:16:3e:62:39:b6", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213a2da6-43", "ovs_interfaceid": "213a2da6-430b-4976-b5f0-a18d8494f42c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converting VIF {"id": "213a2da6-430b-4976-b5f0-a18d8494f42c", "address": "fa:16:3e:62:39:b6", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213a2da6-43", "ovs_interfaceid": "213a2da6-430b-4976-b5f0-a18d8494f42c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:39:b6,bridge_name='br-int',has_traffic_filtering=True,id=213a2da6-430b-4976-b5f0-a18d8494f42c,network=Network(a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap213a2da6-43') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG os_vif [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:39:b6,bridge_name='br-int',has_traffic_filtering=True,id=213a2da6-430b-4976-b5f0-a18d8494f42c,network=Network(a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap213a2da6-43') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap213a2da6-43, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap213a2da6-43, col_values=(('external_ids', {'iface-id': '213a2da6-430b-4976-b5f0-a18d8494f42c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:39:b6', 'vm-uuid': 'df2acdf5-7c83-4129-8cab-da9882e1ac69'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:42 user nova-compute[72773]: INFO os_vif [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:39:b6,bridge_name='br-int',has_traffic_filtering=True,id=213a2da6-430b-4976-b5f0-a18d8494f42c,network=Network(a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap213a2da6-43')
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:26:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1052487575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1052487575',id=11,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMr61hRyHoiw7RLAcmFFbRkNzJ6KcXma/DRbPz67AtgnSN5y3RBjBLqcyKXMwTBi5sdTSeHxaM6LxiVQERZhG+rVcfO43p97rmIcySw2/GR43aK1f6KOgaRoN5sRtwVSVA==',key_name='tempest-keypair-1826579815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07a1fa6998aa4972a3335aa78398e667',ramdisk_id='',reservation_id='r-5u37r3nl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-186566092',owner_user_name='tempest-TaggedBootDevicesTest-186566092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:26:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='270300fb94e04ed5823a0eeab40a4703',uuid=df2acdf5-7c83-4129-8cab-da9882e1ac69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c27765c1-ae78-4b0b-8abf-2514be5599a4", "address": "fa:16:3e:12:84:13", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc27765c1-ae", "ovs_interfaceid": "c27765c1-ae78-4b0b-8abf-2514be5599a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converting VIF {"id": "c27765c1-ae78-4b0b-8abf-2514be5599a4", "address": "fa:16:3e:12:84:13", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc27765c1-ae", "ovs_interfaceid": "c27765c1-ae78-4b0b-8abf-2514be5599a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:84:13,bridge_name='br-int',has_traffic_filtering=True,id=c27765c1-ae78-4b0b-8abf-2514be5599a4,network=Network(a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc27765c1-ae') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG os_vif [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:84:13,bridge_name='br-int',has_traffic_filtering=True,id=c27765c1-ae78-4b0b-8abf-2514be5599a4,network=Network(a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc27765c1-ae') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc27765c1-ae, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc27765c1-ae, col_values=(('external_ids', {'iface-id': 'c27765c1-ae78-4b0b-8abf-2514be5599a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:84:13', 'vm-uuid': 'df2acdf5-7c83-4129-8cab-da9882e1ac69'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:42 user nova-compute[72773]: INFO os_vif [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:84:13,bridge_name='br-int',has_traffic_filtering=True,id=c27765c1-ae78-4b0b-8abf-2514be5599a4,network=Network(a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc27765c1-ae')
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:26:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1052487575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1052487575',id=11,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMr61hRyHoiw7RLAcmFFbRkNzJ6KcXma/DRbPz67AtgnSN5y3RBjBLqcyKXMwTBi5sdTSeHxaM6LxiVQERZhG+rVcfO43p97rmIcySw2/GR43aK1f6KOgaRoN5sRtwVSVA==',key_name='tempest-keypair-1826579815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07a1fa6998aa4972a3335aa78398e667',ramdisk_id='',reservation_id='r-5u37r3nl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-186566092',owner_user_name='tempest-TaggedBootDevicesTest-186566092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:26:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='270300fb94e04ed5823a0eeab40a4703',uuid=df2acdf5-7c83-4129-8cab-da9882e1ac69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69942063-04a7-4cd3-87dd-42952e5fc667", "address": "fa:16:3e:8c:1b:60", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69942063-04", "ovs_interfaceid": "69942063-04a7-4cd3-87dd-42952e5fc667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converting VIF {"id": "69942063-04a7-4cd3-87dd-42952e5fc667", "address": "fa:16:3e:8c:1b:60", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69942063-04", "ovs_interfaceid": "69942063-04a7-4cd3-87dd-42952e5fc667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:1b:60,bridge_name='br-int',has_traffic_filtering=True,id=69942063-04a7-4cd3-87dd-42952e5fc667,network=Network(a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69942063-04') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG os_vif [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:1b:60,bridge_name='br-int',has_traffic_filtering=True,id=69942063-04a7-4cd3-87dd-42952e5fc667,network=Network(a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69942063-04') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69942063-04, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap69942063-04, col_values=(('external_ids', {'iface-id': '69942063-04a7-4cd3-87dd-42952e5fc667', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:1b:60', 'vm-uuid': 'df2acdf5-7c83-4129-8cab-da9882e1ac69'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:42 user nova-compute[72773]: INFO os_vif [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:1b:60,bridge_name='br-int',has_traffic_filtering=True,id=69942063-04a7-4cd3-87dd-42952e5fc667,network=Network(a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69942063-04')
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:26:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1052487575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1052487575',id=11,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMr61hRyHoiw7RLAcmFFbRkNzJ6KcXma/DRbPz67AtgnSN5y3RBjBLqcyKXMwTBi5sdTSeHxaM6LxiVQERZhG+rVcfO43p97rmIcySw2/GR43aK1f6KOgaRoN5sRtwVSVA==',key_name='tempest-keypair-1826579815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07a1fa6998aa4972a3335aa78398e667',ramdisk_id='',reservation_id='r-5u37r3nl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-186566092',owner_user_name='tempest-TaggedBootDevicesTest-186566092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:26:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='270300fb94e04ed5823a0eeab40a4703',uuid=df2acdf5-7c83-4129-8cab-da9882e1ac69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38eab1de-142b-4f98-a91e-bea564b65757", "address": "fa:16:3e:a8:88:1c", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38eab1de-14", "ovs_interfaceid": "38eab1de-142b-4f98-a91e-bea564b65757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converting VIF {"id": "38eab1de-142b-4f98-a91e-bea564b65757", "address": "fa:16:3e:a8:88:1c", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38eab1de-14", "ovs_interfaceid": "38eab1de-142b-4f98-a91e-bea564b65757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:88:1c,bridge_name='br-int',has_traffic_filtering=True,id=38eab1de-142b-4f98-a91e-bea564b65757,network=Network(a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38eab1de-14') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG os_vif [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:88:1c,bridge_name='br-int',has_traffic_filtering=True,id=38eab1de-142b-4f98-a91e-bea564b65757,network=Network(a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38eab1de-14') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38eab1de-14, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap38eab1de-14, col_values=(('external_ids', {'iface-id': '38eab1de-142b-4f98-a91e-bea564b65757', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:88:1c', 'vm-uuid': 'df2acdf5-7c83-4129-8cab-da9882e1ac69'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:42 user nova-compute[72773]: INFO os_vif [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:88:1c,bridge_name='br-int',has_traffic_filtering=True,id=38eab1de-142b-4f98-a91e-bea564b65757,network=Network(a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38eab1de-14')
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:26:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1052487575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1052487575',id=11,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMr61hRyHoiw7RLAcmFFbRkNzJ6KcXma/DRbPz67AtgnSN5y3RBjBLqcyKXMwTBi5sdTSeHxaM6LxiVQERZhG+rVcfO43p97rmIcySw2/GR43aK1f6KOgaRoN5sRtwVSVA==',key_name='tempest-keypair-1826579815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07a1fa6998aa4972a3335aa78398e667',ramdisk_id='',reservation_id='r-5u37r3nl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-186566092',owner_user_name='tempest-TaggedBootDevicesTest-186566092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:26:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='270300fb94e04ed5823a0eeab40a4703',uuid=df2acdf5-7c83-4129-8cab-da9882e1ac69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f77f6c81-0377-4531-8c95-07be0a197bcc", "address": "fa:16:3e:f0:3c:4a", "network": {"id": "9e71d1ff-9a5b-4a29-ad7e-6b4da698415d", "bridge": "br-int", "label": "tempest-device-tagging-net2-584203226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f6c81-03", "ovs_interfaceid": "f77f6c81-0377-4531-8c95-07be0a197bcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converting VIF {"id": "f77f6c81-0377-4531-8c95-07be0a197bcc", "address": "fa:16:3e:f0:3c:4a", "network": {"id": "9e71d1ff-9a5b-4a29-ad7e-6b4da698415d", "bridge": "br-int", "label": "tempest-device-tagging-net2-584203226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f6c81-03", "ovs_interfaceid": "f77f6c81-0377-4531-8c95-07be0a197bcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:3c:4a,bridge_name='br-int',has_traffic_filtering=True,id=f77f6c81-0377-4531-8c95-07be0a197bcc,network=Network(9e71d1ff-9a5b-4a29-ad7e-6b4da698415d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf77f6c81-03') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG os_vif [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:3c:4a,bridge_name='br-int',has_traffic_filtering=True,id=f77f6c81-0377-4531-8c95-07be0a197bcc,network=Network(9e71d1ff-9a5b-4a29-ad7e-6b4da698415d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf77f6c81-03') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf77f6c81-03, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf77f6c81-03, col_values=(('external_ids', {'iface-id': 'f77f6c81-0377-4531-8c95-07be0a197bcc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:3c:4a', 'vm-uuid': 'df2acdf5-7c83-4129-8cab-da9882e1ac69'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:27:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:43 user nova-compute[72773]: INFO os_vif [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:3c:4a,bridge_name='br-int',has_traffic_filtering=True,id=f77f6c81-0377-4531-8c95-07be0a197bcc,network=Network(9e71d1ff-9a5b-4a29-ad7e-6b4da698415d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf77f6c81-03')
Aug 16 22:27:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:26:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1052487575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1052487575',id=11,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMr61hRyHoiw7RLAcmFFbRkNzJ6KcXma/DRbPz67AtgnSN5y3RBjBLqcyKXMwTBi5sdTSeHxaM6LxiVQERZhG+rVcfO43p97rmIcySw2/GR43aK1f6KOgaRoN5sRtwVSVA==',key_name='tempest-keypair-1826579815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07a1fa6998aa4972a3335aa78398e667',ramdisk_id='',reservation_id='r-5u37r3nl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-186566092',owner_user_name='tempest-TaggedBootDevicesTest-186566092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:26:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='270300fb94e04ed5823a0eeab40a4703',uuid=df2acdf5-7c83-4129-8cab-da9882e1ac69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b07374e-822f-4550-bcf1-c0259ca3624b", "address": "fa:16:3e:5f:15:a3", "network": {"id": "9e71d1ff-9a5b-4a29-ad7e-6b4da698415d", "bridge": "br-int", "label": "tempest-device-tagging-net2-584203226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b07374e-82", "ovs_interfaceid": "4b07374e-822f-4550-bcf1-c0259ca3624b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:27:43 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converting VIF {"id": "4b07374e-822f-4550-bcf1-c0259ca3624b", "address": "fa:16:3e:5f:15:a3", "network": {"id": "9e71d1ff-9a5b-4a29-ad7e-6b4da698415d", "bridge": "br-int", "label": "tempest-device-tagging-net2-584203226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b07374e-82", "ovs_interfaceid": "4b07374e-822f-4550-bcf1-c0259ca3624b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:27:43 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:15:a3,bridge_name='br-int',has_traffic_filtering=True,id=4b07374e-822f-4550-bcf1-c0259ca3624b,network=Network(9e71d1ff-9a5b-4a29-ad7e-6b4da698415d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b07374e-82') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:27:43 user nova-compute[72773]: DEBUG os_vif [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:15:a3,bridge_name='br-int',has_traffic_filtering=True,id=4b07374e-822f-4550-bcf1-c0259ca3624b,network=Network(9e71d1ff-9a5b-4a29-ad7e-6b4da698415d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b07374e-82') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:27:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:27:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:27:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b07374e-82, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:27:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4b07374e-82, col_values=(('external_ids', {'iface-id': '4b07374e-822f-4550-bcf1-c0259ca3624b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:15:a3', 'vm-uuid': 'df2acdf5-7c83-4129-8cab-da9882e1ac69'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:27:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:27:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:43 user nova-compute[72773]: INFO os_vif [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:15:a3,bridge_name='br-int',has_traffic_filtering=True,id=4b07374e-822f-4550-bcf1-c0259ca3624b,network=Network(9e71d1ff-9a5b-4a29-ad7e-6b4da698415d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b07374e-82')
Aug 16 22:27:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] No BDM found with device name hda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:27:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:27:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] No VIF found with MAC fa:16:3e:ee:62:f5, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:27:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] No VIF found with MAC fa:16:3e:a8:88:1c, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:27:43 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Using config drive
Aug 16 22:27:43 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Creating config drive at /opt/stack/data/nova/instances/df2acdf5-7c83-4129-8cab-da9882e1ac69/disk.config
Aug 16 22:27:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/df2acdf5-7c83-4129-8cab-da9882e1ac69/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpwp3qomyd {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/df2acdf5-7c83-4129-8cab-da9882e1ac69/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpwp3qomyd" returned: 0 in 0.055s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:43 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:27:43 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:27:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:44 user nova-compute[72773]: DEBUG nova.compute.manager [req-5b4597be-ce3c-487e-832d-773d5a098fc8 req-cf1a97c7-266d-4863-97fd-916e4b436fa9 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-plugged-a2f04ed7-213b-4297-a13d-ad99a922f878 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:27:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5b4597be-ce3c-487e-832d-773d5a098fc8 req-cf1a97c7-266d-4863-97fd-916e4b436fa9 service nova] Acquiring lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5b4597be-ce3c-487e-832d-773d5a098fc8 req-cf1a97c7-266d-4863-97fd-916e4b436fa9 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5b4597be-ce3c-487e-832d-773d5a098fc8 req-cf1a97c7-266d-4863-97fd-916e4b436fa9 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:44 user nova-compute[72773]: DEBUG nova.compute.manager [req-5b4597be-ce3c-487e-832d-773d5a098fc8 req-cf1a97c7-266d-4863-97fd-916e4b436fa9 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] No waiting events found dispatching network-vif-plugged-a2f04ed7-213b-4297-a13d-ad99a922f878 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:27:44 user nova-compute[72773]: WARNING nova.compute.manager [req-5b4597be-ce3c-487e-832d-773d5a098fc8 req-cf1a97c7-266d-4863-97fd-916e4b436fa9 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received unexpected event network-vif-plugged-a2f04ed7-213b-4297-a13d-ad99a922f878 for instance with vm_state building and task_state spawning.
Aug 16 22:27:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:45 user nova-compute[72773]: DEBUG nova.compute.manager [req-fe876b6c-c3a5-4330-9e8f-9107075aa1d0 req-2bbb5c0f-1fcc-42b7-b992-768a67d14677 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-plugged-213a2da6-430b-4976-b5f0-a18d8494f42c {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:27:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fe876b6c-c3a5-4330-9e8f-9107075aa1d0 req-2bbb5c0f-1fcc-42b7-b992-768a67d14677 service nova] Acquiring lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fe876b6c-c3a5-4330-9e8f-9107075aa1d0 req-2bbb5c0f-1fcc-42b7-b992-768a67d14677 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fe876b6c-c3a5-4330-9e8f-9107075aa1d0 req-2bbb5c0f-1fcc-42b7-b992-768a67d14677 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:45 user nova-compute[72773]: DEBUG nova.compute.manager [req-fe876b6c-c3a5-4330-9e8f-9107075aa1d0 req-2bbb5c0f-1fcc-42b7-b992-768a67d14677 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] No waiting events found dispatching network-vif-plugged-213a2da6-430b-4976-b5f0-a18d8494f42c {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:27:45 user nova-compute[72773]: WARNING nova.compute.manager [req-fe876b6c-c3a5-4330-9e8f-9107075aa1d0 req-2bbb5c0f-1fcc-42b7-b992-768a67d14677 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received unexpected event network-vif-plugged-213a2da6-430b-4976-b5f0-a18d8494f42c for instance with vm_state building and task_state spawning.
Aug 16 22:27:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:45 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:27:45 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:27:45 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:27:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:45 user nova-compute[72773]: DEBUG nova.compute.manager [req-d3972620-121a-48a5-a0d4-557fa0f0c68f req-6537f4ca-ef74-4e0f-8f94-a28bd91c76a4 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-plugged-c27765c1-ae78-4b0b-8abf-2514be5599a4 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:27:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d3972620-121a-48a5-a0d4-557fa0f0c68f req-6537f4ca-ef74-4e0f-8f94-a28bd91c76a4 service nova] Acquiring lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d3972620-121a-48a5-a0d4-557fa0f0c68f req-6537f4ca-ef74-4e0f-8f94-a28bd91c76a4 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d3972620-121a-48a5-a0d4-557fa0f0c68f req-6537f4ca-ef74-4e0f-8f94-a28bd91c76a4 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:45 user nova-compute[72773]: DEBUG nova.compute.manager [req-d3972620-121a-48a5-a0d4-557fa0f0c68f req-6537f4ca-ef74-4e0f-8f94-a28bd91c76a4 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] No waiting events found dispatching network-vif-plugged-c27765c1-ae78-4b0b-8abf-2514be5599a4 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:27:45 user nova-compute[72773]: WARNING nova.compute.manager [req-d3972620-121a-48a5-a0d4-557fa0f0c68f req-6537f4ca-ef74-4e0f-8f94-a28bd91c76a4 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received unexpected event network-vif-plugged-c27765c1-ae78-4b0b-8abf-2514be5599a4 for instance with vm_state building and task_state spawning.
Aug 16 22:27:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-4efab321-f2aa-456c-a1ae-b32f399f694d" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-4efab321-f2aa-456c-a1ae-b32f399f694d" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG nova.compute.manager [req-78c3c92e-48b5-4fc6-aa6a-d4d10e3e1759 req-7858028f-25d0-4cde-b66f-a3fad2e2039f service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-plugged-a2f04ed7-213b-4297-a13d-ad99a922f878 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-78c3c92e-48b5-4fc6-aa6a-d4d10e3e1759 req-7858028f-25d0-4cde-b66f-a3fad2e2039f service nova] Acquiring lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-78c3c92e-48b5-4fc6-aa6a-d4d10e3e1759 req-7858028f-25d0-4cde-b66f-a3fad2e2039f service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-78c3c92e-48b5-4fc6-aa6a-d4d10e3e1759 req-7858028f-25d0-4cde-b66f-a3fad2e2039f service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG nova.compute.manager [req-78c3c92e-48b5-4fc6-aa6a-d4d10e3e1759 req-7858028f-25d0-4cde-b66f-a3fad2e2039f service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] No waiting events found dispatching network-vif-plugged-a2f04ed7-213b-4297-a13d-ad99a922f878 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:27:46 user nova-compute[72773]: WARNING nova.compute.manager [req-78c3c92e-48b5-4fc6-aa6a-d4d10e3e1759 req-7858028f-25d0-4cde-b66f-a3fad2e2039f service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received unexpected event network-vif-plugged-a2f04ed7-213b-4297-a13d-ad99a922f878 for instance with vm_state building and task_state spawning.
Aug 16 22:27:46 user nova-compute[72773]: DEBUG nova.compute.manager [req-78c3c92e-48b5-4fc6-aa6a-d4d10e3e1759 req-7858028f-25d0-4cde-b66f-a3fad2e2039f service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-plugged-69942063-04a7-4cd3-87dd-42952e5fc667 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-78c3c92e-48b5-4fc6-aa6a-d4d10e3e1759 req-7858028f-25d0-4cde-b66f-a3fad2e2039f service nova] Acquiring lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-78c3c92e-48b5-4fc6-aa6a-d4d10e3e1759 req-7858028f-25d0-4cde-b66f-a3fad2e2039f service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-78c3c92e-48b5-4fc6-aa6a-d4d10e3e1759 req-7858028f-25d0-4cde-b66f-a3fad2e2039f service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG nova.compute.manager [req-78c3c92e-48b5-4fc6-aa6a-d4d10e3e1759 req-7858028f-25d0-4cde-b66f-a3fad2e2039f service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] No waiting events found dispatching network-vif-plugged-69942063-04a7-4cd3-87dd-42952e5fc667 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:27:46 user nova-compute[72773]: WARNING nova.compute.manager [req-78c3c92e-48b5-4fc6-aa6a-d4d10e3e1759 req-7858028f-25d0-4cde-b66f-a3fad2e2039f service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received unexpected event network-vif-plugged-69942063-04a7-4cd3-87dd-42952e5fc667 for instance with vm_state building and task_state spawning.
Aug 16 22:27:46 user nova-compute[72773]: DEBUG nova.compute.manager [req-78c3c92e-48b5-4fc6-aa6a-d4d10e3e1759 req-7858028f-25d0-4cde-b66f-a3fad2e2039f service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-plugged-69942063-04a7-4cd3-87dd-42952e5fc667 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-78c3c92e-48b5-4fc6-aa6a-d4d10e3e1759 req-7858028f-25d0-4cde-b66f-a3fad2e2039f service nova] Acquiring lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-78c3c92e-48b5-4fc6-aa6a-d4d10e3e1759 req-7858028f-25d0-4cde-b66f-a3fad2e2039f service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-78c3c92e-48b5-4fc6-aa6a-d4d10e3e1759 req-7858028f-25d0-4cde-b66f-a3fad2e2039f service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG nova.compute.manager [req-78c3c92e-48b5-4fc6-aa6a-d4d10e3e1759 req-7858028f-25d0-4cde-b66f-a3fad2e2039f service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] No waiting events found dispatching network-vif-plugged-69942063-04a7-4cd3-87dd-42952e5fc667 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:27:46 user nova-compute[72773]: WARNING nova.compute.manager [req-78c3c92e-48b5-4fc6-aa6a-d4d10e3e1759 req-7858028f-25d0-4cde-b66f-a3fad2e2039f service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received unexpected event network-vif-plugged-69942063-04a7-4cd3-87dd-42952e5fc667 for instance with vm_state building and task_state spawning.
Aug 16 22:27:46 user nova-compute[72773]: DEBUG nova.compute.manager [req-78c3c92e-48b5-4fc6-aa6a-d4d10e3e1759 req-7858028f-25d0-4cde-b66f-a3fad2e2039f service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-plugged-f77f6c81-0377-4531-8c95-07be0a197bcc {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-78c3c92e-48b5-4fc6-aa6a-d4d10e3e1759 req-7858028f-25d0-4cde-b66f-a3fad2e2039f service nova] Acquiring lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-78c3c92e-48b5-4fc6-aa6a-d4d10e3e1759 req-7858028f-25d0-4cde-b66f-a3fad2e2039f service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-78c3c92e-48b5-4fc6-aa6a-d4d10e3e1759 req-7858028f-25d0-4cde-b66f-a3fad2e2039f service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:46 user nova-compute[72773]: DEBUG nova.compute.manager [req-78c3c92e-48b5-4fc6-aa6a-d4d10e3e1759 req-7858028f-25d0-4cde-b66f-a3fad2e2039f service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] No waiting events found dispatching network-vif-plugged-f77f6c81-0377-4531-8c95-07be0a197bcc {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:27:46 user nova-compute[72773]: WARNING nova.compute.manager [req-78c3c92e-48b5-4fc6-aa6a-d4d10e3e1759 req-7858028f-25d0-4cde-b66f-a3fad2e2039f service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received unexpected event network-vif-plugged-f77f6c81-0377-4531-8c95-07be0a197bcc for instance with vm_state building and task_state spawning.
Aug 16 22:27:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Updating instance_info_cache with network_info: [{"id": "94d9c8c3-7857-42d7-8e92-2b983bdd3dc6", "address": "fa:16:3e:05:f5:f1", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d9c8c3-78", "ovs_interfaceid": "94d9c8c3-7857-42d7-8e92-2b983bdd3dc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-4efab321-f2aa-456c-a1ae-b32f399f694d" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG nova.compute.manager [req-1938f3da-5f1a-4746-92dc-4c726076919e req-848200f3-d72f-400e-a085-72f210045de5 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-plugged-213a2da6-430b-4976-b5f0-a18d8494f42c {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-1938f3da-5f1a-4746-92dc-4c726076919e req-848200f3-d72f-400e-a085-72f210045de5 service nova] Acquiring lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-1938f3da-5f1a-4746-92dc-4c726076919e req-848200f3-d72f-400e-a085-72f210045de5 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-1938f3da-5f1a-4746-92dc-4c726076919e req-848200f3-d72f-400e-a085-72f210045de5 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG nova.compute.manager [req-1938f3da-5f1a-4746-92dc-4c726076919e req-848200f3-d72f-400e-a085-72f210045de5 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] No waiting events found dispatching network-vif-plugged-213a2da6-430b-4976-b5f0-a18d8494f42c {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:27:47 user nova-compute[72773]: WARNING nova.compute.manager [req-1938f3da-5f1a-4746-92dc-4c726076919e req-848200f3-d72f-400e-a085-72f210045de5 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received unexpected event network-vif-plugged-213a2da6-430b-4976-b5f0-a18d8494f42c for instance with vm_state building and task_state spawning.
Aug 16 22:27:47 user nova-compute[72773]: DEBUG nova.compute.manager [req-1938f3da-5f1a-4746-92dc-4c726076919e req-848200f3-d72f-400e-a085-72f210045de5 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-plugged-38eab1de-142b-4f98-a91e-bea564b65757 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-1938f3da-5f1a-4746-92dc-4c726076919e req-848200f3-d72f-400e-a085-72f210045de5 service nova] Acquiring lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-1938f3da-5f1a-4746-92dc-4c726076919e req-848200f3-d72f-400e-a085-72f210045de5 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-1938f3da-5f1a-4746-92dc-4c726076919e req-848200f3-d72f-400e-a085-72f210045de5 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG nova.compute.manager [req-1938f3da-5f1a-4746-92dc-4c726076919e req-848200f3-d72f-400e-a085-72f210045de5 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] No waiting events found dispatching network-vif-plugged-38eab1de-142b-4f98-a91e-bea564b65757 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:27:47 user nova-compute[72773]: WARNING nova.compute.manager [req-1938f3da-5f1a-4746-92dc-4c726076919e req-848200f3-d72f-400e-a085-72f210045de5 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received unexpected event network-vif-plugged-38eab1de-142b-4f98-a91e-bea564b65757 for instance with vm_state building and task_state spawning.
Aug 16 22:27:47 user nova-compute[72773]: DEBUG nova.compute.manager [req-1938f3da-5f1a-4746-92dc-4c726076919e req-848200f3-d72f-400e-a085-72f210045de5 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-plugged-38eab1de-142b-4f98-a91e-bea564b65757 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-1938f3da-5f1a-4746-92dc-4c726076919e req-848200f3-d72f-400e-a085-72f210045de5 service nova] Acquiring lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-1938f3da-5f1a-4746-92dc-4c726076919e req-848200f3-d72f-400e-a085-72f210045de5 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-1938f3da-5f1a-4746-92dc-4c726076919e req-848200f3-d72f-400e-a085-72f210045de5 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG nova.compute.manager [req-1938f3da-5f1a-4746-92dc-4c726076919e req-848200f3-d72f-400e-a085-72f210045de5 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] No waiting events found dispatching network-vif-plugged-38eab1de-142b-4f98-a91e-bea564b65757 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:27:47 user nova-compute[72773]: WARNING nova.compute.manager [req-1938f3da-5f1a-4746-92dc-4c726076919e req-848200f3-d72f-400e-a085-72f210045de5 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received unexpected event network-vif-plugged-38eab1de-142b-4f98-a91e-bea564b65757 for instance with vm_state building and task_state spawning.
Aug 16 22:27:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG nova.compute.manager [req-21b5bd3f-f257-4a1e-ba86-f5243918cb98 req-4f34e84e-27b7-4397-aeac-fa914d6b6c5c service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-plugged-c27765c1-ae78-4b0b-8abf-2514be5599a4 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-21b5bd3f-f257-4a1e-ba86-f5243918cb98 req-4f34e84e-27b7-4397-aeac-fa914d6b6c5c service nova] Acquiring lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-21b5bd3f-f257-4a1e-ba86-f5243918cb98 req-4f34e84e-27b7-4397-aeac-fa914d6b6c5c service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-21b5bd3f-f257-4a1e-ba86-f5243918cb98 req-4f34e84e-27b7-4397-aeac-fa914d6b6c5c service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG nova.compute.manager [req-21b5bd3f-f257-4a1e-ba86-f5243918cb98 req-4f34e84e-27b7-4397-aeac-fa914d6b6c5c service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] No waiting events found dispatching network-vif-plugged-c27765c1-ae78-4b0b-8abf-2514be5599a4 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:27:47 user nova-compute[72773]: WARNING nova.compute.manager [req-21b5bd3f-f257-4a1e-ba86-f5243918cb98 req-4f34e84e-27b7-4397-aeac-fa914d6b6c5c service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received unexpected event network-vif-plugged-c27765c1-ae78-4b0b-8abf-2514be5599a4 for instance with vm_state building and task_state spawning.
Aug 16 22:27:47 user nova-compute[72773]: DEBUG nova.compute.manager [req-21b5bd3f-f257-4a1e-ba86-f5243918cb98 req-4f34e84e-27b7-4397-aeac-fa914d6b6c5c service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-plugged-4b07374e-822f-4550-bcf1-c0259ca3624b {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-21b5bd3f-f257-4a1e-ba86-f5243918cb98 req-4f34e84e-27b7-4397-aeac-fa914d6b6c5c service nova] Acquiring lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-21b5bd3f-f257-4a1e-ba86-f5243918cb98 req-4f34e84e-27b7-4397-aeac-fa914d6b6c5c service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-21b5bd3f-f257-4a1e-ba86-f5243918cb98 req-4f34e84e-27b7-4397-aeac-fa914d6b6c5c service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG nova.compute.manager [req-21b5bd3f-f257-4a1e-ba86-f5243918cb98 req-4f34e84e-27b7-4397-aeac-fa914d6b6c5c service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] No waiting events found dispatching network-vif-plugged-4b07374e-822f-4550-bcf1-c0259ca3624b {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:27:47 user nova-compute[72773]: WARNING nova.compute.manager [req-21b5bd3f-f257-4a1e-ba86-f5243918cb98 req-4f34e84e-27b7-4397-aeac-fa914d6b6c5c service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received unexpected event network-vif-plugged-4b07374e-822f-4550-bcf1-c0259ca3624b for instance with vm_state building and task_state spawning.
Aug 16 22:27:47 user nova-compute[72773]: DEBUG nova.compute.manager [req-21b5bd3f-f257-4a1e-ba86-f5243918cb98 req-4f34e84e-27b7-4397-aeac-fa914d6b6c5c service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-plugged-4b07374e-822f-4550-bcf1-c0259ca3624b {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-21b5bd3f-f257-4a1e-ba86-f5243918cb98 req-4f34e84e-27b7-4397-aeac-fa914d6b6c5c service nova] Acquiring lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-21b5bd3f-f257-4a1e-ba86-f5243918cb98 req-4f34e84e-27b7-4397-aeac-fa914d6b6c5c service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-21b5bd3f-f257-4a1e-ba86-f5243918cb98 req-4f34e84e-27b7-4397-aeac-fa914d6b6c5c service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG nova.compute.manager [req-21b5bd3f-f257-4a1e-ba86-f5243918cb98 req-4f34e84e-27b7-4397-aeac-fa914d6b6c5c service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] No waiting events found dispatching network-vif-plugged-4b07374e-822f-4550-bcf1-c0259ca3624b {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:27:47 user nova-compute[72773]: WARNING nova.compute.manager [req-21b5bd3f-f257-4a1e-ba86-f5243918cb98 req-4f34e84e-27b7-4397-aeac-fa914d6b6c5c service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received unexpected event network-vif-plugged-4b07374e-822f-4550-bcf1-c0259ca3624b for instance with vm_state building and task_state spawning.
Aug 16 22:27:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:48 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224868.8957653, df2acdf5-7c83-4129-8cab-da9882e1ac69 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:27:48 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] VM Resumed (Lifecycle Event)
Aug 16 22:27:48 user nova-compute[72773]: DEBUG nova.compute.manager [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:27:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:27:48 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Instance spawned successfully.
Aug 16 22:27:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:27:48 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:27:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:27:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:27:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:27:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:27:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:27:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:27:48 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:27:48 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:27:48 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224868.8980262, df2acdf5-7c83-4129-8cab-da9882e1ac69 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:27:48 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] VM Started (Lifecycle Event)
Aug 16 22:27:49 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:27:49 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:27:49 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:27:49 user nova-compute[72773]: INFO nova.compute.manager [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Took 12.18 seconds to spawn the instance on the hypervisor.
Aug 16 22:27:49 user nova-compute[72773]: DEBUG nova.compute.manager [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:27:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbfa3908-7c4c-4c7d-a04f-672a8c52ca89/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:49 user nova-compute[72773]: DEBUG nova.compute.manager [req-2864e4d8-1c3b-4f9b-8c90-80be4e2c8ac7 req-6d983ae3-e527-4004-8ed8-3160144f53de service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-plugged-f77f6c81-0377-4531-8c95-07be0a197bcc {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:27:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2864e4d8-1c3b-4f9b-8c90-80be4e2c8ac7 req-6d983ae3-e527-4004-8ed8-3160144f53de service nova] Acquiring lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2864e4d8-1c3b-4f9b-8c90-80be4e2c8ac7 req-6d983ae3-e527-4004-8ed8-3160144f53de service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2864e4d8-1c3b-4f9b-8c90-80be4e2c8ac7 req-6d983ae3-e527-4004-8ed8-3160144f53de service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:49 user nova-compute[72773]: DEBUG nova.compute.manager [req-2864e4d8-1c3b-4f9b-8c90-80be4e2c8ac7 req-6d983ae3-e527-4004-8ed8-3160144f53de service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] No waiting events found dispatching network-vif-plugged-f77f6c81-0377-4531-8c95-07be0a197bcc {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:27:49 user nova-compute[72773]: WARNING nova.compute.manager [req-2864e4d8-1c3b-4f9b-8c90-80be4e2c8ac7 req-6d983ae3-e527-4004-8ed8-3160144f53de service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received unexpected event network-vif-plugged-f77f6c81-0377-4531-8c95-07be0a197bcc for instance with vm_state building and task_state spawning.
Aug 16 22:27:49 user nova-compute[72773]: INFO nova.compute.manager [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Took 64.62 seconds to build instance.
Aug 16 22:27:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b4a99bba-07e8-46cd-be5e-8ef33107d69d tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 64.715s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbfa3908-7c4c-4c7d-a04f-672a8c52ca89/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbfa3908-7c4c-4c7d-a04f-672a8c52ca89/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbfa3908-7c4c-4c7d-a04f-672a8c52ca89/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbb196d-e352-47a5-86fb-a819723c2ce8/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbb196d-e352-47a5-86fb-a819723c2ce8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbb196d-e352-47a5-86fb-a819723c2ce8/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbb196d-e352-47a5-86fb-a819723c2ce8/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "030d076d-5099-4236-ae31-6025017eb51e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "030d076d-5099-4236-ae31-6025017eb51e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:49 user nova-compute[72773]: DEBUG nova.compute.manager [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:27:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:50 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:27:50 user nova-compute[72773]: INFO nova.compute.claims [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Claim successful on node user
Aug 16 22:27:50 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:50 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:50 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:50 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:50 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:27:50 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:50 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:50 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:27:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.507s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:50 user nova-compute[72773]: DEBUG nova.compute.manager [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:27:50 user nova-compute[72773]: DEBUG nova.compute.manager [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:27:50 user nova-compute[72773]: DEBUG nova.network.neutron [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:27:50 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:27:50 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:50 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:27:50 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:50 user nova-compute[72773]: DEBUG nova.compute.manager [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:27:50 user nova-compute[72773]: DEBUG nova.policy [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '42e8c8d0806e45ed9d1126aad24a034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f496354017e467e9b7a537c73248fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:27:50 user nova-compute[72773]: INFO nova.virt.block_device [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Booting with blank volume at /dev/vda
Aug 16 22:27:50 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:50 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4387131d-7a86-477a-a231-69713b2d965d/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4387131d-7a86-477a-a231-69713b2d965d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4387131d-7a86-477a-a231-69713b2d965d/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG nova.network.neutron [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Successfully created port: bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EnRLvJAG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:27:51 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:27:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:27:51 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:27:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:27:51 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6e2732-81dc-4b73-83e9-3959062a55ca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:27:51 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d957cbe-a850-4c78-9a76-6545feedde8c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede] added
Aug 16 22:27:51 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[671c4a02-6b7d-4bdd-bdee-7bf763a277be]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f382216e-9a11-4611-8843-28cdc21ee753]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EnRLvJAG {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4387131d-7a86-477a-a231-69713b2d965d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa4cbd72-a11c-4dab-b2e2-29fe10493931/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EnRLvJAG" returned: 0 in 0.026s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f1eaf6-fcf1-416c-aff4-7198138ef454]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EnRLvJAG'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0542e008-a94f-406e-949b-63c15fb7893c]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3ab415-75d5-4e22-a27a-7885e655d7da]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:27:51 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:27:51 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:27:51 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:27:51 user nova-compute[72773]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce (non-flash)
Aug 16 22:27:51 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:27:51 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:27:51 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:27:51 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:27:51 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:27:51 user nova-compute[72773]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce (non-flash)
Aug 16 22:27:51 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:27:51 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b59eb4-d988-4c32-b330-a794e8ce6362]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede, portal: 172.16.0.220,3260]
Aug 16 22:27:51 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede, portal: 172.16.0.220,3260] successful.
Aug 16 22:27:51 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa4cbd72-a11c-4dab-b2e2-29fe10493931/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa4cbd72-a11c-4dab-b2e2-29fe10493931/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49f92c9-c5de-4aee-ad69-365a1c6ab4f9]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[02190cfe-5479-4ba8-9827-ee7eb7ca5c75]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:27:51 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:27:51 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:27:51 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:27:51 user nova-compute[72773]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce (non-flash)
Aug 16 22:27:51 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:27:51 user nova-compute[72773]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede (non-flash)
Aug 16 22:27:51 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:27:51 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:27:51 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:27:51 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:27:51 user nova-compute[72773]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce (non-flash)
Aug 16 22:27:51 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:27:51 user nova-compute[72773]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede (non-flash)
Aug 16 22:27:51 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.441s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.027s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[325accce-65ff-4898-8374-fce14e1fc4ec]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EnRLvJAG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e43a9e03-046b-4579-8901-15e478257114 tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Lock "4387131d-7a86-477a-a231-69713b2d965d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 41.024s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa4cbd72-a11c-4dab-b2e2-29fe10493931/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:27:52 user nova-compute[72773]: DEBUG nova.network.neutron [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Successfully updated port: bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:27:52 user nova-compute[72773]: DEBUG nova.compute.manager [req-39d6577e-df26-4eba-aacf-0b4135e87ff5 req-b859b460-2e5a-4057-b9f7-f497e457ad10 service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Received event network-changed-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:27:52 user nova-compute[72773]: DEBUG nova.compute.manager [req-39d6577e-df26-4eba-aacf-0b4135e87ff5 req-b859b460-2e5a-4057-b9f7-f497e457ad10 service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Refreshing instance network info cache due to event network-changed-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:27:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-39d6577e-df26-4eba-aacf-0b4135e87ff5 req-b859b460-2e5a-4057-b9f7-f497e457ad10 service nova] Acquiring lock "refresh_cache-030d076d-5099-4236-ae31-6025017eb51e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:27:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-39d6577e-df26-4eba-aacf-0b4135e87ff5 req-b859b460-2e5a-4057-b9f7-f497e457ad10 service nova] Acquired lock "refresh_cache-030d076d-5099-4236-ae31-6025017eb51e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:27:52 user nova-compute[72773]: DEBUG nova.network.neutron [req-39d6577e-df26-4eba-aacf-0b4135e87ff5 req-b859b460-2e5a-4057-b9f7-f497e457ad10 service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Refreshing network info cache for port bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:27:52 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:27:52 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:27:52 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=7484MB free_disk=25.8248291015625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:27:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "refresh_cache-030d076d-5099-4236-ae31-6025017eb51e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:27:52 user nova-compute[72773]: DEBUG nova.network.neutron [req-39d6577e-df26-4eba-aacf-0b4135e87ff5 req-b859b460-2e5a-4057-b9f7-f497e457ad10 service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:27:52 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 956d334e-f190-4625-b144-ab44d2f3321a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:27:52 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 4efab321-f2aa-456c-a1ae-b32f399f694d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:27:52 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 4387131d-7a86-477a-a231-69713b2d965d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:27:52 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance c6adfa95-47ac-40d3-abc1-0c6027507f07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:27:52 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance aa4cbd72-a11c-4dab-b2e2-29fe10493931 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:27:52 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 8bbb196d-e352-47a5-86fb-a819723c2ce8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:27:52 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 2c1c948f-c541-41ea-ba51-23ff78d1c0db actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:27:52 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance dbfa3908-7c4c-4c7d-a04f-672a8c52ca89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:27:52 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance df2acdf5-7c83-4129-8cab-da9882e1ac69 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:27:52 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 030d076d-5099-4236-ae31-6025017eb51e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:27:52 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:27:52 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:27:52 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.512s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:27:52 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] <== connect_volume: return (1513ms) {'type': 'block', 'scsi_wwn': '23735303335376236', 'path': '/dev/sdh'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:27:52 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735303335376236', 'path': '/dev/sdh'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:27:52 user nova-compute[72773]: DEBUG nova.objects.instance [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lazy-loading 'flavor' on Instance uuid c6adfa95-47ac-40d3-abc1-0c6027507f07 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:27:52 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 22:27:52 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:27:52 user nova-compute[72773]:   <source dev="/dev/sdh"/>
Aug 16 22:27:52 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:27:52 user nova-compute[72773]:   <serial>72cbff1f-2142-4f5c-9fae-ee21f058aede</serial>
Aug 16 22:27:52 user nova-compute[72773]: </disk>
Aug 16 22:27:52 user nova-compute[72773]:  {{(pid=72773) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 22:27:52 user nova-compute[72773]: DEBUG nova.network.neutron [req-39d6577e-df26-4eba-aacf-0b4135e87ff5 req-b859b460-2e5a-4057-b9f7-f497e457ad10 service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:27:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-39d6577e-df26-4eba-aacf-0b4135e87ff5 req-b859b460-2e5a-4057-b9f7-f497e457ad10 service nova] Releasing lock "refresh_cache-030d076d-5099-4236-ae31-6025017eb51e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:27:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquired lock "refresh_cache-030d076d-5099-4236-ae31-6025017eb51e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:27:52 user nova-compute[72773]: DEBUG nova.network.neutron [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:27:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ca5619a1-4a86-47bf-b784-b44ccf4acc0a tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] [instance: 4387131d-7a86-477a-a231-69713b2d965d] volume_snapshot_create: create_info: {'snapshot_id': '831d6f4a-094e-4842-a601-1848b59eadb9', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=72773) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 16 22:27:53 user nova-compute[72773]: DEBUG nova.network.neutron [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:27:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ca5619a1-4a86-47bf-b784-b44ccf4acc0a tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] [instance: 4387131d-7a86-477a-a231-69713b2d965d] snap xml: <domainsnapshot>
Aug 16 22:27:53 user nova-compute[72773]:   <disks>
Aug 16 22:27:53 user nova-compute[72773]:     <disk name="/dev/sdf" snapshot="external" type="file">
Aug 16 22:27:53 user nova-compute[72773]:       <source file="/dev/new_file"/>
Aug 16 22:27:53 user nova-compute[72773]:     </disk>
Aug 16 22:27:53 user nova-compute[72773]:     <disk name="vda" snapshot="no"/>
Aug 16 22:27:53 user nova-compute[72773]:   </disks>
Aug 16 22:27:53 user nova-compute[72773]: </domainsnapshot>
Aug 16 22:27:53 user nova-compute[72773]:  {{(pid=72773) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 16 22:27:53 user nova-compute[72773]: DEBUG nova.objects.instance [None req-ca5619a1-4a86-47bf-b784-b44ccf4acc0a tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Lazy-loading 'system_metadata' on Instance uuid 4387131d-7a86-477a-a231-69713b2d965d {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:27:53 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-ca5619a1-4a86-47bf-b784-b44ccf4acc0a tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [None req-ca5619a1-4a86-47bf-b784-b44ccf4acc0a tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d] Traceback (most recent call last):
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]     rv = execute(f, *args, **kwargs)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]     six.reraise(c, e, tb)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]     raise value
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]     rv = meth(*args, **kwargs)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d] 
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [None req-ca5619a1-4a86-47bf-b784-b44ccf4acc0a tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d] Traceback (most recent call last):
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]     self._volume_snapshot_create(context, instance, guest,
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]     rv = execute(f, *args, **kwargs)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]     six.reraise(c, e, tb)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]     raise value
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]     rv = meth(*args, **kwargs)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d] 
Aug 16 22:27:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7a348cb6-9526-4516-835e-0586ff4709eb tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] [instance: 4387131d-7a86-477a-a231-69713b2d965d] volume_snapshot_delete: delete_info: {'volume_id': '662f1abb-c712-47b6-b09b-9d8a776ad8ce'} {{(pid=72773) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [None req-7a348cb6-9526-4516-835e-0586ff4709eb tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d] Traceback (most recent call last):
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d]     if delete_info['type'] != 'qcow2':
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d] KeyError: 'type'
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [instance: 4387131d-7a86-477a-a231-69713b2d965d] 
Aug 16 22:27:53 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:27:53 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [None req-ca5619a1-4a86-47bf-b784-b44ccf4acc0a tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 831d6f4a-094e-4842-a601-1848b59eadb9 could not be found.
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     raise value
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver 
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver 
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 831d6f4a-094e-4842-a601-1848b59eadb9 could not be found. (HTTP 404) (Request-ID: req-b60d95c4-c4ee-403c-a24a-7ab7c2cb72a4)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver 
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver 
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 831d6f4a-094e-4842-a601-1848b59eadb9 could not be found.
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver 
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server [None req-ca5619a1-4a86-47bf-b784-b44ccf4acc0a tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server     raise value
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server 
Aug 16 22:27:53 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:27:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.715s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver [None req-7a348cb6-9526-4516-835e-0586ff4709eb tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver 
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver 
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-65ee2239-d04f-4fda-b7a0-f355e1747dc0)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver 
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver 
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 16 22:27:53 user nova-compute[72773]: ERROR nova.virt.libvirt.driver 
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server [None req-7a348cb6-9526-4516-835e-0586ff4709eb tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Exception during message handling: KeyError: 'type'
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 16 22:27:53 user nova-compute[72773]: ERROR oslo_messaging.rpc.server 
Aug 16 22:27:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:27:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:27:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] No VIF found with MAC fa:16:3e:55:99:4d, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:27:53 user nova-compute[72773]: DEBUG nova.network.neutron [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Updating instance_info_cache with network_info: [{"id": "bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c", "address": "fa:16:3e:27:b6:2b", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc3b07d-2b", "ovs_interfaceid": "bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:27:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Releasing lock "refresh_cache-030d076d-5099-4236-ae31-6025017eb51e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:27:53 user nova-compute[72773]: DEBUG nova.compute.manager [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Instance network_info: |[{"id": "bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c", "address": "fa:16:3e:27:b6:2b", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc3b07d-2b", "ovs_interfaceid": "bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:27:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-aad0dec8-7142-46ab-8ab5-40bbb3b898cd tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "c6adfa95-47ac-40d3-abc1-0c6027507f07" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 38.105s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-965d3998-dc50-462c-91b1-7d84c9c7e4aa tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Acquiring lock "4387131d-7a86-477a-a231-69713b2d965d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-965d3998-dc50-462c-91b1-7d84c9c7e4aa tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Lock "4387131d-7a86-477a-a231-69713b2d965d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:53 user nova-compute[72773]: INFO nova.compute.manager [None req-965d3998-dc50-462c-91b1-7d84c9c7e4aa tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Detaching volume 662f1abb-c712-47b6-b09b-9d8a776ad8ce
Aug 16 22:27:54 user nova-compute[72773]: INFO nova.virt.block_device [None req-965d3998-dc50-462c-91b1-7d84c9c7e4aa tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Attempting to driver detach volume 662f1abb-c712-47b6-b09b-9d8a776ad8ce from mountpoint /dev/vdb
Aug 16 22:27:54 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-965d3998-dc50-462c-91b1-7d84c9c7e4aa tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Attempting to detach device vdb from instance 4387131d-7a86-477a-a231-69713b2d965d from the persistent domain config. {{(pid=72773) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-965d3998-dc50-462c-91b1-7d84c9c7e4aa tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] detach device xml: <disk type="block" device="disk">
Aug 16 22:27:54 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:27:54 user nova-compute[72773]:   <source dev="/dev/sdf"/>
Aug 16 22:27:54 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:27:54 user nova-compute[72773]:   <serial>662f1abb-c712-47b6-b09b-9d8a776ad8ce</serial>
Aug 16 22:27:54 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:27:54 user nova-compute[72773]: </disk>
Aug 16 22:27:54 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:27:54 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-965d3998-dc50-462c-91b1-7d84c9c7e4aa tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Successfully detached device vdb from instance 4387131d-7a86-477a-a231-69713b2d965d from the persistent domain config.
Aug 16 22:27:54 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-965d3998-dc50-462c-91b1-7d84c9c7e4aa tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4387131d-7a86-477a-a231-69713b2d965d from the live domain config. {{(pid=72773) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-965d3998-dc50-462c-91b1-7d84c9c7e4aa tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] detach device xml: <disk type="block" device="disk">
Aug 16 22:27:54 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:27:54 user nova-compute[72773]:   <source dev="/dev/sdf"/>
Aug 16 22:27:54 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:27:54 user nova-compute[72773]:   <serial>662f1abb-c712-47b6-b09b-9d8a776ad8ce</serial>
Aug 16 22:27:54 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:27:54 user nova-compute[72773]: </disk>
Aug 16 22:27:54 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Received event <DeviceRemovedEvent: 1692224874.7184772, 4387131d-7a86-477a-a231-69713b2d965d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72773) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-965d3998-dc50-462c-91b1-7d84c9c7e4aa tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4387131d-7a86-477a-a231-69713b2d965d {{(pid=72773) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 22:27:54 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-965d3998-dc50-462c-91b1-7d84c9c7e4aa tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Successfully detached device vdb from instance 4387131d-7a86-477a-a231-69713b2d965d from the live domain config.
Aug 16 22:27:54 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-965d3998-dc50-462c-91b1-7d84c9c7e4aa tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] [instance: 4387131d-7a86-477a-a231-69713b2d965d] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-965d3998-dc50-462c-91b1-7d84c9c7e4aa tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JFxefyzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:27:54 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-965d3998-dc50-462c-91b1-7d84c9c7e4aa tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:27:54 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-965d3998-dc50-462c-91b1-7d84c9c7e4aa tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-965d3998-dc50-462c-91b1-7d84c9c7e4aa tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-965d3998-dc50-462c-91b1-7d84c9c7e4aa tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[da40c873-815a-4863-a71f-136b5a81d5c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cccdcb4-e2cf-4ccc-b41b-e43e21358052]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-965d3998-dc50-462c-91b1-7d84c9c7e4aa tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:27:54 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:27:54 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:27:54 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:27:54 user nova-compute[72773]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce (non-flash)
Aug 16 22:27:54 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:27:54 user nova-compute[72773]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede (non-flash)
Aug 16 22:27:54 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-965d3998-dc50-462c-91b1-7d84c9c7e4aa tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:27:54 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:27:54 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:27:54 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:27:54 user nova-compute[72773]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce (non-flash)
Aug 16 22:27:54 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:27:54 user nova-compute[72773]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede (non-flash)
Aug 16 22:27:54 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-965d3998-dc50-462c-91b1-7d84c9c7e4aa tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef5c587250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce'): ({'sdf'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-965d3998-dc50-462c-91b1-7d84c9c7e4aa tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Removing single pathed devices sdf {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1b6e5c-f7f0-41b7-80f8-8485059f9d07]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea306ee-b0c0-4585-8b6c-bbac3fe79ff7]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-965d3998-dc50-462c-91b1-7d84c9c7e4aa tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Flushing IO for device /dev/sdf {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0a7ef7-22e9-49a3-85ff-37cb7bf454b1]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-965d3998-dc50-462c-91b1-7d84c9c7e4aa tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.065s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff59bc4-bd2e-4748-ba1c-0d29c688b9f2]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-965d3998-dc50-462c-91b1-7d84c9c7e4aa tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-965d3998-dc50-462c-91b1-7d84c9c7e4aa tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] SCSI volumes sdf have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-965d3998-dc50-462c-91b1-7d84c9c7e4aa tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6e1a13-8eac-4a37-a212-fef31e150ce3]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:54 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-965d3998-dc50-462c-91b1-7d84c9c7e4aa tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3110a8c9-f57d-4bfa-bad4-dc9125ae2321 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Acquiring lock "c6adfa95-47ac-40d3-abc1-0c6027507f07" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3110a8c9-f57d-4bfa-bad4-dc9125ae2321 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "c6adfa95-47ac-40d3-abc1-0c6027507f07" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1389b7-7fb4-45e2-be8f-343b7f1b5ec8]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-965d3998-dc50-462c-91b1-7d84c9c7e4aa tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce, portal: 172.16.0.220,3260]
Aug 16 22:27:55 user nova-compute[72773]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce, portal: 172.16.0.220,3260] successful.
Aug 16 22:27:55 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:55 user nova-compute[72773]: INFO nova.compute.manager [None req-3110a8c9-f57d-4bfa-bad4-dc9125ae2321 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Detaching volume 72cbff1f-2142-4f5c-9fae-ee21f058aede
Aug 16 22:27:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:662f1abb-c712-47b6-b09b-9d8a776ad8ce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[155dac74-fcab-4691-805b-da92b2aa926d]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-965d3998-dc50-462c-91b1-7d84c9c7e4aa tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-965d3998-dc50-462c-91b1-7d84c9c7e4aa tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-965d3998-dc50-462c-91b1-7d84c9c7e4aa tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] <== disconnect_volume: return (402ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-965d3998-dc50-462c-91b1-7d84c9c7e4aa tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:27:55 user nova-compute[72773]: INFO nova.virt.block_device [None req-3110a8c9-f57d-4bfa-bad4-dc9125ae2321 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Attempting to driver detach volume 72cbff1f-2142-4f5c-9fae-ee21f058aede from mountpoint /dev/vdb
Aug 16 22:27:55 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-3110a8c9-f57d-4bfa-bad4-dc9125ae2321 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Attempting to detach device vdb from instance c6adfa95-47ac-40d3-abc1-0c6027507f07 from the persistent domain config. {{(pid=72773) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-3110a8c9-f57d-4bfa-bad4-dc9125ae2321 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:27:55 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:27:55 user nova-compute[72773]:   <source dev="/dev/sdh"/>
Aug 16 22:27:55 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:27:55 user nova-compute[72773]:   <serial>72cbff1f-2142-4f5c-9fae-ee21f058aede</serial>
Aug 16 22:27:55 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:27:55 user nova-compute[72773]: </disk>
Aug 16 22:27:55 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:27:55 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-3110a8c9-f57d-4bfa-bad4-dc9125ae2321 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Successfully detached device vdb from instance c6adfa95-47ac-40d3-abc1-0c6027507f07 from the persistent domain config.
Aug 16 22:27:55 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-3110a8c9-f57d-4bfa-bad4-dc9125ae2321 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c6adfa95-47ac-40d3-abc1-0c6027507f07 from the live domain config. {{(pid=72773) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-3110a8c9-f57d-4bfa-bad4-dc9125ae2321 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:27:55 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:27:55 user nova-compute[72773]:   <source dev="/dev/sdh"/>
Aug 16 22:27:55 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:27:55 user nova-compute[72773]:   <serial>72cbff1f-2142-4f5c-9fae-ee21f058aede</serial>
Aug 16 22:27:55 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:27:55 user nova-compute[72773]: </disk>
Aug 16 22:27:55 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Received event <DeviceRemovedEvent: 1692224875.6708996, c6adfa95-47ac-40d3-abc1-0c6027507f07 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72773) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "3cd33603-83f3-4d7f-8bed-7db4b4d67c32" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "3cd33603-83f3-4d7f-8bed-7db4b4d67c32" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-3110a8c9-f57d-4bfa-bad4-dc9125ae2321 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c6adfa95-47ac-40d3-abc1-0c6027507f07 {{(pid=72773) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 22:27:55 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-3110a8c9-f57d-4bfa-bad4-dc9125ae2321 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Successfully detached device vdb from instance c6adfa95-47ac-40d3-abc1-0c6027507f07 from the live domain config.
Aug 16 22:27:55 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3110a8c9-f57d-4bfa-bad4-dc9125ae2321 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3110a8c9-f57d-4bfa-bad4-dc9125ae2321 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EnRLvJAG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:27:55 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-3110a8c9-f57d-4bfa-bad4-dc9125ae2321 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:27:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-3110a8c9-f57d-4bfa-bad4-dc9125ae2321 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-3110a8c9-f57d-4bfa-bad4-dc9125ae2321 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3110a8c9-f57d-4bfa-bad4-dc9125ae2321 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG nova.compute.manager [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bf309f-c21a-437e-b205-f6aa6ddbe39b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b270f77f-8c08-40a2-9a3c-2da854ee586e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3110a8c9-f57d-4bfa-bad4-dc9125ae2321 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:27:55 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:27:55 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:27:55 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:27:55 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:27:55 user nova-compute[72773]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede (non-flash)
Aug 16 22:27:55 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3110a8c9-f57d-4bfa-bad4-dc9125ae2321 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:27:55 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:27:55 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:27:55 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:27:55 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:27:55 user nova-compute[72773]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede (non-flash)
Aug 16 22:27:55 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3110a8c9-f57d-4bfa-bad4-dc9125ae2321 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef80758310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede'): ({'sdh'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-3110a8c9-f57d-4bfa-bad4-dc9125ae2321 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Removing single pathed devices sdh {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f588265-c034-4e02-937d-77c98bd6fc1e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfca9f0f-1842-4e19-a269-b5fe7b6261b4]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-3110a8c9-f57d-4bfa-bad4-dc9125ae2321 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Flushing IO for device /dev/sdh {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:27:55 user nova-compute[72773]: INFO nova.compute.claims [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Claim successful on node user
Aug 16 22:27:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0542b02-980d-4572-a58f-d798c68b02aa]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-3110a8c9-f57d-4bfa-bad4-dc9125ae2321 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.056s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab0c9b2-8c23-43d3-8a1e-88492167257b]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-3110a8c9-f57d-4bfa-bad4-dc9125ae2321 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-3110a8c9-f57d-4bfa-bad4-dc9125ae2321 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] SCSI volumes sdh have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3110a8c9-f57d-4bfa-bad4-dc9125ae2321 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c377fd-d7bc-4d0d-b12f-8c4f2dab94da]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3110a8c9-f57d-4bfa-bad4-dc9125ae2321 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:56 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c859e2-b52b-4edf-84b0-5d51572b0fc7]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3110a8c9-f57d-4bfa-bad4-dc9125ae2321 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede, portal: 172.16.0.220,3260]
Aug 16 22:27:56 user nova-compute[72773]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede, portal: 172.16.0.220,3260] successful.
Aug 16 22:27:56 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72cbff1f-2142-4f5c-9fae-ee21f058aede -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:56 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf06d9de-d9fe-43e9-8082-536b54f25ff4]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:27:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3110a8c9-f57d-4bfa-bad4-dc9125ae2321 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:27:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-3110a8c9-f57d-4bfa-bad4-dc9125ae2321 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:27:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3110a8c9-f57d-4bfa-bad4-dc9125ae2321 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] <== disconnect_volume: return (364ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:27:56 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3110a8c9-f57d-4bfa-bad4-dc9125ae2321 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:27:56 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:27:56 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:27:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.515s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:56 user nova-compute[72773]: DEBUG nova.compute.manager [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:27:56 user nova-compute[72773]: DEBUG nova.compute.manager [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:27:56 user nova-compute[72773]: DEBUG nova.network.neutron [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:27:56 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:27:56 user nova-compute[72773]: DEBUG nova.compute.manager [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:27:56 user nova-compute[72773]: DEBUG nova.policy [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3b873f599fc4a2686c154d856bd5f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49739a140d40508ea307eedceb9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:27:56 user nova-compute[72773]: DEBUG nova.compute.manager [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:27:56 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:27:56 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Creating image(s)
Aug 16 22:27:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "/opt/stack/data/nova/instances/3cd33603-83f3-4d7f-8bed-7db4b4d67c32/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "/opt/stack/data/nova/instances/3cd33603-83f3-4d7f-8bed-7db4b4d67c32/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "/opt/stack/data/nova/instances/3cd33603-83f3-4d7f-8bed-7db4b4d67c32/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.221s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.185s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/3cd33603-83f3-4d7f-8bed-7db4b4d67c32/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/3cd33603-83f3-4d7f-8bed-7db4b4d67c32/disk 1073741824" returned: 0 in 0.055s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:57 user nova-compute[72773]: DEBUG nova.network.neutron [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Successfully created port: 29bed5bd-e561-4bfa-bdb6-76c2063ffd52 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:27:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.186s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:57 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3cd33603-83f3-4d7f-8bed-7db4b4d67c32/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:27:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cd33603-83f3-4d7f-8bed-7db4b4d67c32/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:27:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cd33603-83f3-4d7f-8bed-7db4b4d67c32/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:27:57 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Cannot resize image /opt/stack/data/nova/instances/3cd33603-83f3-4d7f-8bed-7db4b4d67c32/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:27:57 user nova-compute[72773]: DEBUG nova.objects.instance [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lazy-loading 'migration_context' on Instance uuid 3cd33603-83f3-4d7f-8bed-7db4b4d67c32 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:27:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:27:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Ensure instance console log exists: /opt/stack/data/nova/instances/3cd33603-83f3-4d7f-8bed-7db4b4d67c32/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:27:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:57 user nova-compute[72773]: DEBUG nova.network.neutron [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Successfully updated port: 29bed5bd-e561-4bfa-bdb6-76c2063ffd52 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:27:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "refresh_cache-3cd33603-83f3-4d7f-8bed-7db4b4d67c32" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:27:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquired lock "refresh_cache-3cd33603-83f3-4d7f-8bed-7db4b4d67c32" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:27:57 user nova-compute[72773]: DEBUG nova.network.neutron [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:27:57 user nova-compute[72773]: DEBUG nova.compute.manager [req-e75d31a4-6efc-485a-99f9-4606e34bf893 req-1abc541f-f248-4170-979b-7e8a49c8f2cc service nova] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Received event network-changed-29bed5bd-e561-4bfa-bdb6-76c2063ffd52 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:27:57 user nova-compute[72773]: DEBUG nova.compute.manager [req-e75d31a4-6efc-485a-99f9-4606e34bf893 req-1abc541f-f248-4170-979b-7e8a49c8f2cc service nova] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Refreshing instance network info cache due to event network-changed-29bed5bd-e561-4bfa-bdb6-76c2063ffd52. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:27:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e75d31a4-6efc-485a-99f9-4606e34bf893 req-1abc541f-f248-4170-979b-7e8a49c8f2cc service nova] Acquiring lock "refresh_cache-3cd33603-83f3-4d7f-8bed-7db4b4d67c32" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG nova.network.neutron [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG nova.network.neutron [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Updating instance_info_cache with network_info: [{"id": "29bed5bd-e561-4bfa-bdb6-76c2063ffd52", "address": "fa:16:3e:0c:0c:6f", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bed5bd-e5", "ovs_interfaceid": "29bed5bd-e561-4bfa-bdb6-76c2063ffd52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Releasing lock "refresh_cache-3cd33603-83f3-4d7f-8bed-7db4b4d67c32" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG nova.compute.manager [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Instance network_info: |[{"id": "29bed5bd-e561-4bfa-bdb6-76c2063ffd52", "address": "fa:16:3e:0c:0c:6f", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bed5bd-e5", "ovs_interfaceid": "29bed5bd-e561-4bfa-bdb6-76c2063ffd52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e75d31a4-6efc-485a-99f9-4606e34bf893 req-1abc541f-f248-4170-979b-7e8a49c8f2cc service nova] Acquired lock "refresh_cache-3cd33603-83f3-4d7f-8bed-7db4b4d67c32" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG nova.network.neutron [req-e75d31a4-6efc-485a-99f9-4606e34bf893 req-1abc541f-f248-4170-979b-7e8a49c8f2cc service nova] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Refreshing network info cache for port 29bed5bd-e561-4bfa-bdb6-76c2063ffd52 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Start _get_guest_xml network_info=[{"id": "29bed5bd-e561-4bfa-bdb6-76c2063ffd52", "address": "fa:16:3e:0c:0c:6f", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bed5bd-e5", "ovs_interfaceid": "29bed5bd-e561-4bfa-bdb6-76c2063ffd52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:27:58 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:27:58 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:27:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:27:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-499787982',display_name='tempest-AttachVolumeNegativeTest-server-499787982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-499787982',id=13,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCbNKTERiF/S4xtp3tjZL4XwGIGeREa7GsR/o8e7qYORSi/1lH0uri5dOaxrcPwQEZJl3DV94o22pKQEOOMwV1ZZbMHBT96+LfMkQC3gIjIMiOl0dBwH0nhW01TSFXXsQ==',key_name='tempest-keypair-778648690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc49739a140d40508ea307eedceb9aaa',ramdisk_id='',reservation_id='r-89pip05e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-801754299',owner_user_name='tempest-AttachVolumeNegativeTest-801754299-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:27:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3b873f599fc4a2686c154d856bd5f06',uuid=3cd33603-83f3-4d7f-8bed-7db4b4d67c32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29bed5bd-e561-4bfa-bdb6-76c2063ffd52", "address": "fa:16:3e:0c:0c:6f", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bed5bd-e5", "ovs_interfaceid": "29bed5bd-e561-4bfa-bdb6-76c2063ffd52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Converting VIF {"id": "29bed5bd-e561-4bfa-bdb6-76c2063ffd52", "address": "fa:16:3e:0c:0c:6f", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bed5bd-e5", "ovs_interfaceid": "29bed5bd-e561-4bfa-bdb6-76c2063ffd52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:0c:6f,bridge_name='br-int',has_traffic_filtering=True,id=29bed5bd-e561-4bfa-bdb6-76c2063ffd52,network=Network(e0974c13-ec74-4a35-95b4-afae254c04a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29bed5bd-e5') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG nova.objects.instance [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lazy-loading 'pci_devices' on Instance uuid 3cd33603-83f3-4d7f-8bed-7db4b4d67c32 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:27:58 user nova-compute[72773]:   <uuid>3cd33603-83f3-4d7f-8bed-7db4b4d67c32</uuid>
Aug 16 22:27:58 user nova-compute[72773]:   <name>instance-0000000d</name>
Aug 16 22:27:58 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:27:58 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:27:58 user nova-compute[72773]:   <metadata>
Aug 16 22:27:58 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:27:58 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:27:58 user nova-compute[72773]:       <nova:name>tempest-AttachVolumeNegativeTest-server-499787982</nova:name>
Aug 16 22:27:58 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:27:58</nova:creationTime>
Aug 16 22:27:58 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:27:58 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:27:58 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:27:58 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:27:58 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:27:58 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:27:58 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:27:58 user nova-compute[72773]:       <nova:owner>
Aug 16 22:27:58 user nova-compute[72773]:         <nova:user uuid="d3b873f599fc4a2686c154d856bd5f06">tempest-AttachVolumeNegativeTest-801754299-project-member</nova:user>
Aug 16 22:27:58 user nova-compute[72773]:         <nova:project uuid="dc49739a140d40508ea307eedceb9aaa">tempest-AttachVolumeNegativeTest-801754299</nova:project>
Aug 16 22:27:58 user nova-compute[72773]:       </nova:owner>
Aug 16 22:27:58 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:27:58 user nova-compute[72773]:       <nova:ports>
Aug 16 22:27:58 user nova-compute[72773]:         <nova:port uuid="29bed5bd-e561-4bfa-bdb6-76c2063ffd52">
Aug 16 22:27:58 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 22:27:58 user nova-compute[72773]:         </nova:port>
Aug 16 22:27:58 user nova-compute[72773]:       </nova:ports>
Aug 16 22:27:58 user nova-compute[72773]:     </nova:instance>
Aug 16 22:27:58 user nova-compute[72773]:   </metadata>
Aug 16 22:27:58 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:27:58 user nova-compute[72773]:     <system>
Aug 16 22:27:58 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:27:58 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:27:58 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:27:58 user nova-compute[72773]:       <entry name="serial">3cd33603-83f3-4d7f-8bed-7db4b4d67c32</entry>
Aug 16 22:27:58 user nova-compute[72773]:       <entry name="uuid">3cd33603-83f3-4d7f-8bed-7db4b4d67c32</entry>
Aug 16 22:27:58 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:27:58 user nova-compute[72773]:     </system>
Aug 16 22:27:58 user nova-compute[72773]:   </sysinfo>
Aug 16 22:27:58 user nova-compute[72773]:   <os>
Aug 16 22:27:58 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:27:58 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:27:58 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:27:58 user nova-compute[72773]:   </os>
Aug 16 22:27:58 user nova-compute[72773]:   <features>
Aug 16 22:27:58 user nova-compute[72773]:     <acpi/>
Aug 16 22:27:58 user nova-compute[72773]:     <apic/>
Aug 16 22:27:58 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:27:58 user nova-compute[72773]:   </features>
Aug 16 22:27:58 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:27:58 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:27:58 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:27:58 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:27:58 user nova-compute[72773]:   </clock>
Aug 16 22:27:58 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:27:58 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:27:58 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:27:58 user nova-compute[72773]:   </cpu>
Aug 16 22:27:58 user nova-compute[72773]:   <devices>
Aug 16 22:27:58 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:27:58 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:27:58 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/3cd33603-83f3-4d7f-8bed-7db4b4d67c32/disk"/>
Aug 16 22:27:58 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:27:58 user nova-compute[72773]:     </disk>
Aug 16 22:27:58 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:27:58 user nova-compute[72773]:       <mac address="fa:16:3e:0c:0c:6f"/>
Aug 16 22:27:58 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:27:58 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:27:58 user nova-compute[72773]:       <target dev="tap29bed5bd-e5"/>
Aug 16 22:27:58 user nova-compute[72773]:     </interface>
Aug 16 22:27:58 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:27:58 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/3cd33603-83f3-4d7f-8bed-7db4b4d67c32/console.log" append="off"/>
Aug 16 22:27:58 user nova-compute[72773]:     </serial>
Aug 16 22:27:58 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:27:58 user nova-compute[72773]:     <video>
Aug 16 22:27:58 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:27:58 user nova-compute[72773]:     </video>
Aug 16 22:27:58 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:27:58 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:27:58 user nova-compute[72773]:     </rng>
Aug 16 22:27:58 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:27:58 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:27:58 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:27:58 user nova-compute[72773]:     </memballoon>
Aug 16 22:27:58 user nova-compute[72773]:   </devices>
Aug 16 22:27:58 user nova-compute[72773]: </domain>
Aug 16 22:27:58 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:27:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-499787982',display_name='tempest-AttachVolumeNegativeTest-server-499787982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-499787982',id=13,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCbNKTERiF/S4xtp3tjZL4XwGIGeREa7GsR/o8e7qYORSi/1lH0uri5dOaxrcPwQEZJl3DV94o22pKQEOOMwV1ZZbMHBT96+LfMkQC3gIjIMiOl0dBwH0nhW01TSFXXsQ==',key_name='tempest-keypair-778648690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc49739a140d40508ea307eedceb9aaa',ramdisk_id='',reservation_id='r-89pip05e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-801754299',owner_user_name='tempest-AttachVolumeNegativeTest-801754299-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:27:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3b873f599fc4a2686c154d856bd5f06',uuid=3cd33603-83f3-4d7f-8bed-7db4b4d67c32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29bed5bd-e561-4bfa-bdb6-76c2063ffd52", "address": "fa:16:3e:0c:0c:6f", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bed5bd-e5", "ovs_interfaceid": "29bed5bd-e561-4bfa-bdb6-76c2063ffd52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Converting VIF {"id": "29bed5bd-e561-4bfa-bdb6-76c2063ffd52", "address": "fa:16:3e:0c:0c:6f", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bed5bd-e5", "ovs_interfaceid": "29bed5bd-e561-4bfa-bdb6-76c2063ffd52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:0c:6f,bridge_name='br-int',has_traffic_filtering=True,id=29bed5bd-e561-4bfa-bdb6-76c2063ffd52,network=Network(e0974c13-ec74-4a35-95b4-afae254c04a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29bed5bd-e5') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG os_vif [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:0c:6f,bridge_name='br-int',has_traffic_filtering=True,id=29bed5bd-e561-4bfa-bdb6-76c2063ffd52,network=Network(e0974c13-ec74-4a35-95b4-afae254c04a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29bed5bd-e5') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29bed5bd-e5, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap29bed5bd-e5, col_values=(('external_ids', {'iface-id': '29bed5bd-e561-4bfa-bdb6-76c2063ffd52', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:0c:6f', 'vm-uuid': '3cd33603-83f3-4d7f-8bed-7db4b4d67c32'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:58 user nova-compute[72773]: INFO os_vif [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:0c:6f,bridge_name='br-int',has_traffic_filtering=True,id=29bed5bd-e561-4bfa-bdb6-76c2063ffd52,network=Network(e0974c13-ec74-4a35-95b4-afae254c04a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29bed5bd-e5')
Aug 16 22:27:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] No VIF found with MAC fa:16:3e:0c:0c:6f, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG nova.network.neutron [req-e75d31a4-6efc-485a-99f9-4606e34bf893 req-1abc541f-f248-4170-979b-7e8a49c8f2cc service nova] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Updated VIF entry in instance network info cache for port 29bed5bd-e561-4bfa-bdb6-76c2063ffd52. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG nova.network.neutron [req-e75d31a4-6efc-485a-99f9-4606e34bf893 req-1abc541f-f248-4170-979b-7e8a49c8f2cc service nova] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Updating instance_info_cache with network_info: [{"id": "29bed5bd-e561-4bfa-bdb6-76c2063ffd52", "address": "fa:16:3e:0c:0c:6f", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bed5bd-e5", "ovs_interfaceid": "29bed5bd-e561-4bfa-bdb6-76c2063ffd52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:27:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e75d31a4-6efc-485a-99f9-4606e34bf893 req-1abc541f-f248-4170-979b-7e8a49c8f2cc service nova] Releasing lock "refresh_cache-3cd33603-83f3-4d7f-8bed-7db4b4d67c32" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:27:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:27:59 user nova-compute[72773]: DEBUG nova.compute.manager [req-9503aa5b-f7be-476d-80ca-12e88719181c req-82acdcb1-e5cc-4ba8-a42a-6e76bddc8952 service nova] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Received event network-vif-plugged-29bed5bd-e561-4bfa-bdb6-76c2063ffd52 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:27:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9503aa5b-f7be-476d-80ca-12e88719181c req-82acdcb1-e5cc-4ba8-a42a-6e76bddc8952 service nova] Acquiring lock "3cd33603-83f3-4d7f-8bed-7db4b4d67c32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:27:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9503aa5b-f7be-476d-80ca-12e88719181c req-82acdcb1-e5cc-4ba8-a42a-6e76bddc8952 service nova] Lock "3cd33603-83f3-4d7f-8bed-7db4b4d67c32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:27:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9503aa5b-f7be-476d-80ca-12e88719181c req-82acdcb1-e5cc-4ba8-a42a-6e76bddc8952 service nova] Lock "3cd33603-83f3-4d7f-8bed-7db4b4d67c32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:27:59 user nova-compute[72773]: DEBUG nova.compute.manager [req-9503aa5b-f7be-476d-80ca-12e88719181c req-82acdcb1-e5cc-4ba8-a42a-6e76bddc8952 service nova] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] No waiting events found dispatching network-vif-plugged-29bed5bd-e561-4bfa-bdb6-76c2063ffd52 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:27:59 user nova-compute[72773]: WARNING nova.compute.manager [req-9503aa5b-f7be-476d-80ca-12e88719181c req-82acdcb1-e5cc-4ba8-a42a-6e76bddc8952 service nova] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Received unexpected event network-vif-plugged-29bed5bd-e561-4bfa-bdb6-76c2063ffd52 for instance with vm_state building and task_state spawning.
Aug 16 22:28:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:00 user nova-compute[72773]: DEBUG nova.compute.manager [req-b75d4e95-1fa2-48f1-9c5e-e53b544c3e6e req-b6227167-fad1-408a-b074-d7cb7caa639b service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Received event network-changed-6e021e1c-b583-4ddf-ad9a-f215484ff208 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:28:00 user nova-compute[72773]: DEBUG nova.compute.manager [req-b75d4e95-1fa2-48f1-9c5e-e53b544c3e6e req-b6227167-fad1-408a-b074-d7cb7caa639b service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Refreshing instance network info cache due to event network-changed-6e021e1c-b583-4ddf-ad9a-f215484ff208. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:28:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b75d4e95-1fa2-48f1-9c5e-e53b544c3e6e req-b6227167-fad1-408a-b074-d7cb7caa639b service nova] Acquiring lock "refresh_cache-2c1c948f-c541-41ea-ba51-23ff78d1c0db" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:28:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b75d4e95-1fa2-48f1-9c5e-e53b544c3e6e req-b6227167-fad1-408a-b074-d7cb7caa639b service nova] Acquired lock "refresh_cache-2c1c948f-c541-41ea-ba51-23ff78d1c0db" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:28:00 user nova-compute[72773]: DEBUG nova.network.neutron [req-b75d4e95-1fa2-48f1-9c5e-e53b544c3e6e req-b6227167-fad1-408a-b074-d7cb7caa639b service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Refreshing network info cache for port 6e021e1c-b583-4ddf-ad9a-f215484ff208 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:28:00 user nova-compute[72773]: DEBUG nova.network.neutron [req-b75d4e95-1fa2-48f1-9c5e-e53b544c3e6e req-b6227167-fad1-408a-b074-d7cb7caa639b service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Updated VIF entry in instance network info cache for port 6e021e1c-b583-4ddf-ad9a-f215484ff208. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:28:00 user nova-compute[72773]: DEBUG nova.network.neutron [req-b75d4e95-1fa2-48f1-9c5e-e53b544c3e6e req-b6227167-fad1-408a-b074-d7cb7caa639b service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Updating instance_info_cache with network_info: [{"id": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "address": "fa:16:3e:48:cc:48", "network": {"id": "a399052b-0f9b-4c24-a176-7b59221e92a1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-679236513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a863da00c62473b9f3726f45900be0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e021e1c-b5", "ovs_interfaceid": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:28:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b75d4e95-1fa2-48f1-9c5e-e53b544c3e6e req-b6227167-fad1-408a-b074-d7cb7caa639b service nova] Releasing lock "refresh_cache-2c1c948f-c541-41ea-ba51-23ff78d1c0db" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:28:01 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224881.9658177, 3cd33603-83f3-4d7f-8bed-7db4b4d67c32 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:28:01 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] VM Resumed (Lifecycle Event)
Aug 16 22:28:01 user nova-compute[72773]: DEBUG nova.compute.manager [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:28:01 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:28:01 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Instance spawned successfully.
Aug 16 22:28:01 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:28:01 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:28:02 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:28:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:28:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:28:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:28:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:28:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:28:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:28:02 user nova-compute[72773]: DEBUG nova.compute.manager [req-9713d2ba-ae7f-4361-a141-a41b8d5ccc67 req-61053f6b-13fa-41c3-83df-3bbd49638444 service nova] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Received event network-vif-plugged-29bed5bd-e561-4bfa-bdb6-76c2063ffd52 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:28:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9713d2ba-ae7f-4361-a141-a41b8d5ccc67 req-61053f6b-13fa-41c3-83df-3bbd49638444 service nova] Acquiring lock "3cd33603-83f3-4d7f-8bed-7db4b4d67c32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:28:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9713d2ba-ae7f-4361-a141-a41b8d5ccc67 req-61053f6b-13fa-41c3-83df-3bbd49638444 service nova] Lock "3cd33603-83f3-4d7f-8bed-7db4b4d67c32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:28:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9713d2ba-ae7f-4361-a141-a41b8d5ccc67 req-61053f6b-13fa-41c3-83df-3bbd49638444 service nova] Lock "3cd33603-83f3-4d7f-8bed-7db4b4d67c32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:28:02 user nova-compute[72773]: DEBUG nova.compute.manager [req-9713d2ba-ae7f-4361-a141-a41b8d5ccc67 req-61053f6b-13fa-41c3-83df-3bbd49638444 service nova] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] No waiting events found dispatching network-vif-plugged-29bed5bd-e561-4bfa-bdb6-76c2063ffd52 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:28:02 user nova-compute[72773]: WARNING nova.compute.manager [req-9713d2ba-ae7f-4361-a141-a41b8d5ccc67 req-61053f6b-13fa-41c3-83df-3bbd49638444 service nova] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Received unexpected event network-vif-plugged-29bed5bd-e561-4bfa-bdb6-76c2063ffd52 for instance with vm_state building and task_state spawning.
Aug 16 22:28:02 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:28:02 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224881.9671822, 3cd33603-83f3-4d7f-8bed-7db4b4d67c32 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:28:02 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] VM Started (Lifecycle Event)
Aug 16 22:28:02 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:28:02 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:28:02 user nova-compute[72773]: INFO nova.compute.manager [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Took 5.53 seconds to spawn the instance on the hypervisor.
Aug 16 22:28:02 user nova-compute[72773]: DEBUG nova.compute.manager [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:28:02 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:28:02 user nova-compute[72773]: INFO nova.compute.manager [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Took 6.42 seconds to build instance.
Aug 16 22:28:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-43b44e0f-39c0-451b-bebc-b0a56f50821c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "3cd33603-83f3-4d7f-8bed-7db4b4d67c32" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.544s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:28:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:04 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iJvfKAHU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:28:12 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:28:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:28:12 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:28:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:28:12 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:28:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da1ed7b-3911-4b2e-a601-4cb21bd2aee0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:28:12 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ed47f3-47b5-463e-9b46-9493b61861fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a] added
Aug 16 22:28:12 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bfbc46-8a58-406d-ad94-af01821a6f6b]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01ae80f-16d5-4a1d-84c1-feb7b9c822fc]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iJvfKAHU {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iJvfKAHU" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc8c574-fa1a-4757-bad5-b8d64b6138bb]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iJvfKAHU'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[995eee77-13be-40f0-91e5-be11680877ff]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b972de11-fb0b-4e18-984d-540d06666af1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:28:12 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:28:12 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:28:12 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:28:12 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:28:12 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:28:12 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:28:12 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:28:12 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:28:12 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:28:12 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4d2845-8c70-4b7d-b2c2-65aa9377ae84]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a, portal: 172.16.0.220,3260]
Aug 16 22:28:12 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a, portal: 172.16.0.220,3260] successful.
Aug 16 22:28:12 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c424dd1e-f1fd-46f3-b9f0-68f56956902f]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9ba9f2-89ea-4a1d-99bd-a43e95b0b745]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a (non-flash)
Aug 16 22:28:12 user nova-compute[72773]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:28:12 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:28:12 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:28:12 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:28:12 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:28:12 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a (non-flash)
Aug 16 22:28:12 user nova-compute[72773]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:28:12 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:28:12 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:28:12 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:28:12 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:28:12 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] HCTL ('37', '-', '-', 0) found on session 10 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c64ddae-badf-42e4-bbd4-6a9a0ecc0804]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Searching for a device in session 10 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iJvfKAHU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:28:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YMiWyPQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:28:12 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:28:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG nova.objects.instance [None req-965d3998-dc50-462c-91b1-7d84c9c7e4aa tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Lazy-loading 'flavor' on Instance uuid 4387131d-7a86-477a-a231-69713b2d965d {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23633636666343363', 'path': '/dev/sdf'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633636666343363', 'path': '/dev/sdf'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.857s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:28:13 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:28:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:28:13 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:28:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-965d3998-dc50-462c-91b1-7d84c9c7e4aa tempest-VolumesAssistedSnapshotsTest-1096109910 tempest-VolumesAssistedSnapshotsTest-1096109910-project-admin] Lock "4387131d-7a86-477a-a231-69713b2d965d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 20.027s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG nova.objects.instance [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lazy-loading 'flavor' on Instance uuid aa4cbd72-a11c-4dab-b2e2-29fe10493931 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0c295e-68e8-4dd4-9ce5-6c38ce33c579]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:28:13 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG os_brick.utils [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 22:28:13 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:28:13 user nova-compute[72773]:   <source dev="/dev/sdf"/>
Aug 16 22:28:13 user nova-compute[72773]:   <target dev="sdc" bus="scsi"/>
Aug 16 22:28:13 user nova-compute[72773]:   <serial>cd4f7346-d9ce-4561-9088-659ddc727c0a</serial>
Aug 16 22:28:13 user nova-compute[72773]:   <address type="drive" controller="0" unit="2"/>
Aug 16 22:28:13 user nova-compute[72773]: </disk>
Aug 16 22:28:13 user nova-compute[72773]:  {{(pid=72773) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[856f48d1-d1cf-480f-a068-bc2d8b098a7a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7] added
Aug 16 22:28:13 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a61766-2386-40fc-8338-5b6a0578b10c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[57371b97-ebb6-4fe3-8820-cb05b2ac8169]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a79123-a2f2-4c90-aa65-78e8dfd04d0d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d846d10-d5e1-42a0-9e57-017633ff7a6e]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YMiWyPQA {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9141399a-4d1f-4a1c-a2d0-a6c1056c2f3a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2d93cd-12f8-4d53-b91b-1856b6ad9369]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YMiWyPQA" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f927390a-3c17-43ce-83a8-df301143b32f]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YMiWyPQA'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:28:14 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:28:14 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6da904-2ca1-4c3e-ad4b-5874da86bc9d]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG os_brick.utils [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Updating existing volume attachment record: 75c59d5c-72e4-480c-908e-188afb9f4b3b {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87f1426-1456-457b-bc47-3b6096c493d3]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0ec12a-8042-4283-9f77-98c401b0ae63]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a (non-flash)
Aug 16 22:28:14 user nova-compute[72773]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:28:14 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:28:14 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:28:14 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:28:14 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:28:14 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a (non-flash)
Aug 16 22:28:14 user nova-compute[72773]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:28:14 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:28:14 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:28:14 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:28:14 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:28:14 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9344d2-d27c-4b11-b0ba-1abf6c8dc8ba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7, portal: 172.16.0.220,3260]
Aug 16 22:28:14 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7, portal: 172.16.0.220,3260] successful.
Aug 16 22:28:14 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdd491c-010b-408e-9ade-57f2c0dfc3cf]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bccdd5-a245-4746-84bc-a11c931c3053]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a (non-flash)
Aug 16 22:28:14 user nova-compute[72773]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)
Aug 16 22:28:14 user nova-compute[72773]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:28:14 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:28:14 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:28:14 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:28:14 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:28:14 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a (non-flash)
Aug 16 22:28:14 user nova-compute[72773]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)
Aug 16 22:28:14 user nova-compute[72773]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:28:14 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:28:14 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:28:14 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:28:14 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:28:14 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.413s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] HCTL ('39', '-', '-', 0) found on session 11 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG nova.objects.instance [None req-3110a8c9-f57d-4bfa-bad4-dc9125ae2321 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lazy-loading 'flavor' on Instance uuid c6adfa95-47ac-40d3-abc1-0c6027507f07 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.029s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6501d364-36de-44ed-abe0-7f1f1fb99e8a]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Searching for a device in session 11 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YMiWyPQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3110a8c9-f57d-4bfa-bad4-dc9125ae2321 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "c6adfa95-47ac-40d3-abc1-0c6027507f07" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 19.245s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:28:14 user nova-compute[72773]: INFO nova.compute.manager [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Rebuilding instance
Aug 16 22:28:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] No BDM found with device name sda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] No VIF found with MAC fa:16:3e:19:53:af, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG nova.objects.instance [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2c1c948f-c541-41ea-ba51-23ff78d1c0db {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG nova.objects.instance [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lazy-loading 'pci_requests' on Instance uuid 2c1c948f-c541-41ea-ba51-23ff78d1c0db {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG nova.objects.instance [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c1c948f-c541-41ea-ba51-23ff78d1c0db {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG nova.objects.instance [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lazy-loading 'resources' on Instance uuid 2c1c948f-c541-41ea-ba51-23ff78d1c0db {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG nova.objects.instance [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lazy-loading 'migration_context' on Instance uuid 2c1c948f-c541-41ea-ba51-23ff78d1c0db {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-87ccf163-f203-4a20-a47e-0d68ae69731f tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lock "aa4cbd72-a11c-4dab-b2e2-29fe10493931" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 37.625s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG nova.objects.instance [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72773) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:15 user nova-compute[72773]: DEBUG nova.compute.manager [req-4129fd50-76c0-4387-84c0-e413a3c3e4f3 req-aeca8160-9f63-4809-afc8-035cf43188c1 service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Received event network-vif-unplugged-6e021e1c-b583-4ddf-ad9a-f215484ff208 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:28:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4129fd50-76c0-4387-84c0-e413a3c3e4f3 req-aeca8160-9f63-4809-afc8-035cf43188c1 service nova] Acquiring lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:28:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4129fd50-76c0-4387-84c0-e413a3c3e4f3 req-aeca8160-9f63-4809-afc8-035cf43188c1 service nova] Lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:28:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4129fd50-76c0-4387-84c0-e413a3c3e4f3 req-aeca8160-9f63-4809-afc8-035cf43188c1 service nova] Lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:28:15 user nova-compute[72773]: DEBUG nova.compute.manager [req-4129fd50-76c0-4387-84c0-e413a3c3e4f3 req-aeca8160-9f63-4809-afc8-035cf43188c1 service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] No waiting events found dispatching network-vif-unplugged-6e021e1c-b583-4ddf-ad9a-f215484ff208 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:28:15 user nova-compute[72773]: WARNING nova.compute.manager [req-4129fd50-76c0-4387-84c0-e413a3c3e4f3 req-aeca8160-9f63-4809-afc8-035cf43188c1 service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Received unexpected event network-vif-unplugged-6e021e1c-b583-4ddf-ad9a-f215484ff208 for instance with vm_state active and task_state rebuilding.
Aug 16 22:28:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.458s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:28:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] <== connect_volume: return (2316ms) {'type': 'block', 'scsi_wwn': '23732646639373731', 'path': '/dev/sdh'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:28:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732646639373731', 'path': '/dev/sdh'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:28:15 user nova-compute[72773]: DEBUG nova.objects.instance [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Lazy-loading 'flavor' on Instance uuid 8bbb196d-e352-47a5-86fb-a819723c2ce8 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:28:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 22:28:15 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:28:15 user nova-compute[72773]:   <source dev="/dev/sdh"/>
Aug 16 22:28:15 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:28:15 user nova-compute[72773]:   <serial>3cfa9b4b-47b9-4700-9c81-d6dfaba199f7</serial>
Aug 16 22:28:15 user nova-compute[72773]: </disk>
Aug 16 22:28:15 user nova-compute[72773]:  {{(pid=72773) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 22:28:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:16 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Instance destroyed successfully.
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ef12e53a-0130-4229-bff7-bf1dbac85d27 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Acquiring lock "aa4cbd72-a11c-4dab-b2e2-29fe10493931" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ef12e53a-0130-4229-bff7-bf1dbac85d27 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lock "aa4cbd72-a11c-4dab-b2e2-29fe10493931" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:28:16 user nova-compute[72773]: INFO nova.compute.manager [None req-ef12e53a-0130-4229-bff7-bf1dbac85d27 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Detaching volume cd4f7346-d9ce-4561-9088-659ddc727c0a
Aug 16 22:28:16 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Instance destroyed successfully.
Aug 16 22:28:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:26:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-959076328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1140763264',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBA6wXj+pYizM4fJfGUIvhwgan4ub6F4+mEVSZeYo3UraSfwK8dHO9ZRWzHCA/0MsTcW4Way+QQ3ZkahEVK/6hRQ7Z4hPQl0XcQMQn6OttJ3+biiwE/FDTRdP2/DP4bJ/g==',key_name='tempest-keypair-1083426637',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:26:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8a863da00c62473b9f3726f45900be0c',ramdisk_id='',reservation_id='r-kdsmsxtr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1773237892',owner_user_name='tempest-ServerActionsV293TestJSON-1773237892-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:28:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='317d00f05a4649c2888f6d30e0a140b8',uuid=2c1c948f-c541-41ea-ba51-23ff78d1c0db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "address": "fa:16:3e:48:cc:48", "network": {"id": "a399052b-0f9b-4c24-a176-7b59221e92a1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-679236513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a863da00c62473b9f3726f45900be0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e021e1c-b5", "ovs_interfaceid": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Converting VIF {"id": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "address": "fa:16:3e:48:cc:48", "network": {"id": "a399052b-0f9b-4c24-a176-7b59221e92a1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-679236513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a863da00c62473b9f3726f45900be0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e021e1c-b5", "ovs_interfaceid": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:cc:48,bridge_name='br-int',has_traffic_filtering=True,id=6e021e1c-b583-4ddf-ad9a-f215484ff208,network=Network(a399052b-0f9b-4c24-a176-7b59221e92a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e021e1c-b5') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_vif [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:cc:48,bridge_name='br-int',has_traffic_filtering=True,id=6e021e1c-b583-4ddf-ad9a-f215484ff208,network=Network(a399052b-0f9b-4c24-a176-7b59221e92a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e021e1c-b5') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e021e1c-b5, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:16 user nova-compute[72773]: INFO os_vif [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:cc:48,bridge_name='br-int',has_traffic_filtering=True,id=6e021e1c-b583-4ddf-ad9a-f215484ff208,network=Network(a399052b-0f9b-4c24-a176-7b59221e92a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e021e1c-b5')
Aug 16 22:28:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] No VIF found with MAC fa:16:3e:54:d7:ac, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abPpkSTl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:28:16 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[05740098-6e45-4ede-88b6-c5a046a68207]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4a73f0-d9b6-480d-b295-a43bdcf86e37]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a (non-flash)
Aug 16 22:28:16 user nova-compute[72773]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)
Aug 16 22:28:16 user nova-compute[72773]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:28:16 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:28:16 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:28:16 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:28:16 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:28:16 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a (non-flash)
Aug 16 22:28:16 user nova-compute[72773]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)
Aug 16 22:28:16 user nova-compute[72773]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:28:16 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:28:16 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:28:16 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:28:16 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:28:16 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef5c586e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18'): ({'sdb'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Removing single pathed devices sdb {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[105a83e8-0c48-4c69-bfbe-be7bbe9654b5]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:16 user nova-compute[72773]: INFO nova.virt.block_device [None req-ef12e53a-0130-4229-bff7-bf1dbac85d27 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Attempting to driver detach volume cd4f7346-d9ce-4561-9088-659ddc727c0a from mountpoint /dev/sdc
Aug 16 22:28:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ef12e53a-0130-4229-bff7-bf1dbac85d27 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Attempting to detach device sdc from instance aa4cbd72-a11c-4dab-b2e2-29fe10493931 from the persistent domain config. {{(pid=72773) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-ef12e53a-0130-4229-bff7-bf1dbac85d27 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:28:16 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:28:16 user nova-compute[72773]:   <source dev="/dev/sdf"/>
Aug 16 22:28:16 user nova-compute[72773]:   <target dev="sdc" bus="scsi"/>
Aug 16 22:28:16 user nova-compute[72773]:   <serial>cd4f7346-d9ce-4561-9088-659ddc727c0a</serial>
Aug 16 22:28:16 user nova-compute[72773]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 16 22:28:16 user nova-compute[72773]: </disk>
Aug 16 22:28:16 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3978b4a-199d-483a-afe4-1ac8662812b1]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Flushing IO for device /dev/sdb {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:28:16 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-ef12e53a-0130-4229-bff7-bf1dbac85d27 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Successfully detached device sdc from instance aa4cbd72-a11c-4dab-b2e2-29fe10493931 from the persistent domain config.
Aug 16 22:28:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ef12e53a-0130-4229-bff7-bf1dbac85d27 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance aa4cbd72-a11c-4dab-b2e2-29fe10493931 from the live domain config. {{(pid=72773) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-ef12e53a-0130-4229-bff7-bf1dbac85d27 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:28:16 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:28:16 user nova-compute[72773]:   <source dev="/dev/sdf"/>
Aug 16 22:28:16 user nova-compute[72773]:   <target dev="sdc" bus="scsi"/>
Aug 16 22:28:16 user nova-compute[72773]:   <serial>cd4f7346-d9ce-4561-9088-659ddc727c0a</serial>
Aug 16 22:28:16 user nova-compute[72773]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 16 22:28:16 user nova-compute[72773]: </disk>
Aug 16 22:28:16 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0aa5de-9664-4cee-96ec-613fd77cf105]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6ba6fc23-a3cf-4d42-9085-0d9e795704f7 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Lock "8bbb196d-e352-47a5-86fb-a819723c2ce8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 39.326s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2cbf0e-b0b5-4a70-a49e-a89d2023cd52]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] SCSI volumes sdb have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cbb832-3e2e-4b39-ba0e-0599af0ba4c9]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b3797e-caa8-4ca1-9dd4-176e26dc53d7]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18, portal: 172.16.0.220,3260]
Aug 16 22:28:16 user nova-compute[72773]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18, portal: 172.16.0.220,3260] successful.
Aug 16 22:28:16 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[68edc764-599c-482b-90c3-209326175da3]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] <== disconnect_volume: return (388ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:28:16 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Deleting instance files /opt/stack/data/nova/instances/2c1c948f-c541-41ea-ba51-23ff78d1c0db_del
Aug 16 22:28:16 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Deletion of /opt/stack/data/nova/instances/2c1c948f-c541-41ea-ba51-23ff78d1c0db_del complete
Aug 16 22:28:16 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 2c1c948f-c541-41ea-ba51-23ff78d1c0db could not be found.
Aug 16 22:28:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abPpkSTl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:28:16 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5391e543-b26d-4794-9500-f47d6dcea8a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Received event <DeviceRemovedEvent: 1692224896.8428771, aa4cbd72-a11c-4dab-b2e2-29fe10493931 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72773) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ef12e53a-0130-4229-bff7-bf1dbac85d27 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance aa4cbd72-a11c-4dab-b2e2-29fe10493931 {{(pid=72773) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 22:28:16 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-ef12e53a-0130-4229-bff7-bf1dbac85d27 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Successfully detached device sdc from instance aa4cbd72-a11c-4dab-b2e2-29fe10493931 from the live domain config.
Aug 16 22:28:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef12e53a-0130-4229-bff7-bf1dbac85d27 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef12e53a-0130-4229-bff7-bf1dbac85d27 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iJvfKAHU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:28:16 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-ef12e53a-0130-4229-bff7-bf1dbac85d27 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-ef12e53a-0130-4229-bff7-bf1dbac85d27 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b366eedb-be58-423f-b314-879a992e68cb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a (non-flash)
Aug 16 22:28:16 user nova-compute[72773]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)
Aug 16 22:28:16 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:28:16 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:28:16 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:28:16 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:28:16 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a (non-flash)
Aug 16 22:28:16 user nova-compute[72773]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)
Aug 16 22:28:16 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:28:16 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:28:16 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:28:16 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:28:16 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef8038eef0>, {}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Disconnecting from: [] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.068s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] <== disconnect_volume: return (69ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-ef12e53a-0130-4229-bff7-bf1dbac85d27 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.008s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef12e53a-0130-4229-bff7-bf1dbac85d27 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f0f2c3-8751-4004-8f91-c1f37df2b634]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cb9c56-856d-4389-9ce4-cb990e8c037e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef12e53a-0130-4229-bff7-bf1dbac85d27 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a (non-flash)
Aug 16 22:28:16 user nova-compute[72773]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)
Aug 16 22:28:16 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:28:16 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:28:16 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:28:16 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:28:16 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef12e53a-0130-4229-bff7-bf1dbac85d27 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a (non-flash)
Aug 16 22:28:16 user nova-compute[72773]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)
Aug 16 22:28:16 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:28:16 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:28:16 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:28:16 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:28:16 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef12e53a-0130-4229-bff7-bf1dbac85d27 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef94a78550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a'): ({'sdf'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-ef12e53a-0130-4229-bff7-bf1dbac85d27 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Removing single pathed devices sdf {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4ec30c-cbd8-455b-932d-d33cfc4ff5b9]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0328cf-d57f-4377-baa5-86c5ab108f1f]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:16 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-ef12e53a-0130-4229-bff7-bf1dbac85d27 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Flushing IO for device /dev/sdf {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:28:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:17 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1836c256-edb7-41ca-979c-ad8e39ab8393]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:17 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-ef12e53a-0130-4229-bff7-bf1dbac85d27 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:28:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:17 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5f6239-6337-4f73-b045-77baa5131994]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:17 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-ef12e53a-0130-4229-bff7-bf1dbac85d27 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:28:17 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-ef12e53a-0130-4229-bff7-bf1dbac85d27 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] SCSI volumes sdf have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:28:17 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef12e53a-0130-4229-bff7-bf1dbac85d27 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:28:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:17 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b1a319-31c6-40b4-9ea8-28becf9ce131]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:17 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef12e53a-0130-4229-bff7-bf1dbac85d27 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:17 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ceab9a-9513-4cd7-b464-24f9fa1ca166]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:17 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef12e53a-0130-4229-bff7-bf1dbac85d27 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a, portal: 172.16.0.220,3260]
Aug 16 22:28:17 user nova-compute[72773]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a, portal: 172.16.0.220,3260] successful.
Aug 16 22:28:17 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:17 user nova-compute[72773]: DEBUG nova.compute.manager [req-c355c35d-f902-45ce-a829-814ead58ba99 req-2ebc3581-d731-4c89-a4ac-adc81e94f984 service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Received event network-vif-plugged-6e021e1c-b583-4ddf-ad9a-f215484ff208 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:28:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c355c35d-f902-45ce-a829-814ead58ba99 req-2ebc3581-d731-4c89-a4ac-adc81e94f984 service nova] Acquiring lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:28:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c355c35d-f902-45ce-a829-814ead58ba99 req-2ebc3581-d731-4c89-a4ac-adc81e94f984 service nova] Lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:28:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c355c35d-f902-45ce-a829-814ead58ba99 req-2ebc3581-d731-4c89-a4ac-adc81e94f984 service nova] Lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:28:17 user nova-compute[72773]: DEBUG nova.compute.manager [req-c355c35d-f902-45ce-a829-814ead58ba99 req-2ebc3581-d731-4c89-a4ac-adc81e94f984 service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] No waiting events found dispatching network-vif-plugged-6e021e1c-b583-4ddf-ad9a-f215484ff208 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:28:17 user nova-compute[72773]: WARNING nova.compute.manager [req-c355c35d-f902-45ce-a829-814ead58ba99 req-2ebc3581-d731-4c89-a4ac-adc81e94f984 service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Received unexpected event network-vif-plugged-6e021e1c-b583-4ddf-ad9a-f215484ff208 for instance with vm_state active and task_state rebuilding.
Aug 16 22:28:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd4f7346-d9ce-4561-9088-659ddc727c0a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:17 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbce712-9a21-4db3-9e67-aa69cbb80aa2]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:17 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef12e53a-0130-4229-bff7-bf1dbac85d27 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:17 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-ef12e53a-0130-4229-bff7-bf1dbac85d27 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:28:17 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef12e53a-0130-4229-bff7-bf1dbac85d27 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] <== disconnect_volume: return (355ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:28:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef12e53a-0130-4229-bff7-bf1dbac85d27 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:28:18 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Preparing to wait for external event volume-reimaged-fb687b38-4616-4b0b-bee3-4ff1da040b18 {{(pid=72773) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 16 22:28:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Acquiring lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:28:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:28:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:28:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Acquiring lock "8bbb196d-e352-47a5-86fb-a819723c2ce8" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:28:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Lock "8bbb196d-e352-47a5-86fb-a819723c2ce8" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:28:20 user nova-compute[72773]: DEBUG os_brick.utils [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:28:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b690d8-03af-429d-ae6e-3d1e23970f68]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddc346f-0417-4e94-b085-504803e8eefa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb17f96-071b-4209-921f-7e2662ae1076]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64ce685-ae7c-4dab-bb4c-8714645a698a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:28:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:28:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:28:20 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:28:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf2625b-5d42-4006-a57a-ee6816815a8a]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:28:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:28:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:28:20 user nova-compute[72773]: DEBUG os_brick.utils [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:28:20 user nova-compute[72773]: INFO nova.compute.manager [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Swapping volume 3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 for 21817152-fc90-4056-880a-bb9a26a3edf2
Aug 16 22:28:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG nova.compute.manager [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:28:28 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Creating image(s)
Aug 16 22:28:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Did not create local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Ensure instance console log exists: /opt/stack/data/nova/instances/030d076d-5099-4236-ae31-6025017eb51e/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Start _get_guest_xml network_info=[{"id": "bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c", "address": "fa:16:3e:27:b6:2b", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc3b07d-2b", "ovs_interfaceid": "bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '75c59d5c-72e4-480c-908e-188afb9f4b3b', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GWPeHDmK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '030d076d-5099-4236-ae31-6025017eb51e', 'attached_at': '', 'detached_at': '', 'volume_id': 'e1b2bca5-6794-44b5-ae2b-66771ff9d706', 'serial': 'e1b2bca5-6794-44b5-ae2b-66771ff9d706'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG nova.objects.instance [None req-ef12e53a-0130-4229-bff7-bf1dbac85d27 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lazy-loading 'flavor' on Instance uuid aa4cbd72-a11c-4dab-b2e2-29fe10493931 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:28:28 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:28:28 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:28:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GWPeHDmK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:28:28 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:28:28 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:28:28 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:28:28 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:28:28 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ef12e53a-0130-4229-bff7-bf1dbac85d27 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lock "aa4cbd72-a11c-4dab-b2e2-29fe10493931" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 12.065s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b591509-2f24-4682-b6e5-16a6cd4d4517]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:28:28 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7d0501-f302-4816-9b36-bd4bbb3d7406]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706] added
Aug 16 22:28:28 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d25eca4-503d-40e6-8129-14887714d1c3]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c15ec58-ff22-46a8-9343-d375e97bb418]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GWPeHDmK {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GWPeHDmK" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6b8758-d59a-4468-b30e-10ae0237d586]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GWPeHDmK'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[984cd325-5dc7-4824-9c90-e077f86c1374]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fda6c23-57cc-4823-a519-3693b34416a4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)
Aug 16 22:28:28 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:28:28 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:28:28 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:28:28 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:28:28 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)
Aug 16 22:28:28 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:28:28 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:28:28 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:28:28 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:28:28 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a405fe79-d59f-43e5-8198-43e38c7d1910]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706, portal: 172.16.0.220,3260]
Aug 16 22:28:28 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706, portal: 172.16.0.220,3260] successful.
Aug 16 22:28:28 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4acb596-4c56-44ca-b5b6-409877a685c1]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[76449fa0-27ea-4e50-beeb-1738f275d25d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)
Aug 16 22:28:28 user nova-compute[72773]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:28:28 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:28:28 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:28:28 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:28:28 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:28:28 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)
Aug 16 22:28:28 user nova-compute[72773]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:28:28 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:28:28 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:28:28 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:28:28 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:28:28 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[977e4316-2b1e-4614-926c-ba933c927f09]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:28:28 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GWPeHDmK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:28:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:28:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23739346336616231', 'path': '/dev/sdb'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:28:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739346336616231', 'path': '/dev/sdb'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:28:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:27:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-481632116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-481632116',id=12,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f496354017e467e9b7a537c73248fe2',ramdisk_id='',reservation_id='r-1jyekcam',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648946443',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:27:51Z,user_data=None,user_id='42e8c8d0806e45ed9d1126aad24a034b',uuid=030d076d-5099-4236-ae31-6025017eb51e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c", "address": "fa:16:3e:27:b6:2b", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc3b07d-2b", "ovs_interfaceid": "bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:28:29 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Converting VIF {"id": "bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c", "address": "fa:16:3e:27:b6:2b", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc3b07d-2b", "ovs_interfaceid": "bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:28:29 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:b6:2b,bridge_name='br-int',has_traffic_filtering=True,id=bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c,network=Network(0a6ec813-28f9-4716-bf41-20722c69fe20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc3b07d-2b') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:28:29 user nova-compute[72773]: DEBUG nova.objects.instance [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lazy-loading 'pci_devices' on Instance uuid 030d076d-5099-4236-ae31-6025017eb51e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:28:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f74b7c32-a472-4713-be3a-3c3c48cf2890 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Acquiring lock "aa4cbd72-a11c-4dab-b2e2-29fe10493931" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:28:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f74b7c32-a472-4713-be3a-3c3c48cf2890 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lock "aa4cbd72-a11c-4dab-b2e2-29fe10493931" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:28:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f74b7c32-a472-4713-be3a-3c3c48cf2890 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Acquiring lock "aa4cbd72-a11c-4dab-b2e2-29fe10493931-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:28:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f74b7c32-a472-4713-be3a-3c3c48cf2890 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lock "aa4cbd72-a11c-4dab-b2e2-29fe10493931-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:28:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f74b7c32-a472-4713-be3a-3c3c48cf2890 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lock "aa4cbd72-a11c-4dab-b2e2-29fe10493931-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:28:29 user nova-compute[72773]: INFO nova.compute.manager [None req-f74b7c32-a472-4713-be3a-3c3c48cf2890 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Terminating instance
Aug 16 22:28:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-f74b7c32-a472-4713-be3a-3c3c48cf2890 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:28:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:28:29 user nova-compute[72773]:   <uuid>030d076d-5099-4236-ae31-6025017eb51e</uuid>
Aug 16 22:28:29 user nova-compute[72773]:   <name>instance-0000000c</name>
Aug 16 22:28:29 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:28:29 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:28:29 user nova-compute[72773]:   <metadata>
Aug 16 22:28:29 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:28:29 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:28:29 user nova-compute[72773]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-481632116</nova:name>
Aug 16 22:28:29 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:28:28</nova:creationTime>
Aug 16 22:28:29 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:28:29 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:28:29 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:28:29 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:28:29 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:28:29 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:28:29 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:28:29 user nova-compute[72773]:       <nova:owner>
Aug 16 22:28:29 user nova-compute[72773]:         <nova:user uuid="42e8c8d0806e45ed9d1126aad24a034b">tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member</nova:user>
Aug 16 22:28:29 user nova-compute[72773]:         <nova:project uuid="4f496354017e467e9b7a537c73248fe2">tempest-ServerBootFromVolumeStableRescueTest-1648946443</nova:project>
Aug 16 22:28:29 user nova-compute[72773]:       </nova:owner>
Aug 16 22:28:29 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:28:29 user nova-compute[72773]:       <nova:ports>
Aug 16 22:28:29 user nova-compute[72773]:         <nova:port uuid="bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c">
Aug 16 22:28:29 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 22:28:29 user nova-compute[72773]:         </nova:port>
Aug 16 22:28:29 user nova-compute[72773]:       </nova:ports>
Aug 16 22:28:29 user nova-compute[72773]:     </nova:instance>
Aug 16 22:28:29 user nova-compute[72773]:   </metadata>
Aug 16 22:28:29 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:28:29 user nova-compute[72773]:     <system>
Aug 16 22:28:29 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:28:29 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:28:29 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:28:29 user nova-compute[72773]:       <entry name="serial">030d076d-5099-4236-ae31-6025017eb51e</entry>
Aug 16 22:28:29 user nova-compute[72773]:       <entry name="uuid">030d076d-5099-4236-ae31-6025017eb51e</entry>
Aug 16 22:28:29 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:28:29 user nova-compute[72773]:     </system>
Aug 16 22:28:29 user nova-compute[72773]:   </sysinfo>
Aug 16 22:28:29 user nova-compute[72773]:   <os>
Aug 16 22:28:29 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:28:29 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:28:29 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:28:29 user nova-compute[72773]:   </os>
Aug 16 22:28:29 user nova-compute[72773]:   <features>
Aug 16 22:28:29 user nova-compute[72773]:     <acpi/>
Aug 16 22:28:29 user nova-compute[72773]:     <apic/>
Aug 16 22:28:29 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:28:29 user nova-compute[72773]:   </features>
Aug 16 22:28:29 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:28:29 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:28:29 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:28:29 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:28:29 user nova-compute[72773]:   </clock>
Aug 16 22:28:29 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:28:29 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:28:29 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:28:29 user nova-compute[72773]:   </cpu>
Aug 16 22:28:29 user nova-compute[72773]:   <devices>
Aug 16 22:28:29 user nova-compute[72773]:     <disk type="block" device="disk">
Aug 16 22:28:29 user nova-compute[72773]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:28:29 user nova-compute[72773]:       <source dev="/dev/sdb"/>
Aug 16 22:28:29 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:28:29 user nova-compute[72773]:       <serial>e1b2bca5-6794-44b5-ae2b-66771ff9d706</serial>
Aug 16 22:28:29 user nova-compute[72773]:     </disk>
Aug 16 22:28:29 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:28:29 user nova-compute[72773]:       <mac address="fa:16:3e:27:b6:2b"/>
Aug 16 22:28:29 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:28:29 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:28:29 user nova-compute[72773]:       <target dev="tapbdc3b07d-2b"/>
Aug 16 22:28:29 user nova-compute[72773]:     </interface>
Aug 16 22:28:29 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:28:29 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/030d076d-5099-4236-ae31-6025017eb51e/console.log" append="off"/>
Aug 16 22:28:29 user nova-compute[72773]:     </serial>
Aug 16 22:28:29 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:28:29 user nova-compute[72773]:     <video>
Aug 16 22:28:29 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:28:29 user nova-compute[72773]:     </video>
Aug 16 22:28:29 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:28:29 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:28:29 user nova-compute[72773]:     </rng>
Aug 16 22:28:29 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:28:29 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:28:29 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:28:29 user nova-compute[72773]:     </memballoon>
Aug 16 22:28:29 user nova-compute[72773]:   </devices>
Aug 16 22:28:29 user nova-compute[72773]: </domain>
Aug 16 22:28:29 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:28:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:27:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-481632116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-481632116',id=12,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f496354017e467e9b7a537c73248fe2',ramdisk_id='',reservation_id='r-1jyekcam',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648946443',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:27:51Z,user_data=None,user_id='42e8c8d0806e45ed9d1126aad24a034b',uuid=030d076d-5099-4236-ae31-6025017eb51e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c", "address": "fa:16:3e:27:b6:2b", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc3b07d-2b", "ovs_interfaceid": "bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:28:29 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Converting VIF {"id": "bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c", "address": "fa:16:3e:27:b6:2b", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc3b07d-2b", "ovs_interfaceid": "bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:28:29 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:b6:2b,bridge_name='br-int',has_traffic_filtering=True,id=bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c,network=Network(0a6ec813-28f9-4716-bf41-20722c69fe20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc3b07d-2b') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:28:29 user nova-compute[72773]: DEBUG os_vif [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:b6:2b,bridge_name='br-int',has_traffic_filtering=True,id=bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c,network=Network(0a6ec813-28f9-4716-bf41-20722c69fe20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc3b07d-2b') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:28:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:28:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:28:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbdc3b07d-2b, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:28:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbdc3b07d-2b, col_values=(('external_ids', {'iface-id': 'bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:b6:2b', 'vm-uuid': '030d076d-5099-4236-ae31-6025017eb51e'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:28:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:28:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:29 user nova-compute[72773]: INFO os_vif [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:b6:2b,bridge_name='br-int',has_traffic_filtering=True,id=bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c,network=Network(0a6ec813-28f9-4716-bf41-20722c69fe20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc3b07d-2b')
Aug 16 22:28:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:28:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] No VIF found with MAC fa:16:3e:27:b6:2b, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:28:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:30 user nova-compute[72773]: DEBUG nova.compute.manager [req-ca333f44-5594-4494-86b5-cb820cc324f2 req-eba0a076-ff41-49ed-b05e-05a63af9652a service nova] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Received event network-vif-unplugged-c0ab5700-b895-412c-acca-e116a216cc89 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:28:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ca333f44-5594-4494-86b5-cb820cc324f2 req-eba0a076-ff41-49ed-b05e-05a63af9652a service nova] Acquiring lock "aa4cbd72-a11c-4dab-b2e2-29fe10493931-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:28:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ca333f44-5594-4494-86b5-cb820cc324f2 req-eba0a076-ff41-49ed-b05e-05a63af9652a service nova] Lock "aa4cbd72-a11c-4dab-b2e2-29fe10493931-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:28:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ca333f44-5594-4494-86b5-cb820cc324f2 req-eba0a076-ff41-49ed-b05e-05a63af9652a service nova] Lock "aa4cbd72-a11c-4dab-b2e2-29fe10493931-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:28:30 user nova-compute[72773]: DEBUG nova.compute.manager [req-ca333f44-5594-4494-86b5-cb820cc324f2 req-eba0a076-ff41-49ed-b05e-05a63af9652a service nova] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] No waiting events found dispatching network-vif-unplugged-c0ab5700-b895-412c-acca-e116a216cc89 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:28:30 user nova-compute[72773]: DEBUG nova.compute.manager [req-ca333f44-5594-4494-86b5-cb820cc324f2 req-eba0a076-ff41-49ed-b05e-05a63af9652a service nova] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Received event network-vif-unplugged-c0ab5700-b895-412c-acca-e116a216cc89 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:28:30 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Instance destroyed successfully.
Aug 16 22:28:30 user nova-compute[72773]: DEBUG nova.objects.instance [None req-f74b7c32-a472-4713-be3a-3c3c48cf2890 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lazy-loading 'resources' on Instance uuid aa4cbd72-a11c-4dab-b2e2-29fe10493931 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:28:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-f74b7c32-a472-4713-be3a-3c3c48cf2890 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:25:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-746378066',display_name='tempest-AttachSCSIVolumeTestJSON-server-746378066',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-746378066',id=7,image_ref='9e426ed0-4ff6-486b-b1d1-cbe7b9263905',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGK0Gwr1cE4s9SCf2MyvVFkEYgrkfLF28DejcAaX+XTTMVNBYt/JM5oTmiSbyJ43fEpvHckCm9aXpHl6+jLHKBYXqubFEinZkrnlQFL1v+Emqll/C2MfqevylzENFPV5Cw==',key_name='tempest-keypair-1212077302',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:25:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc901cb159c84701b71722d227c56baf',ramdisk_id='',reservation_id='r-39mxluxs',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9e426ed0-4ff6-486b-b1d1-cbe7b9263905',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-445128069',owner_user_name='tempest-AttachSCSIVolumeTestJSON-445128069-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:25:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec229d21f9ca4d6db7758eb42579f4e9',uuid=aa4cbd72-a11c-4dab-b2e2-29fe10493931,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0ab5700-b895-412c-acca-e116a216cc89", "address": "fa:16:3e:19:53:af", "network": {"id": "03be4829-78f7-42b1-8d1d-742719d2e16d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-503860176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc901cb159c84701b71722d227c56baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ab5700-b8", "ovs_interfaceid": "c0ab5700-b895-412c-acca-e116a216cc89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:28:30 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-f74b7c32-a472-4713-be3a-3c3c48cf2890 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Converting VIF {"id": "c0ab5700-b895-412c-acca-e116a216cc89", "address": "fa:16:3e:19:53:af", "network": {"id": "03be4829-78f7-42b1-8d1d-742719d2e16d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-503860176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc901cb159c84701b71722d227c56baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0ab5700-b8", "ovs_interfaceid": "c0ab5700-b895-412c-acca-e116a216cc89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:28:30 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-f74b7c32-a472-4713-be3a-3c3c48cf2890 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:53:af,bridge_name='br-int',has_traffic_filtering=True,id=c0ab5700-b895-412c-acca-e116a216cc89,network=Network(03be4829-78f7-42b1-8d1d-742719d2e16d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ab5700-b8') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:28:30 user nova-compute[72773]: DEBUG os_vif [None req-f74b7c32-a472-4713-be3a-3c3c48cf2890 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:53:af,bridge_name='br-int',has_traffic_filtering=True,id=c0ab5700-b895-412c-acca-e116a216cc89,network=Network(03be4829-78f7-42b1-8d1d-742719d2e16d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ab5700-b8') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:28:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0ab5700-b8, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:28:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:28:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:30 user nova-compute[72773]: INFO os_vif [None req-f74b7c32-a472-4713-be3a-3c3c48cf2890 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:53:af,bridge_name='br-int',has_traffic_filtering=True,id=c0ab5700-b895-412c-acca-e116a216cc89,network=Network(03be4829-78f7-42b1-8d1d-742719d2e16d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0ab5700-b8')
Aug 16 22:28:30 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-f74b7c32-a472-4713-be3a-3c3c48cf2890 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Deleting instance files /opt/stack/data/nova/instances/aa4cbd72-a11c-4dab-b2e2-29fe10493931_del
Aug 16 22:28:30 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-f74b7c32-a472-4713-be3a-3c3c48cf2890 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Deletion of /opt/stack/data/nova/instances/aa4cbd72-a11c-4dab-b2e2-29fe10493931_del complete
Aug 16 22:28:30 user nova-compute[72773]: INFO nova.compute.manager [None req-f74b7c32-a472-4713-be3a-3c3c48cf2890 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 16 22:28:30 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-f74b7c32-a472-4713-be3a-3c3c48cf2890 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:28:30 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:28:30 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:28:31 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692224896.0287402, 2c1c948f-c541-41ea-ba51-23ff78d1c0db => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:28:31 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] VM Stopped (Lifecycle Event)
Aug 16 22:28:31 user nova-compute[72773]: DEBUG nova.compute.manager [None req-70e0f61e-e1e9-4a3d-82a2-374106bf0113 None None] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:28:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:31 user nova-compute[72773]: DEBUG nova.compute.manager [req-203ed4f7-002c-4b6f-9edc-7ce648b83b08 req-ef089633-6b7e-41de-9550-b71ba128a368 service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Received event network-vif-plugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:28:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-203ed4f7-002c-4b6f-9edc-7ce648b83b08 req-ef089633-6b7e-41de-9550-b71ba128a368 service nova] Acquiring lock "030d076d-5099-4236-ae31-6025017eb51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:28:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-203ed4f7-002c-4b6f-9edc-7ce648b83b08 req-ef089633-6b7e-41de-9550-b71ba128a368 service nova] Lock "030d076d-5099-4236-ae31-6025017eb51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:28:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-203ed4f7-002c-4b6f-9edc-7ce648b83b08 req-ef089633-6b7e-41de-9550-b71ba128a368 service nova] Lock "030d076d-5099-4236-ae31-6025017eb51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:28:31 user nova-compute[72773]: DEBUG nova.compute.manager [req-203ed4f7-002c-4b6f-9edc-7ce648b83b08 req-ef089633-6b7e-41de-9550-b71ba128a368 service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] No waiting events found dispatching network-vif-plugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:28:31 user nova-compute[72773]: WARNING nova.compute.manager [req-203ed4f7-002c-4b6f-9edc-7ce648b83b08 req-ef089633-6b7e-41de-9550-b71ba128a368 service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Received unexpected event network-vif-plugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c for instance with vm_state building and task_state spawning.
Aug 16 22:28:31 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:28:31 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Took 1.14 seconds to deallocate network for instance.
Aug 16 22:28:31 user nova-compute[72773]: DEBUG nova.compute.manager [req-0889d97f-c714-4eea-8e89-b412c168cf2a req-b482bb3e-6a0d-45fe-8d43-28ef8b44fa39 service nova] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Received event network-vif-deleted-c0ab5700-b895-412c-acca-e116a216cc89 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:28:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f74b7c32-a472-4713-be3a-3c3c48cf2890 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:28:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f74b7c32-a472-4713-be3a-3c3c48cf2890 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:28:32 user nova-compute[72773]: DEBUG nova.compute.manager [req-ac79dc20-7df0-4b1e-b19c-e97219a6d754 req-53e97816-a3ea-46b1-b405-6651540ef250 service nova] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Received event network-vif-plugged-c0ab5700-b895-412c-acca-e116a216cc89 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:28:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ac79dc20-7df0-4b1e-b19c-e97219a6d754 req-53e97816-a3ea-46b1-b405-6651540ef250 service nova] Acquiring lock "aa4cbd72-a11c-4dab-b2e2-29fe10493931-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:28:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ac79dc20-7df0-4b1e-b19c-e97219a6d754 req-53e97816-a3ea-46b1-b405-6651540ef250 service nova] Lock "aa4cbd72-a11c-4dab-b2e2-29fe10493931-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:28:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ac79dc20-7df0-4b1e-b19c-e97219a6d754 req-53e97816-a3ea-46b1-b405-6651540ef250 service nova] Lock "aa4cbd72-a11c-4dab-b2e2-29fe10493931-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:28:32 user nova-compute[72773]: DEBUG nova.compute.manager [req-ac79dc20-7df0-4b1e-b19c-e97219a6d754 req-53e97816-a3ea-46b1-b405-6651540ef250 service nova] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] No waiting events found dispatching network-vif-plugged-c0ab5700-b895-412c-acca-e116a216cc89 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:28:32 user nova-compute[72773]: WARNING nova.compute.manager [req-ac79dc20-7df0-4b1e-b19c-e97219a6d754 req-53e97816-a3ea-46b1-b405-6651540ef250 service nova] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Received unexpected event network-vif-plugged-c0ab5700-b895-412c-acca-e116a216cc89 for instance with vm_state deleted and task_state None.
Aug 16 22:28:32 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-f74b7c32-a472-4713-be3a-3c3c48cf2890 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:28:32 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-f74b7c32-a472-4713-be3a-3c3c48cf2890 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:28:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f74b7c32-a472-4713-be3a-3c3c48cf2890 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.408s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:28:32 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-f74b7c32-a472-4713-be3a-3c3c48cf2890 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Deleted allocations for instance aa4cbd72-a11c-4dab-b2e2-29fe10493931
Aug 16 22:28:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f74b7c32-a472-4713-be3a-3c3c48cf2890 tempest-AttachSCSIVolumeTestJSON-445128069 tempest-AttachSCSIVolumeTestJSON-445128069-project-member] Lock "aa4cbd72-a11c-4dab-b2e2-29fe10493931" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.028s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcaxtOdV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8bbb196d-e352-47a5-86fb-a819723c2ce8', 'attached_at': '', 'detached_at': '', 'volume_id': '21817152-fc90-4056-880a-bb9a26a3edf2', 'serial': '21817152-fc90-4056-880a-bb9a26a3edf2'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YMiWyPQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '8bbb196d-e352-47a5-86fb-a819723c2ce8', 'attached_at': '', 'detached_at': '', 'volume_id': '3cfa9b4b-47b9-4700-9c81-d6dfaba199f7', 'serial'} {{(pid=72773) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcaxtOdV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:28:33 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:28:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:28:33 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:28:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:28:33 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:28:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224913.7459204, 030d076d-5099-4236-ae31-6025017eb51e => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:28:33 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 030d076d-5099-4236-ae31-6025017eb51e] VM Resumed (Lifecycle Event)
Aug 16 22:28:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:28:33 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Instance spawned successfully.
Aug 16 22:28:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a00823b-a3b8-4cb1-9578-3229c422eb53]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:28:33 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[be67ae60-1daa-421f-94cd-94ae378955ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2] added
Aug 16 22:28:33 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:28:33 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 030d076d-5099-4236-ae31-6025017eb51e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:28:33 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224913.7495158, 030d076d-5099-4236-ae31-6025017eb51e => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:28:33 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 030d076d-5099-4236-ae31-6025017eb51e] VM Started (Lifecycle Event)
Aug 16 22:28:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce5f3a3-d1df-4eed-9a67-55c3dbbceb74]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad332a4e-99f5-4425-bf05-7ec5c2470144]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PcaxtOdV {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:33 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 030d076d-5099-4236-ae31-6025017eb51e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:28:33 user nova-compute[72773]: INFO nova.compute.manager [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Took 5.87 seconds to spawn the instance on the hypervisor.
Aug 16 22:28:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PcaxtOdV" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[984b5bf4-0512-4780-a245-670fe75d4d20]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PcaxtOdV'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bf5088-7713-47ed-a195-7f22bfa20a05]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80a46d0-b8ad-4aaf-9803-b251967a8398]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)
Aug 16 22:28:33 user nova-compute[72773]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:28:33 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:28:33 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:28:33 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:28:33 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:28:33 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)
Aug 16 22:28:33 user nova-compute[72773]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:28:33 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:28:33 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:28:33 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:28:33 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:28:33 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:33 user nova-compute[72773]: INFO nova.compute.manager [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Took 43.97 seconds to build instance.
Aug 16 22:28:33 user nova-compute[72773]: DEBUG nova.compute.manager [req-7dd5a322-b1dd-40f6-a2b2-27e3f7a72da2 req-67b77952-da90-463a-b5cb-97d0faf1c2e7 service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Received event network-vif-plugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-7dd5a322-b1dd-40f6-a2b2-27e3f7a72da2 req-67b77952-da90-463a-b5cb-97d0faf1c2e7 service nova] Acquiring lock "030d076d-5099-4236-ae31-6025017eb51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-7dd5a322-b1dd-40f6-a2b2-27e3f7a72da2 req-67b77952-da90-463a-b5cb-97d0faf1c2e7 service nova] Lock "030d076d-5099-4236-ae31-6025017eb51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-7dd5a322-b1dd-40f6-a2b2-27e3f7a72da2 req-67b77952-da90-463a-b5cb-97d0faf1c2e7 service nova] Lock "030d076d-5099-4236-ae31-6025017eb51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:28:33 user nova-compute[72773]: DEBUG nova.compute.manager [req-7dd5a322-b1dd-40f6-a2b2-27e3f7a72da2 req-67b77952-da90-463a-b5cb-97d0faf1c2e7 service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] No waiting events found dispatching network-vif-plugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:28:33 user nova-compute[72773]: WARNING nova.compute.manager [req-7dd5a322-b1dd-40f6-a2b2-27e3f7a72da2 req-67b77952-da90-463a-b5cb-97d0faf1c2e7 service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Received unexpected event network-vif-plugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c for instance with vm_state active and task_state None.
Aug 16 22:28:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e43a23c0-6728-4174-82eb-a82ed0e3386e tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "030d076d-5099-4236-ae31-6025017eb51e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 44.104s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:28:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57bdd9d-4862-4571-880a-001763b80d03]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2, portal: 172.16.0.220,3260]
Aug 16 22:28:34 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2, portal: 172.16.0.220,3260] successful.
Aug 16 22:28:34 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f897fbb6-4357-4ca5-8a37-ea69753ba9cc]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc63723-aab2-4855-8a7f-5aca32cd3a3d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)
Aug 16 22:28:34 user nova-compute[72773]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:28:34 user nova-compute[72773]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 (non-flash)
Aug 16 22:28:34 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:28:34 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:28:34 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:28:34 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:28:34 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:28:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)
Aug 16 22:28:34 user nova-compute[72773]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:28:34 user nova-compute[72773]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 (non-flash)
Aug 16 22:28:34 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:28:34 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:28:34 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:28:34 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:28:34 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:28:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:28:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:28:34 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] HCTL ('37', '-', '-', 0) found on session 13 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:28:34 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:28:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d5691b-6ac3-40f3-b96f-e1839da6bb15]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:34 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Searching for a device in session 13 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:28:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcaxtOdV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:28:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:28:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '26230623563633563', 'path': '/dev/sdf'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:28:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230623563633563', 'path': '/dev/sdf'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:28:35 user nova-compute[72773]: DEBUG nova.objects.instance [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Lazy-loading 'flavor' on Instance uuid 8bbb196d-e352-47a5-86fb-a819723c2ce8 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:28:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72773) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 22:28:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] COPY block job progress, current cursor: 119537664 final cursor: 1073741824 {{(pid=72773) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 22:28:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] COPY block job progress, current cursor: 268435456 final cursor: 1073741824 {{(pid=72773) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 22:28:37 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] COPY block job progress, current cursor: 447741952 final cursor: 1073741824 {{(pid=72773) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 22:28:37 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] COPY block job progress, current cursor: 586153984 final cursor: 1073741824 {{(pid=72773) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 22:28:38 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] COPY block job progress, current cursor: 760217600 final cursor: 1073741824 {{(pid=72773) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 22:28:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:38 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] COPY block job progress, current cursor: 922746880 final cursor: 1073741824 {{(pid=72773) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72773) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YMiWyPQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:28:39 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:28:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8fc660-b1eb-4004-8ab9-58de27226998]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7247b3-6492-40b1-bb4c-78c9a2cf1d3e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)
Aug 16 22:28:39 user nova-compute[72773]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:28:39 user nova-compute[72773]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 (non-flash)
Aug 16 22:28:39 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:28:39 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:28:39 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:28:39 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:28:39 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)
Aug 16 22:28:39 user nova-compute[72773]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:28:39 user nova-compute[72773]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 (non-flash)
Aug 16 22:28:39 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:28:39 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:28:39 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:28:39 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:28:39 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef802fd120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7'): ({'sdh'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Removing single pathed devices sdh {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2513ef55-c911-4243-96c0-a2d18da245b2]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb19b15-b747-40dd-85b7-6a94b4c6a69e]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Flushing IO for device /dev/sdh {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dab9f3f-220e-4eec-8b04-95ebca648aa9]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.042s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[601714a1-1ded-4bc9-8716-2021408f6a17]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] SCSI volumes sdh have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7f38c7-1154-4511-a8fb-83d86fc4cad7]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.106s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ce2bea-06d0-4845-a828-b279f99c8f40]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7, portal: 172.16.0.220,3260]
Aug 16 22:28:39 user nova-compute[72773]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7, portal: 172.16.0.220,3260] successful.
Aug 16 22:28:39 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8f9b45-54a4-4088-8ed5-2a546ace764c]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] <== disconnect_volume: return (350ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG nova.compute.manager [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcaxtOdV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '8bbb196d-e352-47a5-86fb-a819723c2ce8', 'attached_at': '', 'detached_at': '', 'volume_id': '21817152-fc90-4056-880a-bb9a26a3edf2', 'serial'} {{(pid=72773) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 16 22:28:39 user nova-compute[72773]: DEBUG nova.compute.manager [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] swap_volume: removing Cinder connection for volume 3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 {{(pid=72773) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 16 22:28:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] swap_volume: Updating volume 3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "PcaxtOdV", "auth_password": "rGZqDevf9bd5O4", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "21817152-fc90-4056-880a-bb9a26a3edf2"}, "status": "reserved", "instance": "8bbb196d-e352-47a5-86fb-a819723c2ce8", "attached_at": "", "detached_at": "", "volume_id": "21817152-fc90-4056-880a-bb9a26a3edf2", "serial": "21817152-fc90-4056-880a-bb9a26a3edf2"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '21817152-fc90-4056-880a-bb9a26a3edf2', 'no_device': None, 'attachment_id': 'f370be37-4871-4304-b505-0b43f3c8d824'} {{(pid=72773) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 16 22:28:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4d5aa97e-aa25-474e-898e-81fc0d0c57e5 tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Lock "8bbb196d-e352-47a5-86fb-a819723c2ce8" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 20.614s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:28:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Acquiring lock "8bbb196d-e352-47a5-86fb-a819723c2ce8" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:28:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Lock "8bbb196d-e352-47a5-86fb-a819723c2ce8" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:28:41 user nova-compute[72773]: DEBUG os_brick.utils [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:28:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86dd746-83b5-4654-b8d0-0a7f126d73e4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[41370c9a-1c6e-4519-908c-23b9017dd072]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d13e52-bd2a-429a-af22-3fe6ca05aeff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[96df1a8f-4a43-456f-b04a-76eccb53efb6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:28:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:28:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:28:41 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:28:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4857c2-43ad-4429-8ee7-cc817c0a4c38]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:28:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:28:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:28:41 user nova-compute[72773]: DEBUG os_brick.utils [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:28:41 user nova-compute[72773]: INFO nova.compute.manager [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Swapping volume 21817152-fc90-4056-880a-bb9a26a3edf2 for 3cfa9b4b-47b9-4700-9c81-d6dfaba199f7
Aug 16 22:28:41 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:43 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:28:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:44 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:28:44 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:28:44 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:28:45 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:28:45 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:28:45 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692224910.704409, aa4cbd72-a11c-4dab-b2e2-29fe10493931 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:28:45 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] VM Stopped (Lifecycle Event)
Aug 16 22:28:45 user nova-compute[72773]: DEBUG nova.compute.manager [None req-964e15ea-194d-4e5e-b083-c253be3410fd None None] [instance: aa4cbd72-a11c-4dab-b2e2-29fe10493931] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:28:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:47 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:28:47 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:28:47 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:28:47 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Skipping network cache update for instance because it has been migrated to another host. {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9886}}
Aug 16 22:28:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Acquiring lock "94ae5694-f56f-4560-a3cc-edc4a59def18" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:28:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "94ae5694-f56f-4560-a3cc-edc4a59def18" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:28:47 user nova-compute[72773]: DEBUG nova.compute.manager [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:28:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:28:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:28:47 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:28:47 user nova-compute[72773]: INFO nova.compute.claims [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Claim successful on node user
Aug 16 22:28:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-4387131d-7a86-477a-a231-69713b2d965d" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:28:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-4387131d-7a86-477a-a231-69713b2d965d" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:28:47 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 22:28:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ddea4008-64d1-4d4f-8e3e-e4aff8091643 tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Acquiring lock "dbfa3908-7c4c-4c7d-a04f-672a8c52ca89" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:28:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ddea4008-64d1-4d4f-8e3e-e4aff8091643 tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Lock "dbfa3908-7c4c-4c7d-a04f-672a8c52ca89" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:28:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ddea4008-64d1-4d4f-8e3e-e4aff8091643 tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Acquiring lock "dbfa3908-7c4c-4c7d-a04f-672a8c52ca89-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:28:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ddea4008-64d1-4d4f-8e3e-e4aff8091643 tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Lock "dbfa3908-7c4c-4c7d-a04f-672a8c52ca89-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:28:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ddea4008-64d1-4d4f-8e3e-e4aff8091643 tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Lock "dbfa3908-7c4c-4c7d-a04f-672a8c52ca89-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:28:47 user nova-compute[72773]: INFO nova.compute.manager [None req-ddea4008-64d1-4d4f-8e3e-e4aff8091643 tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Terminating instance
Aug 16 22:28:47 user nova-compute[72773]: DEBUG nova.compute.manager [None req-ddea4008-64d1-4d4f-8e3e-e4aff8091643 tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:28:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:48 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:28:48 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:28:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.596s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:28:48 user nova-compute[72773]: DEBUG nova.compute.manager [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:28:48 user nova-compute[72773]: DEBUG nova.compute.manager [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:28:48 user nova-compute[72773]: DEBUG nova.network.neutron [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:28:48 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:28:48 user nova-compute[72773]: DEBUG nova.compute.manager [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:28:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:48 user nova-compute[72773]: DEBUG nova.compute.manager [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:28:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:28:48 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Creating image(s)
Aug 16 22:28:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Acquiring lock "/opt/stack/data/nova/instances/94ae5694-f56f-4560-a3cc-edc4a59def18/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:28:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "/opt/stack/data/nova/instances/94ae5694-f56f-4560-a3cc-edc4a59def18/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:28:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "/opt/stack/data/nova/instances/94ae5694-f56f-4560-a3cc-edc4a59def18/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:28:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:48 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Instance destroyed successfully.
Aug 16 22:28:48 user nova-compute[72773]: DEBUG nova.objects.instance [None req-ddea4008-64d1-4d4f-8e3e-e4aff8091643 tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Lazy-loading 'resources' on Instance uuid dbfa3908-7c4c-4c7d-a04f-672a8c52ca89 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:28:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-ddea4008-64d1-4d4f-8e3e-e4aff8091643 tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:26:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-356436697',display_name='tempest-VolumesActionsTest-instance-356436697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-356436697',id=10,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:26:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48facceddcd84885acb1d719ee6b6fe4',ramdisk_id='',reservation_id='r-llefm4um',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1396899120',owner_user_name='tempest-VolumesActionsTest-1396899120-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:26:20Z,user_data=None,user_id='c35e2d6fa19149818d643673a3506401',uuid=dbfa3908-7c4c-4c7d-a04f-672a8c52ca89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca6a5116-be17-41d1-82be-140d0b6df7d7", "address": "fa:16:3e:ad:a8:58", "network": {"id": "8f06d9ea-90a9-4ade-9b5e-25eb1f1c6ca5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2137341653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48facceddcd84885acb1d719ee6b6fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca6a5116-be", "ovs_interfaceid": "ca6a5116-be17-41d1-82be-140d0b6df7d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:28:48 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-ddea4008-64d1-4d4f-8e3e-e4aff8091643 tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Converting VIF {"id": "ca6a5116-be17-41d1-82be-140d0b6df7d7", "address": "fa:16:3e:ad:a8:58", "network": {"id": "8f06d9ea-90a9-4ade-9b5e-25eb1f1c6ca5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2137341653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48facceddcd84885acb1d719ee6b6fe4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca6a5116-be", "ovs_interfaceid": "ca6a5116-be17-41d1-82be-140d0b6df7d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:28:48 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-ddea4008-64d1-4d4f-8e3e-e4aff8091643 tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:a8:58,bridge_name='br-int',has_traffic_filtering=True,id=ca6a5116-be17-41d1-82be-140d0b6df7d7,network=Network(8f06d9ea-90a9-4ade-9b5e-25eb1f1c6ca5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca6a5116-be') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:28:48 user nova-compute[72773]: DEBUG os_vif [None req-ddea4008-64d1-4d4f-8e3e-e4aff8091643 tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:a8:58,bridge_name='br-int',has_traffic_filtering=True,id=ca6a5116-be17-41d1-82be-140d0b6df7d7,network=Network(8f06d9ea-90a9-4ade-9b5e-25eb1f1c6ca5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca6a5116-be') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:28:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca6a5116-be, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:28:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:48 user nova-compute[72773]: DEBUG nova.policy [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cdc2f4b4e44b46689635994d2d3ab066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086072338454300bb7a455bff6d0757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:28:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:28:48 user nova-compute[72773]: INFO os_vif [None req-ddea4008-64d1-4d4f-8e3e-e4aff8091643 tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:a8:58,bridge_name='br-int',has_traffic_filtering=True,id=ca6a5116-be17-41d1-82be-140d0b6df7d7,network=Network(8f06d9ea-90a9-4ade-9b5e-25eb1f1c6ca5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca6a5116-be')
Aug 16 22:28:48 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-ddea4008-64d1-4d4f-8e3e-e4aff8091643 tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Deleting instance files /opt/stack/data/nova/instances/dbfa3908-7c4c-4c7d-a04f-672a8c52ca89_del
Aug 16 22:28:48 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-ddea4008-64d1-4d4f-8e3e-e4aff8091643 tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Deletion of /opt/stack/data/nova/instances/dbfa3908-7c4c-4c7d-a04f-672a8c52ca89_del complete
Aug 16 22:28:48 user nova-compute[72773]: INFO nova.compute.manager [None req-ddea4008-64d1-4d4f-8e3e-e4aff8091643 tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 16 22:28:48 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-ddea4008-64d1-4d4f-8e3e-e4aff8091643 tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:28:48 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:28:48 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:28:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.205s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:28:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:28:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:49 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Updating instance_info_cache with network_info: [{"id": "b757c921-b63d-4724-874a-2b9bd0710124", "address": "fa:16:3e:30:86:c9", "network": {"id": "5f00189e-3c15-4517-85ba-30c0d1de2ee7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-297270230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f27a55e197bd45cab4ca201a5a0b7b04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb757c921-b6", "ovs_interfaceid": "b757c921-b63d-4724-874a-2b9bd0710124", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:28:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.285s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/94ae5694-f56f-4560-a3cc-edc4a59def18/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-4387131d-7a86-477a-a231-69713b2d965d" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:28:49 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 22:28:49 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:28:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:28:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:28:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:28:49 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:28:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/94ae5694-f56f-4560-a3cc-edc4a59def18/disk 1073741824" returned: 0 in 0.150s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.440s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:28:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cd33603-83f3-4d7f-8bed-7db4b4d67c32/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.190s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:49 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Checking if we can resize image /opt/stack/data/nova/instances/94ae5694-f56f-4560-a3cc-edc4a59def18/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:28:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94ae5694-f56f-4560-a3cc-edc4a59def18/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cd33603-83f3-4d7f-8bed-7db4b4d67c32/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cd33603-83f3-4d7f-8bed-7db4b4d67c32/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94ae5694-f56f-4560-a3cc-edc4a59def18/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:49 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Cannot resize image /opt/stack/data/nova/instances/94ae5694-f56f-4560-a3cc-edc4a59def18/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:28:49 user nova-compute[72773]: DEBUG nova.objects.instance [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lazy-loading 'migration_context' on Instance uuid 94ae5694-f56f-4560-a3cc-edc4a59def18 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:28:49 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:28:49 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Ensure instance console log exists: /opt/stack/data/nova/instances/94ae5694-f56f-4560-a3cc-edc4a59def18/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:28:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:28:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:28:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:28:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cd33603-83f3-4d7f-8bed-7db4b4d67c32/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbb196d-e352-47a5-86fb-a819723c2ce8/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbb196d-e352-47a5-86fb-a819723c2ce8/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbb196d-e352-47a5-86fb-a819723c2ce8/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:50 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:28:50 user nova-compute[72773]: DEBUG nova.compute.manager [req-e1d2b240-cd57-4105-886f-aae3898f8425 req-9e435106-f5cc-4521-bc33-823b060b70b3 service nova] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Received event network-vif-deleted-ca6a5116-be17-41d1-82be-140d0b6df7d7 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:28:50 user nova-compute[72773]: INFO nova.compute.manager [req-e1d2b240-cd57-4105-886f-aae3898f8425 req-9e435106-f5cc-4521-bc33-823b060b70b3 service nova] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Neutron deleted interface ca6a5116-be17-41d1-82be-140d0b6df7d7; detaching it from the instance and deleting it from the info cache
Aug 16 22:28:50 user nova-compute[72773]: DEBUG nova.network.neutron [req-e1d2b240-cd57-4105-886f-aae3898f8425 req-9e435106-f5cc-4521-bc33-823b060b70b3 service nova] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:28:50 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Took 1.36 seconds to deallocate network for instance.
Aug 16 22:28:50 user nova-compute[72773]: DEBUG nova.compute.manager [req-e1d2b240-cd57-4105-886f-aae3898f8425 req-9e435106-f5cc-4521-bc33-823b060b70b3 service nova] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Detach interface failed, port_id=ca6a5116-be17-41d1-82be-140d0b6df7d7, reason: Instance dbfa3908-7c4c-4c7d-a04f-672a8c52ca89 could not be found. {{(pid=72773) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 22:28:50 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbb196d-e352-47a5-86fb-a819723c2ce8/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:50 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:28:50 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ddea4008-64d1-4d4f-8e3e-e4aff8091643 tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:28:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ddea4008-64d1-4d4f-8e3e-e4aff8091643 tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:28:50 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:50 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:50 user nova-compute[72773]: DEBUG nova.network.neutron [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Successfully created port: 40af08fd-63ff-47fc-8a4a-d01047a902bd {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:28:50 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:50 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:28:50 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:50 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-ddea4008-64d1-4d4f-8e3e-e4aff8091643 tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:28:50 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-ddea4008-64d1-4d4f-8e3e-e4aff8091643 tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:28:50 user nova-compute[72773]: DEBUG nova.compute.manager [req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db req-8c21eb6f-b59e-42da-a7b4-a118725b546b service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Received event volume-reimaged-fb687b38-4616-4b0b-bee3-4ff1da040b18 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:28:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db req-8c21eb6f-b59e-42da-a7b4-a118725b546b service nova] Acquiring lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:28:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db req-8c21eb6f-b59e-42da-a7b4-a118725b546b service nova] Lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:28:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db req-8c21eb6f-b59e-42da-a7b4-a118725b546b service nova] Lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:28:50 user nova-compute[72773]: DEBUG nova.compute.manager [req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db req-8c21eb6f-b59e-42da-a7b4-a118725b546b service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Processing event volume-reimaged-fb687b38-4616-4b0b-bee3-4ff1da040b18 {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 16 22:28:50 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Instance event wait completed in 30 seconds for volume-reimaged {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:28:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ddea4008-64d1-4d4f-8e3e-e4aff8091643 tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.584s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:28:50 user nova-compute[72773]: INFO nova.virt.block_device [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Booting with volume fb687b38-4616-4b0b-bee3-4ff1da040b18 at /dev/vda
Aug 16 22:28:50 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-ddea4008-64d1-4d4f-8e3e-e4aff8091643 tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Deleted allocations for instance dbfa3908-7c4c-4c7d-a04f-672a8c52ca89
Aug 16 22:28:50 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:50 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:50 user nova-compute[72773]: DEBUG os_brick.utils [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:28:50 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:50 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:50 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4740f8d-e509-4f4d-a3bf-119396b486a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d320ae6-dce6-48b9-827b-24732d053589]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d105dd7-5c11-4dd1-b13b-49ca921cd268]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ddea4008-64d1-4d4f-8e3e-e4aff8091643 tempest-VolumesActionsTest-1396899120 tempest-VolumesActionsTest-1396899120-project-member] Lock "dbfa3908-7c4c-4c7d-a04f-672a8c52ca89" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.272s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:28:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[851c3ed3-67f9-465d-b219-eec41dd912d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:28:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:28:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:28:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:28:51 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:28:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cb742f-8de3-4f25-8501-cfbad59be3e7]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:28:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:28:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:28:51 user nova-compute[72773]: DEBUG os_brick.utils [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:28:51 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Updating existing volume attachment record: b3cf238e-d594-4e0d-9085-77bb52e9be26 {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:28:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:28:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:28:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:28:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4387131d-7a86-477a-a231-69713b2d965d/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4387131d-7a86-477a-a231-69713b2d965d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4387131d-7a86-477a-a231-69713b2d965d/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4387131d-7a86-477a-a231-69713b2d965d/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:52 user nova-compute[72773]: DEBUG nova.network.neutron [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Successfully updated port: 40af08fd-63ff-47fc-8a4a-d01047a902bd {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:28:52 user nova-compute[72773]: DEBUG nova.compute.manager [req-4bd86397-2444-4cd3-89ab-6090e6521025 req-538b2619-d6e2-4de2-bade-c7cacd68f717 service nova] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Received event network-changed-40af08fd-63ff-47fc-8a4a-d01047a902bd {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:28:52 user nova-compute[72773]: DEBUG nova.compute.manager [req-4bd86397-2444-4cd3-89ab-6090e6521025 req-538b2619-d6e2-4de2-bade-c7cacd68f717 service nova] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Refreshing instance network info cache due to event network-changed-40af08fd-63ff-47fc-8a4a-d01047a902bd. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:28:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4bd86397-2444-4cd3-89ab-6090e6521025 req-538b2619-d6e2-4de2-bade-c7cacd68f717 service nova] Acquiring lock "refresh_cache-94ae5694-f56f-4560-a3cc-edc4a59def18" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:28:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4bd86397-2444-4cd3-89ab-6090e6521025 req-538b2619-d6e2-4de2-bade-c7cacd68f717 service nova] Acquired lock "refresh_cache-94ae5694-f56f-4560-a3cc-edc4a59def18" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:28:52 user nova-compute[72773]: DEBUG nova.network.neutron [req-4bd86397-2444-4cd3-89ab-6090e6521025 req-538b2619-d6e2-4de2-bade-c7cacd68f717 service nova] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Refreshing network info cache for port 40af08fd-63ff-47fc-8a4a-d01047a902bd {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:28:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Acquiring lock "refresh_cache-94ae5694-f56f-4560-a3cc-edc4a59def18" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:28:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:28:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:28:52 user nova-compute[72773]: INFO nova.compute.manager [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Unshelving
Aug 16 22:28:52 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:28:52 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:28:52 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=7688MB free_disk=25.821823120117188GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:28:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:28:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:28:52 user nova-compute[72773]: DEBUG nova.network.neutron [req-4bd86397-2444-4cd3-89ab-6090e6521025 req-538b2619-d6e2-4de2-bade-c7cacd68f717 service nova] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:28:52 user nova-compute[72773]: INFO nova.virt.block_device [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Booting with volume 33b7060b-4d09-4bef-b22e-75ca0372f0b2 at /dev/vdc
Aug 16 22:28:52 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 956d334e-f190-4625-b144-ab44d2f3321a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:28:52 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 4efab321-f2aa-456c-a1ae-b32f399f694d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:28:52 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 4387131d-7a86-477a-a231-69713b2d965d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:28:52 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance c6adfa95-47ac-40d3-abc1-0c6027507f07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:28:52 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 8bbb196d-e352-47a5-86fb-a819723c2ce8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:28:52 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 2c1c948f-c541-41ea-ba51-23ff78d1c0db actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:28:52 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance df2acdf5-7c83-4129-8cab-da9882e1ac69 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:28:52 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 030d076d-5099-4236-ae31-6025017eb51e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:28:52 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 3cd33603-83f3-4d7f-8bed-7db4b4d67c32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:28:52 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 94ae5694-f56f-4560-a3cc-edc4a59def18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:28:52 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 02227d9f-5ddf-42fe-91a8-ce56d76aa274 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 16 22:28:52 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:28:52 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:28:52 user nova-compute[72773]: DEBUG os_brick.utils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:28:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:52 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[122e2ae5-23f1-434b-a13c-b0495773e2af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed3f9f5-e184-48f9-a6db-54787d0f1286]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[323899df-eb34-4ca1-9398-e2fc2dc61022]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[606ebfd0-6b08-4e46-a950-470cbfd1d8db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.network.neutron [req-4bd86397-2444-4cd3-89ab-6090e6521025 req-538b2619-d6e2-4de2-bade-c7cacd68f717 service nova] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4bd86397-2444-4cd3-89ab-6090e6521025 req-538b2619-d6e2-4de2-bade-c7cacd68f717 service nova] Releasing lock "refresh_cache-94ae5694-f56f-4560-a3cc-edc4a59def18" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:28:53 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:28:53 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44f1ebf-ef76-4e12-b51d-112f61434171]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Acquired lock "refresh_cache-94ae5694-f56f-4560-a3cc-edc4a59def18" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.network.neutron [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG os_brick.utils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Updating existing volume attachment record: 198ddbd8-0d40-4654-bbab-fadb8ab179e6 {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.network.neutron [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.666s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.network.neutron [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Updating instance_info_cache with network_info: [{"id": "40af08fd-63ff-47fc-8a4a-d01047a902bd", "address": "fa:16:3e:b7:4b:4e", "network": {"id": "db5b9d7a-8d3c-409c-961b-9bd7d882664c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1507737858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9086072338454300bb7a455bff6d0757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40af08fd-63", "ovs_interfaceid": "40af08fd-63ff-47fc-8a4a-d01047a902bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Releasing lock "refresh_cache-94ae5694-f56f-4560-a3cc-edc4a59def18" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.compute.manager [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Instance network_info: |[{"id": "40af08fd-63ff-47fc-8a4a-d01047a902bd", "address": "fa:16:3e:b7:4b:4e", "network": {"id": "db5b9d7a-8d3c-409c-961b-9bd7d882664c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1507737858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9086072338454300bb7a455bff6d0757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40af08fd-63", "ovs_interfaceid": "40af08fd-63ff-47fc-8a4a-d01047a902bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Start _get_guest_xml network_info=[{"id": "40af08fd-63ff-47fc-8a4a-d01047a902bd", "address": "fa:16:3e:b7:4b:4e", "network": {"id": "db5b9d7a-8d3c-409c-961b-9bd7d882664c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1507737858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9086072338454300bb7a455bff6d0757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40af08fd-63", "ovs_interfaceid": "40af08fd-63ff-47fc-8a4a-d01047a902bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:28:53 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:28:53 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:28:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-546080394',display_name='tempest-VolumesAdminNegativeTest-server-546080394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-546080394',id=14,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9086072338454300bb7a455bff6d0757',ramdisk_id='',reservation_id='r-w9j096m0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2096874148',owner_user_name='tempest-VolumesAdminNegativeTest-2096874148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:28:49Z,user_data=None,user_id='cdc2f4b4e44b46689635994d2d3ab066',uuid=94ae5694-f56f-4560-a3cc-edc4a59def18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40af08fd-63ff-47fc-8a4a-d01047a902bd", "address": "fa:16:3e:b7:4b:4e", "network": {"id": "db5b9d7a-8d3c-409c-961b-9bd7d882664c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1507737858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9086072338454300bb7a455bff6d0757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40af08fd-63", "ovs_interfaceid": "40af08fd-63ff-47fc-8a4a-d01047a902bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Converting VIF {"id": "40af08fd-63ff-47fc-8a4a-d01047a902bd", "address": "fa:16:3e:b7:4b:4e", "network": {"id": "db5b9d7a-8d3c-409c-961b-9bd7d882664c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1507737858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9086072338454300bb7a455bff6d0757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40af08fd-63", "ovs_interfaceid": "40af08fd-63ff-47fc-8a4a-d01047a902bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:4b:4e,bridge_name='br-int',has_traffic_filtering=True,id=40af08fd-63ff-47fc-8a4a-d01047a902bd,network=Network(db5b9d7a-8d3c-409c-961b-9bd7d882664c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40af08fd-63') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.objects.instance [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lazy-loading 'pci_devices' on Instance uuid 94ae5694-f56f-4560-a3cc-edc4a59def18 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:28:53 user nova-compute[72773]:   <uuid>94ae5694-f56f-4560-a3cc-edc4a59def18</uuid>
Aug 16 22:28:53 user nova-compute[72773]:   <name>instance-0000000e</name>
Aug 16 22:28:53 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:28:53 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:28:53 user nova-compute[72773]:   <metadata>
Aug 16 22:28:53 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:28:53 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:28:53 user nova-compute[72773]:       <nova:name>tempest-VolumesAdminNegativeTest-server-546080394</nova:name>
Aug 16 22:28:53 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:28:53</nova:creationTime>
Aug 16 22:28:53 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:28:53 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:28:53 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:28:53 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:28:53 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:28:53 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:28:53 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:28:53 user nova-compute[72773]:       <nova:owner>
Aug 16 22:28:53 user nova-compute[72773]:         <nova:user uuid="cdc2f4b4e44b46689635994d2d3ab066">tempest-VolumesAdminNegativeTest-2096874148-project-member</nova:user>
Aug 16 22:28:53 user nova-compute[72773]:         <nova:project uuid="9086072338454300bb7a455bff6d0757">tempest-VolumesAdminNegativeTest-2096874148</nova:project>
Aug 16 22:28:53 user nova-compute[72773]:       </nova:owner>
Aug 16 22:28:53 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:28:53 user nova-compute[72773]:       <nova:ports>
Aug 16 22:28:53 user nova-compute[72773]:         <nova:port uuid="40af08fd-63ff-47fc-8a4a-d01047a902bd">
Aug 16 22:28:53 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 22:28:53 user nova-compute[72773]:         </nova:port>
Aug 16 22:28:53 user nova-compute[72773]:       </nova:ports>
Aug 16 22:28:53 user nova-compute[72773]:     </nova:instance>
Aug 16 22:28:53 user nova-compute[72773]:   </metadata>
Aug 16 22:28:53 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:28:53 user nova-compute[72773]:     <system>
Aug 16 22:28:53 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:28:53 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:28:53 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:28:53 user nova-compute[72773]:       <entry name="serial">94ae5694-f56f-4560-a3cc-edc4a59def18</entry>
Aug 16 22:28:53 user nova-compute[72773]:       <entry name="uuid">94ae5694-f56f-4560-a3cc-edc4a59def18</entry>
Aug 16 22:28:53 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:28:53 user nova-compute[72773]:     </system>
Aug 16 22:28:53 user nova-compute[72773]:   </sysinfo>
Aug 16 22:28:53 user nova-compute[72773]:   <os>
Aug 16 22:28:53 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:28:53 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:28:53 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:28:53 user nova-compute[72773]:   </os>
Aug 16 22:28:53 user nova-compute[72773]:   <features>
Aug 16 22:28:53 user nova-compute[72773]:     <acpi/>
Aug 16 22:28:53 user nova-compute[72773]:     <apic/>
Aug 16 22:28:53 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:28:53 user nova-compute[72773]:   </features>
Aug 16 22:28:53 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:28:53 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:28:53 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:28:53 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:28:53 user nova-compute[72773]:   </clock>
Aug 16 22:28:53 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:28:53 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:28:53 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:28:53 user nova-compute[72773]:   </cpu>
Aug 16 22:28:53 user nova-compute[72773]:   <devices>
Aug 16 22:28:53 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:28:53 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:28:53 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/94ae5694-f56f-4560-a3cc-edc4a59def18/disk"/>
Aug 16 22:28:53 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:28:53 user nova-compute[72773]:     </disk>
Aug 16 22:28:53 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:28:53 user nova-compute[72773]:       <mac address="fa:16:3e:b7:4b:4e"/>
Aug 16 22:28:53 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:28:53 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:28:53 user nova-compute[72773]:       <target dev="tap40af08fd-63"/>
Aug 16 22:28:53 user nova-compute[72773]:     </interface>
Aug 16 22:28:53 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:28:53 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/94ae5694-f56f-4560-a3cc-edc4a59def18/console.log" append="off"/>
Aug 16 22:28:53 user nova-compute[72773]:     </serial>
Aug 16 22:28:53 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:28:53 user nova-compute[72773]:     <video>
Aug 16 22:28:53 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:28:53 user nova-compute[72773]:     </video>
Aug 16 22:28:53 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:28:53 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:28:53 user nova-compute[72773]:     </rng>
Aug 16 22:28:53 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:28:53 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:28:53 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:28:53 user nova-compute[72773]:     </memballoon>
Aug 16 22:28:53 user nova-compute[72773]:   </devices>
Aug 16 22:28:53 user nova-compute[72773]: </domain>
Aug 16 22:28:53 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:28:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-546080394',display_name='tempest-VolumesAdminNegativeTest-server-546080394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-546080394',id=14,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9086072338454300bb7a455bff6d0757',ramdisk_id='',reservation_id='r-w9j096m0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2096874148',owner_user_name='tempest-VolumesAdminNegativeTest-2096874148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:28:49Z,user_data=None,user_id='cdc2f4b4e44b46689635994d2d3ab066',uuid=94ae5694-f56f-4560-a3cc-edc4a59def18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40af08fd-63ff-47fc-8a4a-d01047a902bd", "address": "fa:16:3e:b7:4b:4e", "network": {"id": "db5b9d7a-8d3c-409c-961b-9bd7d882664c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1507737858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9086072338454300bb7a455bff6d0757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40af08fd-63", "ovs_interfaceid": "40af08fd-63ff-47fc-8a4a-d01047a902bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Converting VIF {"id": "40af08fd-63ff-47fc-8a4a-d01047a902bd", "address": "fa:16:3e:b7:4b:4e", "network": {"id": "db5b9d7a-8d3c-409c-961b-9bd7d882664c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1507737858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9086072338454300bb7a455bff6d0757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40af08fd-63", "ovs_interfaceid": "40af08fd-63ff-47fc-8a4a-d01047a902bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:4b:4e,bridge_name='br-int',has_traffic_filtering=True,id=40af08fd-63ff-47fc-8a4a-d01047a902bd,network=Network(db5b9d7a-8d3c-409c-961b-9bd7d882664c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40af08fd-63') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG os_vif [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:4b:4e,bridge_name='br-int',has_traffic_filtering=True,id=40af08fd-63ff-47fc-8a4a-d01047a902bd,network=Network(db5b9d7a-8d3c-409c-961b-9bd7d882664c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40af08fd-63') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40af08fd-63, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap40af08fd-63, col_values=(('external_ids', {'iface-id': '40af08fd-63ff-47fc-8a4a-d01047a902bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:4b:4e', 'vm-uuid': '94ae5694-f56f-4560-a3cc-edc4a59def18'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:53 user nova-compute[72773]: INFO os_vif [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:4b:4e,bridge_name='br-int',has_traffic_filtering=True,id=40af08fd-63ff-47fc-8a4a-d01047a902bd,network=Network(db5b9d7a-8d3c-409c-961b-9bd7d882664c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40af08fd-63')
Aug 16 22:28:53 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:28:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] No VIF found with MAC fa:16:3e:b7:4b:4e, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:28:54 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:54 user nova-compute[72773]: DEBUG nova.compute.manager [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YMiWyPQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8bbb196d-e352-47a5-86fb-a819723c2ce8', 'attached_at': '', 'detached_at': '', 'volume_id': '3cfa9b4b-47b9-4700-9c81-d6dfaba199f7', 'serial': '3cfa9b4b-47b9-4700-9c81-d6dfaba199f7'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcaxtOdV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '21817152-fc90-4056-880a-bb9a26a3edf2'}, 'status': 'reserved', 'instance': '8bbb196d-e352-47a5-86fb-a819723c2ce8', 'attached_at': '', 'detached_at': '', 'volume_id': '21817152-fc90-4056-880a-bb9a26a3edf2', 'serial'} {{(pid=72773) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 16 22:28:54 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:28:54 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YMiWyPQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:28:54 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:28:54 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:28:54 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:28:54 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:28:54 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:28:54 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:28:54 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:28:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:54 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bf20b8-d4a7-42b1-8c7c-5adda7975616]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:54 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:28:54 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:54 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e722ec1-6d39-422d-a40b-4efed62150e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:54 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7] added
Aug 16 22:28:54 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:54 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9286e5d-fefc-439d-a326-f816fa76fe65]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:54 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:54 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[058d4dcf-cd58-4b96-bd8e-c318e9bfc41c]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:54 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YMiWyPQA {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YMiWyPQA" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:54 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ca7337-457b-4532-ab13-efa246d9877d]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:54 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YMiWyPQA'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:54 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9f8ca4-215c-4e85-afee-6649e4a5a850]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:54 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ae82a3-a5ae-49b6-9ced-c23868434e33]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:28:55 user nova-compute[72773]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 (non-flash)
Aug 16 22:28:55 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:28:55 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:28:55 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:28:55 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:28:55 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:28:55 user nova-compute[72773]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 (non-flash)
Aug 16 22:28:55 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:28:55 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:28:55 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:28:55 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:28:55 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5577e0c4-499b-40a5-915f-ede07b73b7ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7, portal: 172.16.0.220,3260]
Aug 16 22:28:55 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7, portal: 172.16.0.220,3260] successful.
Aug 16 22:28:55 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01a7dbf-5eda-460a-9a86-642a3488167e]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.133s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b251e471-39b7-4e31-9294-ce18664c0108]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:28:55 user nova-compute[72773]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 (non-flash)
Aug 16 22:28:55 user nova-compute[72773]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)
Aug 16 22:28:55 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:28:55 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:28:55 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:28:55 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:28:55 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:28:55 user nova-compute[72773]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 (non-flash)
Aug 16 22:28:55 user nova-compute[72773]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)
Aug 16 22:28:55 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:28:55 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:28:55 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:28:55 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:28:55 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.463s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] HCTL ('39', '-', '-', 0) found on session 15 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63d9dc4-82d5-4625-b15e-0682172e07e8]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Searching for a device in session 15 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YMiWyPQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG nova.compute.manager [req-2f0dbdf5-c220-4778-a6fa-b0776cc4814b req-0bd40394-6d97-40dc-9622-f8f3f62b9367 service nova] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Received event network-vif-plugged-40af08fd-63ff-47fc-8a4a-d01047a902bd {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2f0dbdf5-c220-4778-a6fa-b0776cc4814b req-0bd40394-6d97-40dc-9622-f8f3f62b9367 service nova] Acquiring lock "94ae5694-f56f-4560-a3cc-edc4a59def18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2f0dbdf5-c220-4778-a6fa-b0776cc4814b req-0bd40394-6d97-40dc-9622-f8f3f62b9367 service nova] Lock "94ae5694-f56f-4560-a3cc-edc4a59def18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2f0dbdf5-c220-4778-a6fa-b0776cc4814b req-0bd40394-6d97-40dc-9622-f8f3f62b9367 service nova] Lock "94ae5694-f56f-4560-a3cc-edc4a59def18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:28:55 user nova-compute[72773]: DEBUG nova.compute.manager [req-2f0dbdf5-c220-4778-a6fa-b0776cc4814b req-0bd40394-6d97-40dc-9622-f8f3f62b9367 service nova] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] No waiting events found dispatching network-vif-plugged-40af08fd-63ff-47fc-8a4a-d01047a902bd {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:28:55 user nova-compute[72773]: WARNING nova.compute.manager [req-2f0dbdf5-c220-4778-a6fa-b0776cc4814b req-0bd40394-6d97-40dc-9622-f8f3f62b9367 service nova] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Received unexpected event network-vif-plugged-40af08fd-63ff-47fc-8a4a-d01047a902bd for instance with vm_state building and task_state spawning.
Aug 16 22:28:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.560s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:28:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] <== connect_volume: return (1561ms) {'type': 'block', 'scsi_wwn': '23732646639373731', 'path': '/dev/sdh'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:28:56 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732646639373731', 'path': '/dev/sdh'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:28:56 user nova-compute[72773]: DEBUG nova.objects.instance [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Lazy-loading 'flavor' on Instance uuid 8bbb196d-e352-47a5-86fb-a819723c2ce8 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:28:56 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72773) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 22:28:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] COPY block job progress, current cursor: 143654912 final cursor: 1073741824 {{(pid=72773) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 22:28:57 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224937.784717, 94ae5694-f56f-4560-a3cc-edc4a59def18 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:28:57 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] VM Resumed (Lifecycle Event)
Aug 16 22:28:57 user nova-compute[72773]: DEBUG nova.compute.manager [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:28:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:28:57 user nova-compute[72773]: DEBUG nova.compute.manager [req-ea0a3afd-739d-4fd9-bde2-36beaecfeb7d req-d40a9101-d4b5-48fc-8a7c-132f9a3db01c service nova] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Received event network-vif-plugged-40af08fd-63ff-47fc-8a4a-d01047a902bd {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:28:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ea0a3afd-739d-4fd9-bde2-36beaecfeb7d req-d40a9101-d4b5-48fc-8a7c-132f9a3db01c service nova] Acquiring lock "94ae5694-f56f-4560-a3cc-edc4a59def18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:28:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ea0a3afd-739d-4fd9-bde2-36beaecfeb7d req-d40a9101-d4b5-48fc-8a7c-132f9a3db01c service nova] Lock "94ae5694-f56f-4560-a3cc-edc4a59def18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:28:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ea0a3afd-739d-4fd9-bde2-36beaecfeb7d req-d40a9101-d4b5-48fc-8a7c-132f9a3db01c service nova] Lock "94ae5694-f56f-4560-a3cc-edc4a59def18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:28:57 user nova-compute[72773]: DEBUG nova.compute.manager [req-ea0a3afd-739d-4fd9-bde2-36beaecfeb7d req-d40a9101-d4b5-48fc-8a7c-132f9a3db01c service nova] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] No waiting events found dispatching network-vif-plugged-40af08fd-63ff-47fc-8a4a-d01047a902bd {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:28:57 user nova-compute[72773]: WARNING nova.compute.manager [req-ea0a3afd-739d-4fd9-bde2-36beaecfeb7d req-d40a9101-d4b5-48fc-8a7c-132f9a3db01c service nova] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Received unexpected event network-vif-plugged-40af08fd-63ff-47fc-8a4a-d01047a902bd for instance with vm_state building and task_state spawning.
Aug 16 22:28:57 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Instance spawned successfully.
Aug 16 22:28:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:28:57 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:28:57 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:28:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:28:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:28:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:28:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:28:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:28:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:28:57 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:28:57 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224937.786741, 94ae5694-f56f-4560-a3cc-edc4a59def18 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:28:57 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] VM Started (Lifecycle Event)
Aug 16 22:28:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] COPY block job progress, current cursor: 254803968 final cursor: 1073741824 {{(pid=72773) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 22:28:57 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:28:57 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:28:57 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:28:58 user nova-compute[72773]: INFO nova.compute.manager [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Took 9.42 seconds to spawn the instance on the hypervisor.
Aug 16 22:28:58 user nova-compute[72773]: DEBUG nova.compute.manager [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:28:58 user nova-compute[72773]: INFO nova.compute.manager [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Took 10.48 seconds to build instance.
Aug 16 22:28:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-97054988-9116-4e3e-ada0-6351a908cac6 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "94ae5694-f56f-4560-a3cc-edc4a59def18" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.624s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:28:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] COPY block job progress, current cursor: 411041792 final cursor: 1073741824 {{(pid=72773) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 22:28:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] COPY block job progress, current cursor: 540016640 final cursor: 1073741824 {{(pid=72773) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 22:28:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:28:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] COPY block job progress, current cursor: 663748608 final cursor: 1073741824 {{(pid=72773) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 22:28:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] COPY block job progress, current cursor: 787480576 final cursor: 1073741824 {{(pid=72773) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 22:29:00 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] COPY block job progress, current cursor: 933232640 final cursor: 1073741824 {{(pid=72773) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 22:29:00 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] COPY block job progress, current cursor: 1064304640 final cursor: 1073741824 {{(pid=72773) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72773) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcaxtOdV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '21817152-fc90-4056-880a-bb9a26a3edf2'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:29:01 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:29:01 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2954d0-d093-4401-89a1-38ec0286be53]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c0a906-0bba-48fe-946e-a5e3806301f6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:29:01 user nova-compute[72773]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 (non-flash)
Aug 16 22:29:01 user nova-compute[72773]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)
Aug 16 22:29:01 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:29:01 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:29:01 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:29:01 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:29:01 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:29:01 user nova-compute[72773]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 (non-flash)
Aug 16 22:29:01 user nova-compute[72773]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)
Aug 16 22:29:01 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:29:01 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:29:01 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:29:01 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:29:01 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef802bbb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2'): ({'sdf'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Removing single pathed devices sdf {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b1a907-176b-476e-b307-056f22a9e871]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8af26f8-3ba6-428e-bb4a-1e5ae559df5d]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Flushing IO for device /dev/sdf {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[991686d7-eada-42c6-b0e3-1bc93ddbe91e]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.036s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b44f8ad-9d95-4f3e-aeca-84f314ee8964]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] SCSI volumes sdf have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c42cfc8-99c4-4e72-b39d-d0047fd5996e]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[745b03fb-0acf-4670-9101-22042375d838]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2, portal: 172.16.0.220,3260]
Aug 16 22:29:01 user nova-compute[72773]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2, portal: 172.16.0.220,3260] successful.
Aug 16 22:29:01 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21817152-fc90-4056-880a-bb9a26a3edf2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3c1c98-a0c2-4b86-934e-a008b4bc774e]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] <== disconnect_volume: return (322ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG nova.compute.manager [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YMiWyPQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '8bbb196d-e352-47a5-86fb-a819723c2ce8', 'attached_at': '', 'detached_at': '', 'volume_id': '3cfa9b4b-47b9-4700-9c81-d6dfaba199f7', 'serial'} {{(pid=72773) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 16 22:29:01 user nova-compute[72773]: DEBUG nova.compute.manager [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] swap_volume: removing Cinder connection for volume 21817152-fc90-4056-880a-bb9a26a3edf2 {{(pid=72773) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 16 22:29:03 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692224928.6085784, dbfa3908-7c4c-4c7d-a04f-672a8c52ca89 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:29:03 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] VM Stopped (Lifecycle Event)
Aug 16 22:29:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:03 user nova-compute[72773]: DEBUG nova.compute.manager [None req-ff68836d-690f-4f0d-a5f4-8767ab9ac7b8 None None] [instance: dbfa3908-7c4c-4c7d-a04f-672a8c52ca89] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:29:04 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:07 user nova-compute[72773]: DEBUG nova.objects.instance [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lazy-loading 'pci_requests' on Instance uuid 02227d9f-5ddf-42fe-91a8-ce56d76aa274 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:29:07 user nova-compute[72773]: DEBUG nova.objects.instance [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lazy-loading 'numa_topology' on Instance uuid 02227d9f-5ddf-42fe-91a8-ce56d76aa274 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:29:07 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:29:07 user nova-compute[72773]: INFO nova.compute.claims [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Claim successful on node user
Aug 16 22:29:07 user nova-compute[72773]: DEBUG nova.compute.manager [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] swap_volume: Updating volume 21817152-fc90-4056-880a-bb9a26a3edf2 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "YMiWyPQA", "auth_password": "P26cBn10RSaLkE", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "3cfa9b4b-47b9-4700-9c81-d6dfaba199f7"}, "status": "reserved", "instance": "8bbb196d-e352-47a5-86fb-a819723c2ce8", "attached_at": "", "detached_at": "", "volume_id": "3cfa9b4b-47b9-4700-9c81-d6dfaba199f7", "serial": "3cfa9b4b-47b9-4700-9c81-d6dfaba199f7"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '3cfa9b4b-47b9-4700-9c81-d6dfaba199f7', 'no_device': None, 'attachment_id': '692a93c6-eb37-441c-99fc-12143a05e160'} {{(pid=72773) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 16 22:29:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ddde5193-8bba-42e9-b6d9-7b912bfb09ba tempest-TestVolumeSwap-1979528341 tempest-TestVolumeSwap-1979528341-project-admin] Lock "8bbb196d-e352-47a5-86fb-a819723c2ce8" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 26.430s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:08 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:29:08 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:29:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.548s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:08 user nova-compute[72773]: INFO nova.network.neutron [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Updating port 26ca6ee6-83b5-4553-b31c-d1b135b219e9 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 16 22:29:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1d72ac56-4a7b-4890-960c-7bd2ebd68f3c tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Acquiring lock "8bbb196d-e352-47a5-86fb-a819723c2ce8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1d72ac56-4a7b-4890-960c-7bd2ebd68f3c tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Lock "8bbb196d-e352-47a5-86fb-a819723c2ce8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:09 user nova-compute[72773]: INFO nova.compute.manager [None req-1d72ac56-4a7b-4890-960c-7bd2ebd68f3c tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Detaching volume 3cfa9b4b-47b9-4700-9c81-d6dfaba199f7
Aug 16 22:29:09 user nova-compute[72773]: INFO nova.virt.block_device [None req-1d72ac56-4a7b-4890-960c-7bd2ebd68f3c tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Attempting to driver detach volume 3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 from mountpoint /dev/vdb
Aug 16 22:29:09 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1d72ac56-4a7b-4890-960c-7bd2ebd68f3c tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Attempting to detach device vdb from instance 8bbb196d-e352-47a5-86fb-a819723c2ce8 from the persistent domain config. {{(pid=72773) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-1d72ac56-4a7b-4890-960c-7bd2ebd68f3c tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:29:09 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:29:09 user nova-compute[72773]:   <source dev="/dev/sdh"/>
Aug 16 22:29:09 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:29:09 user nova-compute[72773]:   <serial>3cfa9b4b-47b9-4700-9c81-d6dfaba199f7</serial>
Aug 16 22:29:09 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:29:09 user nova-compute[72773]: </disk>
Aug 16 22:29:09 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:29:09 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-1d72ac56-4a7b-4890-960c-7bd2ebd68f3c tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Successfully detached device vdb from instance 8bbb196d-e352-47a5-86fb-a819723c2ce8 from the persistent domain config.
Aug 16 22:29:09 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1d72ac56-4a7b-4890-960c-7bd2ebd68f3c tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8bbb196d-e352-47a5-86fb-a819723c2ce8 from the live domain config. {{(pid=72773) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-1d72ac56-4a7b-4890-960c-7bd2ebd68f3c tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:29:09 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:29:09 user nova-compute[72773]:   <source dev="/dev/sdh"/>
Aug 16 22:29:09 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:29:09 user nova-compute[72773]:   <serial>3cfa9b4b-47b9-4700-9c81-d6dfaba199f7</serial>
Aug 16 22:29:09 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:29:09 user nova-compute[72773]: </disk>
Aug 16 22:29:09 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "refresh_cache-02227d9f-5ddf-42fe-91a8-ce56d76aa274" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquired lock "refresh_cache-02227d9f-5ddf-42fe-91a8-ce56d76aa274" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG nova.network.neutron [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG nova.compute.manager [req-ea254157-7d42-426e-99ba-7d660f688a58 req-95a5d367-bf70-4681-b6aa-5b1630e86d98 service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Received event network-changed-26ca6ee6-83b5-4553-b31c-d1b135b219e9 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG nova.compute.manager [req-ea254157-7d42-426e-99ba-7d660f688a58 req-95a5d367-bf70-4681-b6aa-5b1630e86d98 service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Refreshing instance network info cache due to event network-changed-26ca6ee6-83b5-4553-b31c-d1b135b219e9. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ea254157-7d42-426e-99ba-7d660f688a58 req-95a5d367-bf70-4681-b6aa-5b1630e86d98 service nova] Acquiring lock "refresh_cache-02227d9f-5ddf-42fe-91a8-ce56d76aa274" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Received event <DeviceRemovedEvent: 1692224949.7865598, 8bbb196d-e352-47a5-86fb-a819723c2ce8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72773) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1d72ac56-4a7b-4890-960c-7bd2ebd68f3c tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8bbb196d-e352-47a5-86fb-a819723c2ce8 {{(pid=72773) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 22:29:09 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-1d72ac56-4a7b-4890-960c-7bd2ebd68f3c tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Successfully detached device vdb from instance 8bbb196d-e352-47a5-86fb-a819723c2ce8 from the live domain config.
Aug 16 22:29:09 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d72ac56-4a7b-4890-960c-7bd2ebd68f3c tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d72ac56-4a7b-4890-960c-7bd2ebd68f3c tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YMiWyPQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '3cfa9b4b-47b9-4700-9c81-d6dfaba199f7'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:29:09 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-1d72ac56-4a7b-4890-960c-7bd2ebd68f3c tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:29:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-1d72ac56-4a7b-4890-960c-7bd2ebd68f3c tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-1d72ac56-4a7b-4890-960c-7bd2ebd68f3c tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d72ac56-4a7b-4890-960c-7bd2ebd68f3c tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2812f59-f294-4705-8e47-a8a8447060b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f54f98e-e337-4f27-af45-2c4c6a957c95]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d72ac56-4a7b-4890-960c-7bd2ebd68f3c tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:29:09 user nova-compute[72773]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)
Aug 16 22:29:09 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:29:09 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:29:09 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:29:09 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:29:09 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d72ac56-4a7b-4890-960c-7bd2ebd68f3c tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:29:09 user nova-compute[72773]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 (non-flash)
Aug 16 22:29:09 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:29:09 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:29:09 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:29:09 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:29:09 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d72ac56-4a7b-4890-960c-7bd2ebd68f3c tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef5c585fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7'): ({'sdh'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-1d72ac56-4a7b-4890-960c-7bd2ebd68f3c tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Removing single pathed devices sdh {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2acbc22-ad21-4b4f-8d1f-f7f0424b2f92]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57de284-021e-4326-a28b-b712d55cd112]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-1d72ac56-4a7b-4890-960c-7bd2ebd68f3c tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Flushing IO for device /dev/sdh {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd987437-862a-4582-90bd-4dbf5c73dc4b]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-1d72ac56-4a7b-4890-960c-7bd2ebd68f3c tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.037s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1707dba-21ad-4ddd-a5c9-8960cd982953]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-1d72ac56-4a7b-4890-960c-7bd2ebd68f3c tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-1d72ac56-4a7b-4890-960c-7bd2ebd68f3c tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] SCSI volumes sdh have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d72ac56-4a7b-4890-960c-7bd2ebd68f3c tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:29:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:10 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db67396-07be-4d59-9b29-1a03d415a05e]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:10 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d72ac56-4a7b-4890-960c-7bd2ebd68f3c tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:10 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[621c181c-00f3-440c-9c15-6dd78960f6ef]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:10 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d72ac56-4a7b-4890-960c-7bd2ebd68f3c tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7, portal: 172.16.0.220,3260]
Aug 16 22:29:10 user nova-compute[72773]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7, portal: 172.16.0.220,3260] successful.
Aug 16 22:29:10 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cfa9b4b-47b9-4700-9c81-d6dfaba199f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:10 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[971596f1-6b8c-4dbe-b595-8a296710081a]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:10 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d72ac56-4a7b-4890-960c-7bd2ebd68f3c tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:10 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-1d72ac56-4a7b-4890-960c-7bd2ebd68f3c tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:29:10 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d72ac56-4a7b-4890-960c-7bd2ebd68f3c tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] <== disconnect_volume: return (325ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:29:10 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d72ac56-4a7b-4890-960c-7bd2ebd68f3c tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:29:10 user nova-compute[72773]: DEBUG nova.network.neutron [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Updating instance_info_cache with network_info: [{"id": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "address": "fa:16:3e:4a:54:e0", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ca6ee6-83", "ovs_interfaceid": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:29:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Releasing lock "refresh_cache-02227d9f-5ddf-42fe-91a8-ce56d76aa274" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:29:10 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:29:10 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Creating image(s)
Aug 16 22:29:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "/opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "/opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "/opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:10 user nova-compute[72773]: DEBUG nova.objects.instance [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lazy-loading 'trusted_certs' on Instance uuid 02227d9f-5ddf-42fe-91a8-ce56d76aa274 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:29:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ea254157-7d42-426e-99ba-7d660f688a58 req-95a5d367-bf70-4681-b6aa-5b1630e86d98 service nova] Acquired lock "refresh_cache-02227d9f-5ddf-42fe-91a8-ce56d76aa274" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:29:10 user nova-compute[72773]: DEBUG nova.network.neutron [req-ea254157-7d42-426e-99ba-7d660f688a58 req-95a5d367-bf70-4681-b6aa-5b1630e86d98 service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Refreshing network info cache for port 26ca6ee6-83b5-4553-b31c-d1b135b219e9 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:29:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "f0c0069c3c98713e72e1c1a0d04a94d87c3526d3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "f0c0069c3c98713e72e1c1a0d04a94d87c3526d3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0c0069c3c98713e72e1c1a0d04a94d87c3526d3.part --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0c0069c3c98713e72e1c1a0d04a94d87c3526d3.part --force-share --output=json" returned: 0 in 0.184s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:11 user nova-compute[72773]: DEBUG nova.virt.images [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] 5600fabf-f736-4764-be5b-d59aa75c3865 was qcow2, converting to raw {{(pid=72773) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 22:29:11 user nova-compute[72773]: DEBUG nova.privsep.utils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72773) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 22:29:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f0c0069c3c98713e72e1c1a0d04a94d87c3526d3.part /opt/stack/data/nova/instances/_base/f0c0069c3c98713e72e1c1a0d04a94d87c3526d3.converted {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f0c0069c3c98713e72e1c1a0d04a94d87c3526d3.part /opt/stack/data/nova/instances/_base/f0c0069c3c98713e72e1c1a0d04a94d87c3526d3.converted" returned: 0 in 0.252s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0c0069c3c98713e72e1c1a0d04a94d87c3526d3.converted --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:11 user nova-compute[72773]: DEBUG nova.network.neutron [req-ea254157-7d42-426e-99ba-7d660f688a58 req-95a5d367-bf70-4681-b6aa-5b1630e86d98 service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Updated VIF entry in instance network info cache for port 26ca6ee6-83b5-4553-b31c-d1b135b219e9. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:29:11 user nova-compute[72773]: DEBUG nova.network.neutron [req-ea254157-7d42-426e-99ba-7d660f688a58 req-95a5d367-bf70-4681-b6aa-5b1630e86d98 service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Updating instance_info_cache with network_info: [{"id": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "address": "fa:16:3e:4a:54:e0", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ca6ee6-83", "ovs_interfaceid": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:29:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ea254157-7d42-426e-99ba-7d660f688a58 req-95a5d367-bf70-4681-b6aa-5b1630e86d98 service nova] Releasing lock "refresh_cache-02227d9f-5ddf-42fe-91a8-ce56d76aa274" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:29:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0c0069c3c98713e72e1c1a0d04a94d87c3526d3.converted --force-share --output=json" returned: 0 in 0.200s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "f0c0069c3c98713e72e1c1a0d04a94d87c3526d3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.633s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0c0069c3c98713e72e1c1a0d04a94d87c3526d3 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:29:11 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Creating image(s)
Aug 16 22:29:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Did not create local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 22:29:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Ensure instance console log exists: /opt/stack/data/nova/instances/2c1c948f-c541-41ea-ba51-23ff78d1c0db/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:29:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Start _get_guest_xml network_info=[{"id": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "address": "fa:16:3e:48:cc:48", "network": {"id": "a399052b-0f9b-4c24-a176-7b59221e92a1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-679236513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a863da00c62473b9f3726f45900be0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e021e1c-b5", "ovs_interfaceid": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b3cf238e-d594-4e0d-9085-77bb52e9be26', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abPpkSTl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2c1c948f-c541-41ea-ba51-23ff78d1c0db', 'attached_at': '', 'detached_at': '', 'volume_id': 'fb687b38-4616-4b0b-bee3-4ff1da040b18', 'serial': 'fb687b38-4616-4b0b-bee3-4ff1da040b18'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:29:11 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 22:29:11 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 22:29:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:29:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:29:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:29:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:29:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:29:11 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:29:11 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:29:11 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:29:11 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:29:11 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:29:11 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:29:11 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:29:11 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:29:11 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:29:11 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:29:11 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:29:11 user nova-compute[72773]: DEBUG nova.objects.instance [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2c1c948f-c541-41ea-ba51-23ff78d1c0db {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abPpkSTl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:29:12 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 22:29:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:29:12 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 22:29:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:29:12 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-df6caaa1-46e9-4d4c-aced-c61299f279a6 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Acquiring lock "4387131d-7a86-477a-a231-69713b2d965d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-df6caaa1-46e9-4d4c-aced-c61299f279a6 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Lock "4387131d-7a86-477a-a231-69713b2d965d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-df6caaa1-46e9-4d4c-aced-c61299f279a6 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Acquiring lock "4387131d-7a86-477a-a231-69713b2d965d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-df6caaa1-46e9-4d4c-aced-c61299f279a6 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Lock "4387131d-7a86-477a-a231-69713b2d965d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-df6caaa1-46e9-4d4c-aced-c61299f279a6 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Lock "4387131d-7a86-477a-a231-69713b2d965d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:12 user nova-compute[72773]: INFO nova.compute.manager [None req-df6caaa1-46e9-4d4c-aced-c61299f279a6 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Terminating instance
Aug 16 22:29:12 user nova-compute[72773]: DEBUG nova.compute.manager [None req-df6caaa1-46e9-4d4c-aced-c61299f279a6 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b780bc11-1654-4995-a0dc-6745d2a3eba0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:29:12 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b454839e-7042-4d25-8a30-aeb11bb3ac19]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18] added
Aug 16 22:29:12 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0c0069c3c98713e72e1c1a0d04a94d87c3526d3 --force-share --output=json" returned: 0 in 0.235s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "f0c0069c3c98713e72e1c1a0d04a94d87c3526d3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "f0c0069c3c98713e72e1c1a0d04a94d87c3526d3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0c0069c3c98713e72e1c1a0d04a94d87c3526d3 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca655ff1-5db3-424a-b771-92386fba9cab]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5d4cad-cbeb-4852-a7e1-74b423cccf73]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v abPpkSTl {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v abPpkSTl" returned: 0 in 0.033s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ea37bb-e1d1-493c-9408-7042313d7152]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'abPpkSTl'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4cd2f0-f9d5-40b9-87da-b4f364bd4b84]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff65a877-23bd-4a19-bd3b-24d851beb22a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:29:12 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:29:12 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:29:12 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:29:12 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:29:12 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:29:12 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:29:12 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:29:12 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:29:12 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:29:12 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0c0069c3c98713e72e1c1a0d04a94d87c3526d3 --force-share --output=json" returned: 0 in 0.292s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0c0069c3c98713e72e1c1a0d04a94d87c3526d3,backing_fmt=raw /opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG nova.objects.instance [None req-1d72ac56-4a7b-4890-960c-7bd2ebd68f3c tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Lazy-loading 'flavor' on Instance uuid 8bbb196d-e352-47a5-86fb-a819723c2ce8 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0c0069c3c98713e72e1c1a0d04a94d87c3526d3,backing_fmt=raw /opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk 1073741824" returned: 0 in 0.099s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "f0c0069c3c98713e72e1c1a0d04a94d87c3526d3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.396s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0c0069c3c98713e72e1c1a0d04a94d87c3526d3 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1d72ac56-4a7b-4890-960c-7bd2ebd68f3c tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Lock "8bbb196d-e352-47a5-86fb-a819723c2ce8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.469s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG nova.compute.manager [req-b84421e5-4c0b-4ac2-9ea3-e833eb2428ea req-c6633865-d25c-4614-94f6-2fa1d91a063a service nova] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Received event network-vif-unplugged-b757c921-b63d-4724-874a-2b9bd0710124 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b84421e5-4c0b-4ac2-9ea3-e833eb2428ea req-c6633865-d25c-4614-94f6-2fa1d91a063a service nova] Acquiring lock "4387131d-7a86-477a-a231-69713b2d965d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b84421e5-4c0b-4ac2-9ea3-e833eb2428ea req-c6633865-d25c-4614-94f6-2fa1d91a063a service nova] Lock "4387131d-7a86-477a-a231-69713b2d965d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b84421e5-4c0b-4ac2-9ea3-e833eb2428ea req-c6633865-d25c-4614-94f6-2fa1d91a063a service nova] Lock "4387131d-7a86-477a-a231-69713b2d965d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG nova.compute.manager [req-b84421e5-4c0b-4ac2-9ea3-e833eb2428ea req-c6633865-d25c-4614-94f6-2fa1d91a063a service nova] [instance: 4387131d-7a86-477a-a231-69713b2d965d] No waiting events found dispatching network-vif-unplugged-b757c921-b63d-4724-874a-2b9bd0710124 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG nova.compute.manager [req-b84421e5-4c0b-4ac2-9ea3-e833eb2428ea req-c6633865-d25c-4614-94f6-2fa1d91a063a service nova] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Received event network-vif-unplugged-b757c921-b63d-4724-874a-2b9bd0710124 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0c0069c3c98713e72e1c1a0d04a94d87c3526d3 --force-share --output=json" returned: 0 in 0.196s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG nova.objects.instance [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lazy-loading 'migration_context' on Instance uuid 02227d9f-5ddf-42fe-91a8-ce56d76aa274 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:29:12 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Rebasing disk image.
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:12 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Instance destroyed successfully.
Aug 16 22:29:12 user nova-compute[72773]: DEBUG nova.objects.instance [None req-df6caaa1-46e9-4d4c-aced-c61299f279a6 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Lazy-loading 'resources' on Instance uuid 4387131d-7a86-477a-a231-69713b2d965d {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-df6caaa1-46e9-4d4c-aced-c61299f279a6 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:25:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2115442895',display_name='tempest-VolumesAssistedSnapshotsTest-server-2115442895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2115442895',id=5,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRYhDfT8rkTuCsZud1B58oN0/sq0ayADgvTT4dRhw6mj+39kDHlhNko4F5UZFPEEfuRf9N2oVO5oBiwjHotKtCVc32bGePrGAb4rqgllL0eelRZutnbU0nxTtrxOh/p7w==',key_name='tempest-keypair-2081781708',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:25:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f27a55e197bd45cab4ca201a5a0b7b04',ramdisk_id='',reservation_id='r-8uvuspab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-179215479',owner_user_name='tempest-VolumesAssistedSnapshotsTest-179215479-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:25:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78cd48612b2946d8a32f3256330660e4',uuid=4387131d-7a86-477a-a231-69713b2d965d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b757c921-b63d-4724-874a-2b9bd0710124", "address": "fa:16:3e:30:86:c9", "network": {"id": "5f00189e-3c15-4517-85ba-30c0d1de2ee7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-297270230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f27a55e197bd45cab4ca201a5a0b7b04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb757c921-b6", "ovs_interfaceid": "b757c921-b63d-4724-874a-2b9bd0710124", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-df6caaa1-46e9-4d4c-aced-c61299f279a6 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Converting VIF {"id": "b757c921-b63d-4724-874a-2b9bd0710124", "address": "fa:16:3e:30:86:c9", "network": {"id": "5f00189e-3c15-4517-85ba-30c0d1de2ee7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-297270230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f27a55e197bd45cab4ca201a5a0b7b04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb757c921-b6", "ovs_interfaceid": "b757c921-b63d-4724-874a-2b9bd0710124", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-df6caaa1-46e9-4d4c-aced-c61299f279a6 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:86:c9,bridge_name='br-int',has_traffic_filtering=True,id=b757c921-b63d-4724-874a-2b9bd0710124,network=Network(5f00189e-3c15-4517-85ba-30c0d1de2ee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb757c921-b6') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG os_vif [None req-df6caaa1-46e9-4d4c-aced-c61299f279a6 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:86:c9,bridge_name='br-int',has_traffic_filtering=True,id=b757c921-b63d-4724-874a-2b9bd0710124,network=Network(5f00189e-3c15-4517-85ba-30c0d1de2ee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb757c921-b6') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb757c921-b6, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:29:12 user nova-compute[72773]: INFO os_vif [None req-df6caaa1-46e9-4d4c-aced-c61299f279a6 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:86:c9,bridge_name='br-int',has_traffic_filtering=True,id=b757c921-b63d-4724-874a-2b9bd0710124,network=Network(5f00189e-3c15-4517-85ba-30c0d1de2ee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb757c921-b6')
Aug 16 22:29:12 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-df6caaa1-46e9-4d4c-aced-c61299f279a6 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Deleting instance files /opt/stack/data/nova/instances/4387131d-7a86-477a-a231-69713b2d965d_del
Aug 16 22:29:12 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-df6caaa1-46e9-4d4c-aced-c61299f279a6 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Deletion of /opt/stack/data/nova/instances/4387131d-7a86-477a-a231-69713b2d965d_del complete
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.209s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 -F raw /opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:13 user nova-compute[72773]: INFO nova.compute.manager [None req-df6caaa1-46e9-4d4c-aced-c61299f279a6 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 16 22:29:13 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-df6caaa1-46e9-4d4c-aced-c61299f279a6 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:29:13 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:29:13 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 4387131d-7a86-477a-a231-69713b2d965d] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:29:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --login" returned: 0 in 1.097s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:13 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc6a1a9-eacd-43a8-99ca-d1a3310e137b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18, portal: 172.16.0.220,3260]
Aug 16 22:29:13 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18, portal: 172.16.0.220,3260] successful.
Aug 16 22:29:13 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:13 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e3c888-36e8-4499-ba86-16f86c90618d]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:13 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a4a0b8-d1d1-4f3b-a969-27abbb4c839e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:29:13 user nova-compute[72773]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:29:13 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:29:13 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:29:13 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:29:13 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:29:13 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:29:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:29:13 user nova-compute[72773]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:29:13 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:29:13 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:29:13 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:29:13 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:29:13 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:29:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.465s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:29:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:29:13 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] HCTL ('37', '-', '-', 0) found on session 16 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:29:13 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:29:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:13 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[de746cdd-4883-4aa1-b118-b9a231c1fcd2]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:13 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Searching for a device in session 16 and hctl ['37', '*', '*', 0] yield: None {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:29:13 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:29:13 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Took 0.95 seconds to deallocate network for instance.
Aug 16 22:29:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-df6caaa1-46e9-4d4c-aced-c61299f279a6 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-df6caaa1-46e9-4d4c-aced-c61299f279a6 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:14 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-df6caaa1-46e9-4d4c-aced-c61299f279a6 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:29:14 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-df6caaa1-46e9-4d4c-aced-c61299f279a6 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:29:14 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Searching for a device in session 16 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:29:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abPpkSTl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:29:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.507s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:29:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] <== connect_volume: return (2508ms) {'type': 'block', 'scsi_wwn': '23639383362376532', 'path': '/dev/sdf'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:29:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639383362376532', 'path': '/dev/sdf'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:29:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-df6caaa1-46e9-4d4c-aced-c61299f279a6 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.493s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T22:26:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-959076328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1140763264',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBA6wXj+pYizM4fJfGUIvhwgan4ub6F4+mEVSZeYo3UraSfwK8dHO9ZRWzHCA/0MsTcW4Way+QQ3ZkahEVK/6hRQ7Z4hPQl0XcQMQn6OttJ3+biiwE/FDTRdP2/DP4bJ/g==',key_name='tempest-keypair-1083426637',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:26:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8a863da00c62473b9f3726f45900be0c',ramdisk_id='',reservation_id='r-kdsmsxtr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1773237892',owner_user_name='tempest-ServerActionsV293TestJSON-1773237892-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:28:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='317d00f05a4649c2888f6d30e0a140b8',uuid=2c1c948f-c541-41ea-ba51-23ff78d1c0db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "address": "fa:16:3e:48:cc:48", "network": {"id": "a399052b-0f9b-4c24-a176-7b59221e92a1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-679236513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a863da00c62473b9f3726f45900be0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e021e1c-b5", "ovs_interfaceid": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:29:14 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Converting VIF {"id": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "address": "fa:16:3e:48:cc:48", "network": {"id": "a399052b-0f9b-4c24-a176-7b59221e92a1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-679236513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a863da00c62473b9f3726f45900be0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e021e1c-b5", "ovs_interfaceid": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:29:14 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:cc:48,bridge_name='br-int',has_traffic_filtering=True,id=6e021e1c-b583-4ddf-ad9a-f215484ff208,network=Network(a399052b-0f9b-4c24-a176-7b59221e92a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e021e1c-b5') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:29:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:29:14 user nova-compute[72773]:   <uuid>2c1c948f-c541-41ea-ba51-23ff78d1c0db</uuid>
Aug 16 22:29:14 user nova-compute[72773]:   <name>instance-00000009</name>
Aug 16 22:29:14 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:29:14 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:29:14 user nova-compute[72773]:   <metadata>
Aug 16 22:29:14 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:29:14 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:29:14 user nova-compute[72773]:       <nova:name>tempest-ServerActionsV293TestJSON-server-959076328</nova:name>
Aug 16 22:29:14 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:29:11</nova:creationTime>
Aug 16 22:29:14 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:29:14 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:29:14 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:29:14 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:29:14 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:29:14 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:29:14 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:29:14 user nova-compute[72773]:       <nova:owner>
Aug 16 22:29:14 user nova-compute[72773]:         <nova:user uuid="317d00f05a4649c2888f6d30e0a140b8">tempest-ServerActionsV293TestJSON-1773237892-project-member</nova:user>
Aug 16 22:29:14 user nova-compute[72773]:         <nova:project uuid="8a863da00c62473b9f3726f45900be0c">tempest-ServerActionsV293TestJSON-1773237892</nova:project>
Aug 16 22:29:14 user nova-compute[72773]:       </nova:owner>
Aug 16 22:29:14 user nova-compute[72773]:       <nova:ports>
Aug 16 22:29:14 user nova-compute[72773]:         <nova:port uuid="6e021e1c-b583-4ddf-ad9a-f215484ff208">
Aug 16 22:29:14 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 22:29:14 user nova-compute[72773]:         </nova:port>
Aug 16 22:29:14 user nova-compute[72773]:       </nova:ports>
Aug 16 22:29:14 user nova-compute[72773]:     </nova:instance>
Aug 16 22:29:14 user nova-compute[72773]:   </metadata>
Aug 16 22:29:14 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:29:14 user nova-compute[72773]:     <system>
Aug 16 22:29:14 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:29:14 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:29:14 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:29:14 user nova-compute[72773]:       <entry name="serial">2c1c948f-c541-41ea-ba51-23ff78d1c0db</entry>
Aug 16 22:29:14 user nova-compute[72773]:       <entry name="uuid">2c1c948f-c541-41ea-ba51-23ff78d1c0db</entry>
Aug 16 22:29:14 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:29:14 user nova-compute[72773]:     </system>
Aug 16 22:29:14 user nova-compute[72773]:   </sysinfo>
Aug 16 22:29:14 user nova-compute[72773]:   <os>
Aug 16 22:29:14 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:29:14 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:29:14 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:29:14 user nova-compute[72773]:   </os>
Aug 16 22:29:14 user nova-compute[72773]:   <features>
Aug 16 22:29:14 user nova-compute[72773]:     <acpi/>
Aug 16 22:29:14 user nova-compute[72773]:     <apic/>
Aug 16 22:29:14 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:29:14 user nova-compute[72773]:   </features>
Aug 16 22:29:14 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:29:14 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:29:14 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:29:14 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:29:14 user nova-compute[72773]:   </clock>
Aug 16 22:29:14 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:29:14 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:29:14 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:29:14 user nova-compute[72773]:   </cpu>
Aug 16 22:29:14 user nova-compute[72773]:   <devices>
Aug 16 22:29:14 user nova-compute[72773]:     <disk type="block" device="disk">
Aug 16 22:29:14 user nova-compute[72773]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:29:14 user nova-compute[72773]:       <source dev="/dev/sdf"/>
Aug 16 22:29:14 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:29:14 user nova-compute[72773]:       <serial>fb687b38-4616-4b0b-bee3-4ff1da040b18</serial>
Aug 16 22:29:14 user nova-compute[72773]:     </disk>
Aug 16 22:29:14 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:29:14 user nova-compute[72773]:       <mac address="fa:16:3e:48:cc:48"/>
Aug 16 22:29:14 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:29:14 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:29:14 user nova-compute[72773]:       <target dev="tap6e021e1c-b5"/>
Aug 16 22:29:14 user nova-compute[72773]:     </interface>
Aug 16 22:29:14 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:29:14 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/2c1c948f-c541-41ea-ba51-23ff78d1c0db/console.log" append="off"/>
Aug 16 22:29:14 user nova-compute[72773]:     </serial>
Aug 16 22:29:14 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:29:14 user nova-compute[72773]:     <video>
Aug 16 22:29:14 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:29:14 user nova-compute[72773]:     </video>
Aug 16 22:29:14 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:29:14 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:29:14 user nova-compute[72773]:     </rng>
Aug 16 22:29:14 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:29:14 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:29:14 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:29:14 user nova-compute[72773]:     </memballoon>
Aug 16 22:29:14 user nova-compute[72773]:   </devices>
Aug 16 22:29:14 user nova-compute[72773]: </domain>
Aug 16 22:29:14 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:29:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T22:26:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-959076328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1140763264',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBA6wXj+pYizM4fJfGUIvhwgan4ub6F4+mEVSZeYo3UraSfwK8dHO9ZRWzHCA/0MsTcW4Way+QQ3ZkahEVK/6hRQ7Z4hPQl0XcQMQn6OttJ3+biiwE/FDTRdP2/DP4bJ/g==',key_name='tempest-keypair-1083426637',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:26:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8a863da00c62473b9f3726f45900be0c',ramdisk_id='',reservation_id='r-kdsmsxtr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1773237892',owner_user_name='tempest-ServerActionsV293TestJSON-1773237892-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:28:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='317d00f05a4649c2888f6d30e0a140b8',uuid=2c1c948f-c541-41ea-ba51-23ff78d1c0db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "address": "fa:16:3e:48:cc:48", "network": {"id": "a399052b-0f9b-4c24-a176-7b59221e92a1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-679236513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a863da00c62473b9f3726f45900be0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e021e1c-b5", "ovs_interfaceid": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:29:14 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Converting VIF {"id": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "address": "fa:16:3e:48:cc:48", "network": {"id": "a399052b-0f9b-4c24-a176-7b59221e92a1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-679236513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a863da00c62473b9f3726f45900be0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e021e1c-b5", "ovs_interfaceid": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:29:14 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:cc:48,bridge_name='br-int',has_traffic_filtering=True,id=6e021e1c-b583-4ddf-ad9a-f215484ff208,network=Network(a399052b-0f9b-4c24-a176-7b59221e92a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e021e1c-b5') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:29:14 user nova-compute[72773]: DEBUG os_vif [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:cc:48,bridge_name='br-int',has_traffic_filtering=True,id=6e021e1c-b583-4ddf-ad9a-f215484ff208,network=Network(a399052b-0f9b-4c24-a176-7b59221e92a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e021e1c-b5') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:29:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:29:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:29:14 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-df6caaa1-46e9-4d4c-aced-c61299f279a6 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Deleted allocations for instance 4387131d-7a86-477a-a231-69713b2d965d
Aug 16 22:29:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e021e1c-b5, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:29:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6e021e1c-b5, col_values=(('external_ids', {'iface-id': '6e021e1c-b583-4ddf-ad9a-f215484ff208', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:cc:48', 'vm-uuid': '2c1c948f-c541-41ea-ba51-23ff78d1c0db'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:29:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:29:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:14 user nova-compute[72773]: INFO os_vif [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:cc:48,bridge_name='br-int',has_traffic_filtering=True,id=6e021e1c-b583-4ddf-ad9a-f215484ff208,network=Network(a399052b-0f9b-4c24-a176-7b59221e92a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e021e1c-b5')
Aug 16 22:29:14 user nova-compute[72773]: DEBUG nova.compute.manager [req-9e53250e-0420-481b-bf96-476bafef8088 req-b43eeaba-7e34-446a-b9b5-1c24b2555e72 service nova] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Received event network-vif-plugged-b757c921-b63d-4724-874a-2b9bd0710124 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9e53250e-0420-481b-bf96-476bafef8088 req-b43eeaba-7e34-446a-b9b5-1c24b2555e72 service nova] Acquiring lock "4387131d-7a86-477a-a231-69713b2d965d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9e53250e-0420-481b-bf96-476bafef8088 req-b43eeaba-7e34-446a-b9b5-1c24b2555e72 service nova] Lock "4387131d-7a86-477a-a231-69713b2d965d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9e53250e-0420-481b-bf96-476bafef8088 req-b43eeaba-7e34-446a-b9b5-1c24b2555e72 service nova] Lock "4387131d-7a86-477a-a231-69713b2d965d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:14 user nova-compute[72773]: DEBUG nova.compute.manager [req-9e53250e-0420-481b-bf96-476bafef8088 req-b43eeaba-7e34-446a-b9b5-1c24b2555e72 service nova] [instance: 4387131d-7a86-477a-a231-69713b2d965d] No waiting events found dispatching network-vif-plugged-b757c921-b63d-4724-874a-2b9bd0710124 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:29:14 user nova-compute[72773]: WARNING nova.compute.manager [req-9e53250e-0420-481b-bf96-476bafef8088 req-b43eeaba-7e34-446a-b9b5-1c24b2555e72 service nova] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Received unexpected event network-vif-plugged-b757c921-b63d-4724-874a-2b9bd0710124 for instance with vm_state deleted and task_state None.
Aug 16 22:29:14 user nova-compute[72773]: DEBUG nova.compute.manager [req-9e53250e-0420-481b-bf96-476bafef8088 req-b43eeaba-7e34-446a-b9b5-1c24b2555e72 service nova] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Received event network-vif-deleted-b757c921-b63d-4724-874a-2b9bd0710124 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:29:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] No VIF found with MAC fa:16:3e:48:cc:48, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:29:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-df6caaa1-46e9-4d4c-aced-c61299f279a6 tempest-VolumesAssistedSnapshotsTest-179215479 tempest-VolumesAssistedSnapshotsTest-179215479-project-member] Lock "4387131d-7a86-477a-a231-69713b2d965d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.734s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 -F raw /opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk" returned: 0 in 2.567s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:29:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Ensure instance console log exists: /opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:29:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Start _get_guest_xml network_info=[{"id": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "address": "fa:16:3e:4a:54:e0", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ca6ee6-83", "ovs_interfaceid": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='e615ca0a9da50e9cc84a74689ee069e3',container_format='bare',created_at=2023-08-16T22:26:59Z,direct_url=<?>,disk_format='qcow2',id=5600fabf-f736-4764-be5b-d59aa75c3865,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-414068688-shelved',owner='a2ef6a37d79341d7a94e5b314efddab4',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T22:27:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '198ddbd8-0d40-4654-bbab-fadb8ab179e6', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IKVAGoxq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '02227d9f-5ddf-42fe-91a8-ce56d76aa274', 'attached_at': '', 'detached_at': '', 'volume_id': '33b7060b-4d09-4bef-b22e-75ca0372f0b2', 'serial': '33b7060b-4d09-4bef-b22e-75ca0372f0b2'}, 'mount_device': '/dev/vdc', 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:29:15 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:29:15 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:29:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:29:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:29:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:29:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:29:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:29:15 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e615ca0a9da50e9cc84a74689ee069e3',container_format='bare',created_at=2023-08-16T22:26:59Z,direct_url=<?>,disk_format='qcow2',id=5600fabf-f736-4764-be5b-d59aa75c3865,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-414068688-shelved',owner='a2ef6a37d79341d7a94e5b314efddab4',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T22:27:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:29:15 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:29:15 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:29:15 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:29:15 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:29:15 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:29:15 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:29:15 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:29:15 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:29:15 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:29:15 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:29:15 user nova-compute[72773]: DEBUG nova.objects.instance [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lazy-loading 'vcpu_model' on Instance uuid 02227d9f-5ddf-42fe-91a8-ce56d76aa274 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:29:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:29:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IKVAGoxq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:29:15 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:29:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:29:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:29:15 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:29:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:29:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:29:15 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:29:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:15 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca15a8db-9634-42a8-ae5a-dac5022dacac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:29:15 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:15 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ae4e70-2857-4a68-8a76-9d195c6f7975]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2] added
Aug 16 22:29:15 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e4512f-afc5-47fd-9dbb-70d1589c09e3]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.052s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b5c9b9-8fc9-4c4f-98e5-3526e06ac58e]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IKVAGoxq {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IKVAGoxq" returned: 0 in 0.026s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[886b8044-f6b9-48e8-8c23-213d80487e8d]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IKVAGoxq'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[319ae365-205c-4bcc-9f5a-d5777bbdd087]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b964b76-0e23-4cac-86a6-6362f2ba5691]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:29:16 user nova-compute[72773]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:29:16 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:29:16 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:29:16 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:29:16 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:29:16 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:29:16 user nova-compute[72773]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:29:16 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:29:16 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:29:16 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:29:16 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:29:16 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3542c01e-ec25-4d31-aa1d-635acbc98029]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2, portal: 172.16.0.220,3260]
Aug 16 22:29:16 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2, portal: 172.16.0.220,3260] successful.
Aug 16 22:29:16 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bf79a6-fde5-4dfe-84f7-6a16cdd24a40]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0e9da0-3501-41c1-aaf0-22587a921a14]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:29:16 user nova-compute[72773]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:29:16 user nova-compute[72773]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 (non-flash)
Aug 16 22:29:16 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:29:16 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:29:16 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:29:16 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:29:16 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:29:16 user nova-compute[72773]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:29:16 user nova-compute[72773]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 (non-flash)
Aug 16 22:29:16 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:29:16 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:29:16 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:29:16 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:29:16 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.578s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] HCTL ('39', '-', '-', 0) found on session 17 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.032s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70e1270-d854-4ea3-aa5c-8872f6418c1c]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Searching for a device in session 17 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:29:16 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IKVAGoxq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:29:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:17 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.640s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:29:17 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] <== connect_volume: return (1643ms) {'type': 'block', 'scsi_wwn': '26539323435393966', 'path': '/dev/sdh'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:29:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539323435393966', 'path': '/dev/sdh'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:29:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T22:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-414068688',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-414068688',id=4,image_ref='5600fabf-f736-4764-be5b-d59aa75c3865',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1733371512',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:25:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a2ef6a37d79341d7a94e5b314efddab4',ramdisk_id='',reservation_id='r-fl923se9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-488184195',owner_user_name='tempest-AttachVolumeShelveTestJSON-488184195-project-member',shelved_at='2023-08-16T22:27:03.064276',shelved_host='user',shelved_image_id='5600fabf-f736-4764-be5b-d59aa75c3865'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:28:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71cd9d1142ec45e792219e8b789cf2a0',uuid=02227d9f-5ddf-42fe-91a8-ce56d76aa274,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "address": "fa:16:3e:4a:54:e0", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ca6ee6-83", "ovs_interfaceid": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:29:17 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Converting VIF {"id": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "address": "fa:16:3e:4a:54:e0", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ca6ee6-83", "ovs_interfaceid": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:29:17 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:54:e0,bridge_name='br-int',has_traffic_filtering=True,id=26ca6ee6-83b5-4553-b31c-d1b135b219e9,network=Network(9aa7e6bf-5a47-422d-b638-cff5a8429391),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26ca6ee6-83') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:29:17 user nova-compute[72773]: DEBUG nova.objects.instance [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lazy-loading 'pci_devices' on Instance uuid 02227d9f-5ddf-42fe-91a8-ce56d76aa274 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:29:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:29:17 user nova-compute[72773]:   <uuid>02227d9f-5ddf-42fe-91a8-ce56d76aa274</uuid>
Aug 16 22:29:17 user nova-compute[72773]:   <name>instance-00000004</name>
Aug 16 22:29:17 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:29:17 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:29:17 user nova-compute[72773]:   <metadata>
Aug 16 22:29:17 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:29:17 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:29:17 user nova-compute[72773]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-414068688</nova:name>
Aug 16 22:29:17 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:29:15</nova:creationTime>
Aug 16 22:29:17 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:29:17 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:29:17 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:29:17 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:29:17 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:29:17 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:29:17 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:29:17 user nova-compute[72773]:       <nova:owner>
Aug 16 22:29:17 user nova-compute[72773]:         <nova:user uuid="71cd9d1142ec45e792219e8b789cf2a0">tempest-AttachVolumeShelveTestJSON-488184195-project-member</nova:user>
Aug 16 22:29:17 user nova-compute[72773]:         <nova:project uuid="a2ef6a37d79341d7a94e5b314efddab4">tempest-AttachVolumeShelveTestJSON-488184195</nova:project>
Aug 16 22:29:17 user nova-compute[72773]:       </nova:owner>
Aug 16 22:29:17 user nova-compute[72773]:       <nova:root type="image" uuid="5600fabf-f736-4764-be5b-d59aa75c3865"/>
Aug 16 22:29:17 user nova-compute[72773]:       <nova:ports>
Aug 16 22:29:17 user nova-compute[72773]:         <nova:port uuid="26ca6ee6-83b5-4553-b31c-d1b135b219e9">
Aug 16 22:29:17 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 22:29:17 user nova-compute[72773]:         </nova:port>
Aug 16 22:29:17 user nova-compute[72773]:       </nova:ports>
Aug 16 22:29:17 user nova-compute[72773]:     </nova:instance>
Aug 16 22:29:17 user nova-compute[72773]:   </metadata>
Aug 16 22:29:17 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:29:17 user nova-compute[72773]:     <system>
Aug 16 22:29:17 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:29:17 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:29:17 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:29:17 user nova-compute[72773]:       <entry name="serial">02227d9f-5ddf-42fe-91a8-ce56d76aa274</entry>
Aug 16 22:29:17 user nova-compute[72773]:       <entry name="uuid">02227d9f-5ddf-42fe-91a8-ce56d76aa274</entry>
Aug 16 22:29:17 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:29:17 user nova-compute[72773]:     </system>
Aug 16 22:29:17 user nova-compute[72773]:   </sysinfo>
Aug 16 22:29:17 user nova-compute[72773]:   <os>
Aug 16 22:29:17 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:29:17 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:29:17 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:29:17 user nova-compute[72773]:   </os>
Aug 16 22:29:17 user nova-compute[72773]:   <features>
Aug 16 22:29:17 user nova-compute[72773]:     <acpi/>
Aug 16 22:29:17 user nova-compute[72773]:     <apic/>
Aug 16 22:29:17 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:29:17 user nova-compute[72773]:   </features>
Aug 16 22:29:17 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:29:17 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:29:17 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:29:17 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:29:17 user nova-compute[72773]:   </clock>
Aug 16 22:29:17 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:29:17 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:29:17 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:29:17 user nova-compute[72773]:   </cpu>
Aug 16 22:29:17 user nova-compute[72773]:   <devices>
Aug 16 22:29:17 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:29:17 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:29:17 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk"/>
Aug 16 22:29:17 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:29:17 user nova-compute[72773]:     </disk>
Aug 16 22:29:17 user nova-compute[72773]:     <disk type="block" device="disk">
Aug 16 22:29:17 user nova-compute[72773]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:29:17 user nova-compute[72773]:       <source dev="/dev/sdh"/>
Aug 16 22:29:17 user nova-compute[72773]:       <target dev="vdc" bus="virtio"/>
Aug 16 22:29:17 user nova-compute[72773]:       <serial>33b7060b-4d09-4bef-b22e-75ca0372f0b2</serial>
Aug 16 22:29:17 user nova-compute[72773]:     </disk>
Aug 16 22:29:17 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:29:17 user nova-compute[72773]:       <mac address="fa:16:3e:4a:54:e0"/>
Aug 16 22:29:17 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:29:17 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:29:17 user nova-compute[72773]:       <target dev="tap26ca6ee6-83"/>
Aug 16 22:29:17 user nova-compute[72773]:     </interface>
Aug 16 22:29:17 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:29:17 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/console.log" append="off"/>
Aug 16 22:29:17 user nova-compute[72773]:     </serial>
Aug 16 22:29:17 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:29:17 user nova-compute[72773]:     <video>
Aug 16 22:29:17 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:29:17 user nova-compute[72773]:     </video>
Aug 16 22:29:17 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:29:17 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:29:17 user nova-compute[72773]:     </rng>
Aug 16 22:29:17 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:29:17 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:29:17 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:29:17 user nova-compute[72773]:     </memballoon>
Aug 16 22:29:17 user nova-compute[72773]:   </devices>
Aug 16 22:29:17 user nova-compute[72773]: </domain>
Aug 16 22:29:17 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:29:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T22:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-414068688',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-414068688',id=4,image_ref='5600fabf-f736-4764-be5b-d59aa75c3865',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1733371512',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:25:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a2ef6a37d79341d7a94e5b314efddab4',ramdisk_id='',reservation_id='r-fl923se9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-488184195',owner_user_name='tempest-AttachVolumeShelveTestJSON-488184195-project-member',shelved_at='2023-08-16T22:27:03.064276',shelved_host='user',shelved_image_id='5600fabf-f736-4764-be5b-d59aa75c3865'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:28:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71cd9d1142ec45e792219e8b789cf2a0',uuid=02227d9f-5ddf-42fe-91a8-ce56d76aa274,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "address": "fa:16:3e:4a:54:e0", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ca6ee6-83", "ovs_interfaceid": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:29:17 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Converting VIF {"id": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "address": "fa:16:3e:4a:54:e0", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ca6ee6-83", "ovs_interfaceid": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:29:17 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:54:e0,bridge_name='br-int',has_traffic_filtering=True,id=26ca6ee6-83b5-4553-b31c-d1b135b219e9,network=Network(9aa7e6bf-5a47-422d-b638-cff5a8429391),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26ca6ee6-83') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:29:17 user nova-compute[72773]: DEBUG os_vif [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:54:e0,bridge_name='br-int',has_traffic_filtering=True,id=26ca6ee6-83b5-4553-b31c-d1b135b219e9,network=Network(9aa7e6bf-5a47-422d-b638-cff5a8429391),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26ca6ee6-83') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:29:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:29:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:29:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26ca6ee6-83, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:29:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap26ca6ee6-83, col_values=(('external_ids', {'iface-id': '26ca6ee6-83b5-4553-b31c-d1b135b219e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:54:e0', 'vm-uuid': '02227d9f-5ddf-42fe-91a8-ce56d76aa274'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:29:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:29:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:17 user nova-compute[72773]: INFO os_vif [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:54:e0,bridge_name='br-int',has_traffic_filtering=True,id=26ca6ee6-83b5-4553-b31c-d1b135b219e9,network=Network(9aa7e6bf-5a47-422d-b638-cff5a8429391),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26ca6ee6-83')
Aug 16 22:29:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:29:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:29:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] No VIF found with MAC fa:16:3e:4a:54:e0, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:29:17 user nova-compute[72773]: DEBUG nova.compute.manager [req-bcb5369f-ffee-48d6-ae0f-e6d03e14c974 req-77b4ec4f-137e-4f50-9a98-3dcee4b36e28 service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Received event network-vif-plugged-6e021e1c-b583-4ddf-ad9a-f215484ff208 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-bcb5369f-ffee-48d6-ae0f-e6d03e14c974 req-77b4ec4f-137e-4f50-9a98-3dcee4b36e28 service nova] Acquiring lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-bcb5369f-ffee-48d6-ae0f-e6d03e14c974 req-77b4ec4f-137e-4f50-9a98-3dcee4b36e28 service nova] Lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-bcb5369f-ffee-48d6-ae0f-e6d03e14c974 req-77b4ec4f-137e-4f50-9a98-3dcee4b36e28 service nova] Lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:17 user nova-compute[72773]: DEBUG nova.compute.manager [req-bcb5369f-ffee-48d6-ae0f-e6d03e14c974 req-77b4ec4f-137e-4f50-9a98-3dcee4b36e28 service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] No waiting events found dispatching network-vif-plugged-6e021e1c-b583-4ddf-ad9a-f215484ff208 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:29:17 user nova-compute[72773]: WARNING nova.compute.manager [req-bcb5369f-ffee-48d6-ae0f-e6d03e14c974 req-77b4ec4f-137e-4f50-9a98-3dcee4b36e28 service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Received unexpected event network-vif-plugged-6e021e1c-b583-4ddf-ad9a-f215484ff208 for instance with vm_state active and task_state rebuild_spawning.
Aug 16 22:29:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:19 user nova-compute[72773]: DEBUG nova.compute.manager [req-cb93c754-8fef-46e7-a8a5-f3196915604a req-37593538-e468-4aac-8611-e79f7a641309 service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Received event network-vif-plugged-6e021e1c-b583-4ddf-ad9a-f215484ff208 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-cb93c754-8fef-46e7-a8a5-f3196915604a req-37593538-e468-4aac-8611-e79f7a641309 service nova] Acquiring lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-cb93c754-8fef-46e7-a8a5-f3196915604a req-37593538-e468-4aac-8611-e79f7a641309 service nova] Lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-cb93c754-8fef-46e7-a8a5-f3196915604a req-37593538-e468-4aac-8611-e79f7a641309 service nova] Lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:19 user nova-compute[72773]: DEBUG nova.compute.manager [req-cb93c754-8fef-46e7-a8a5-f3196915604a req-37593538-e468-4aac-8611-e79f7a641309 service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] No waiting events found dispatching network-vif-plugged-6e021e1c-b583-4ddf-ad9a-f215484ff208 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:29:19 user nova-compute[72773]: WARNING nova.compute.manager [req-cb93c754-8fef-46e7-a8a5-f3196915604a req-37593538-e468-4aac-8611-e79f7a641309 service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Received unexpected event network-vif-plugged-6e021e1c-b583-4ddf-ad9a-f215484ff208 for instance with vm_state active and task_state rebuild_spawning.
Aug 16 22:29:20 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224960.690928, 2c1c948f-c541-41ea-ba51-23ff78d1c0db => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:29:20 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] VM Resumed (Lifecycle Event)
Aug 16 22:29:20 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:29:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:29:20 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Instance spawned successfully.
Aug 16 22:29:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:29:20 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:29:20 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:29:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:29:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:29:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:29:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:29:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:29:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:29:20 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 22:29:20 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224960.692756, 2c1c948f-c541-41ea-ba51-23ff78d1c0db => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:29:20 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] VM Started (Lifecycle Event)
Aug 16 22:29:20 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:29:20 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:29:20 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 22:29:20 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:29:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:20 user nova-compute[72773]: DEBUG nova.objects.instance [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72773) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 22:29:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7fd1d4e0-4247-45a3-8d9d-cd7174c363db tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.071s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:21 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224961.7316778, 02227d9f-5ddf-42fe-91a8-ce56d76aa274 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:29:21 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] VM Resumed (Lifecycle Event)
Aug 16 22:29:21 user nova-compute[72773]: DEBUG nova.compute.manager [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:29:21 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:29:21 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Instance spawned successfully.
Aug 16 22:29:21 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:29:21 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:29:21 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:29:21 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224961.7323349, 02227d9f-5ddf-42fe-91a8-ce56d76aa274 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:29:21 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] VM Started (Lifecycle Event)
Aug 16 22:29:21 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:29:21 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:29:21 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:29:22 user nova-compute[72773]: DEBUG nova.compute.manager [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:29:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-603fc377-6b2c-4bf2-bc18-cf7818d5dd14 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 29.474s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:25 user nova-compute[72773]: DEBUG nova.compute.manager [req-773184eb-fba4-4e16-96cd-e88c54b26b6a req-9ee79272-50bb-49d7-84ca-02a655a4071b service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Received event network-vif-plugged-26ca6ee6-83b5-4553-b31c-d1b135b219e9 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-773184eb-fba4-4e16-96cd-e88c54b26b6a req-9ee79272-50bb-49d7-84ca-02a655a4071b service nova] Acquiring lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-773184eb-fba4-4e16-96cd-e88c54b26b6a req-9ee79272-50bb-49d7-84ca-02a655a4071b service nova] Lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-773184eb-fba4-4e16-96cd-e88c54b26b6a req-9ee79272-50bb-49d7-84ca-02a655a4071b service nova] Lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:25 user nova-compute[72773]: DEBUG nova.compute.manager [req-773184eb-fba4-4e16-96cd-e88c54b26b6a req-9ee79272-50bb-49d7-84ca-02a655a4071b service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] No waiting events found dispatching network-vif-plugged-26ca6ee6-83b5-4553-b31c-d1b135b219e9 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:29:25 user nova-compute[72773]: WARNING nova.compute.manager [req-773184eb-fba4-4e16-96cd-e88c54b26b6a req-9ee79272-50bb-49d7-84ca-02a655a4071b service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Received unexpected event network-vif-plugged-26ca6ee6-83b5-4553-b31c-d1b135b219e9 for instance with vm_state active and task_state None.
Aug 16 22:29:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Acquiring lock "60b4514f-16f8-466d-9e58-b95c0bfb3f32" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lock "60b4514f-16f8-466d-9e58-b95c0bfb3f32" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:26 user nova-compute[72773]: DEBUG nova.compute.manager [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:29:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:26 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:29:26 user nova-compute[72773]: INFO nova.compute.claims [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Claim successful on node user
Aug 16 22:29:26 user nova-compute[72773]: DEBUG nova.compute.manager [req-c34bd107-f637-4143-9f80-97ce76122ba8 req-70c59364-fabd-4db1-8cda-97eb9398a72e service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-changed-a2f04ed7-213b-4297-a13d-ad99a922f878 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:26 user nova-compute[72773]: DEBUG nova.compute.manager [req-c34bd107-f637-4143-9f80-97ce76122ba8 req-70c59364-fabd-4db1-8cda-97eb9398a72e service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Refreshing instance network info cache due to event network-changed-a2f04ed7-213b-4297-a13d-ad99a922f878. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:29:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c34bd107-f637-4143-9f80-97ce76122ba8 req-70c59364-fabd-4db1-8cda-97eb9398a72e service nova] Acquiring lock "refresh_cache-df2acdf5-7c83-4129-8cab-da9882e1ac69" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:29:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c34bd107-f637-4143-9f80-97ce76122ba8 req-70c59364-fabd-4db1-8cda-97eb9398a72e service nova] Acquired lock "refresh_cache-df2acdf5-7c83-4129-8cab-da9882e1ac69" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:29:26 user nova-compute[72773]: DEBUG nova.network.neutron [req-c34bd107-f637-4143-9f80-97ce76122ba8 req-70c59364-fabd-4db1-8cda-97eb9398a72e service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Refreshing network info cache for port a2f04ed7-213b-4297-a13d-ad99a922f878 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:29:27 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:29:27 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:29:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:27 user nova-compute[72773]: DEBUG nova.compute.manager [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:29:27 user nova-compute[72773]: DEBUG nova.compute.manager [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:29:27 user nova-compute[72773]: DEBUG nova.network.neutron [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:29:27 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:29:27 user nova-compute[72773]: DEBUG nova.compute.manager [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:29:27 user nova-compute[72773]: DEBUG nova.network.neutron [req-c34bd107-f637-4143-9f80-97ce76122ba8 req-70c59364-fabd-4db1-8cda-97eb9398a72e service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Updated VIF entry in instance network info cache for port a2f04ed7-213b-4297-a13d-ad99a922f878. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:29:27 user nova-compute[72773]: DEBUG nova.network.neutron [req-c34bd107-f637-4143-9f80-97ce76122ba8 req-70c59364-fabd-4db1-8cda-97eb9398a72e service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Updating instance_info_cache with network_info: [{"id": "a2f04ed7-213b-4297-a13d-ad99a922f878", "address": "fa:16:3e:ee:62:f5", "network": {"id": "78850332-7129-48d4-ad0f-222c6981d934", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-817612380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f04ed7-21", "ovs_interfaceid": "a2f04ed7-213b-4297-a13d-ad99a922f878", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "213a2da6-430b-4976-b5f0-a18d8494f42c", "address": "fa:16:3e:62:39:b6", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213a2da6-43", "ovs_interfaceid": "213a2da6-430b-4976-b5f0-a18d8494f42c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c27765c1-ae78-4b0b-8abf-2514be5599a4", "address": "fa:16:3e:12:84:13", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc27765c1-ae", "ovs_interfaceid": "c27765c1-ae78-4b0b-8abf-2514be5599a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "69942063-04a7-4cd3-87dd-42952e5fc667", "address": "fa:16:3e:8c:1b:60", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69942063-04", "ovs_interfaceid": "69942063-04a7-4cd3-87dd-42952e5fc667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38eab1de-142b-4f98-a91e-bea564b65757", "address": "fa:16:3e:a8:88:1c", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38eab1de-14", "ovs_interfaceid": "38eab1de-142b-4f98-a91e-bea564b65757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f77f6c81-0377-4531-8c95-07be0a197bcc", "address": "fa:16:3e:f0:3c:4a", "network": {"id": "9e71d1ff-9a5b-4a29-ad7e-6b4da698415d", "bridge": "br-int", "label": "tempest-device-tagging-net2-584203226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f6c81-03", "ovs_interfaceid": "f77f6c81-0377-4531-8c95-07be0a197bcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b07374e-822f-4550-bcf1-c0259ca3624b", "address": "fa:16:3e:5f:15:a3", "network": {"id": "9e71d1ff-9a5b-4a29-ad7e-6b4da698415d", "bridge": "br-int", "label": "tempest-device-tagging-net2-584203226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b07374e-82", "ovs_interfaceid": "4b07374e-822f-4550-bcf1-c0259ca3624b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:29:27 user nova-compute[72773]: DEBUG nova.policy [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72a395fc29094394bbbe0411cbd4ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a319bbe5472b84c6fa3373d5c6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:29:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c34bd107-f637-4143-9f80-97ce76122ba8 req-70c59364-fabd-4db1-8cda-97eb9398a72e service nova] Releasing lock "refresh_cache-df2acdf5-7c83-4129-8cab-da9882e1ac69" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:29:27 user nova-compute[72773]: DEBUG nova.compute.manager [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:29:27 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:29:27 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Creating image(s)
Aug 16 22:29:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Acquiring lock "/opt/stack/data/nova/instances/60b4514f-16f8-466d-9e58-b95c0bfb3f32/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lock "/opt/stack/data/nova/instances/60b4514f-16f8-466d-9e58-b95c0bfb3f32/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lock "/opt/stack/data/nova/instances/60b4514f-16f8-466d-9e58-b95c0bfb3f32/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.258s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:27 user nova-compute[72773]: DEBUG nova.compute.manager [req-bc0f3d0f-1b18-4fe1-a165-75ee4e63416e req-6cab01c4-260d-4ec1-bb96-8a7bb202d046 service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Received event network-vif-plugged-26ca6ee6-83b5-4553-b31c-d1b135b219e9 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-bc0f3d0f-1b18-4fe1-a165-75ee4e63416e req-6cab01c4-260d-4ec1-bb96-8a7bb202d046 service nova] Acquiring lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-bc0f3d0f-1b18-4fe1-a165-75ee4e63416e req-6cab01c4-260d-4ec1-bb96-8a7bb202d046 service nova] Lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-bc0f3d0f-1b18-4fe1-a165-75ee4e63416e req-6cab01c4-260d-4ec1-bb96-8a7bb202d046 service nova] Lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:27 user nova-compute[72773]: DEBUG nova.compute.manager [req-bc0f3d0f-1b18-4fe1-a165-75ee4e63416e req-6cab01c4-260d-4ec1-bb96-8a7bb202d046 service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] No waiting events found dispatching network-vif-plugged-26ca6ee6-83b5-4553-b31c-d1b135b219e9 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:29:27 user nova-compute[72773]: WARNING nova.compute.manager [req-bc0f3d0f-1b18-4fe1-a165-75ee4e63416e req-6cab01c4-260d-4ec1-bb96-8a7bb202d046 service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Received unexpected event network-vif-plugged-26ca6ee6-83b5-4553-b31c-d1b135b219e9 for instance with vm_state active and task_state None.
Aug 16 22:29:27 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692224952.8589218, 4387131d-7a86-477a-a231-69713b2d965d => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:29:27 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 4387131d-7a86-477a-a231-69713b2d965d] VM Stopped (Lifecycle Event)
Aug 16 22:29:27 user nova-compute[72773]: DEBUG nova.compute.manager [None req-3cd16ed4-cc5b-4514-ae87-b8582c541e20 None None] [instance: 4387131d-7a86-477a-a231-69713b2d965d] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:29:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.201s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/60b4514f-16f8-466d-9e58-b95c0bfb3f32/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/60b4514f-16f8-466d-9e58-b95c0bfb3f32/disk 1073741824" returned: 0 in 0.056s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.211s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:28 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60b4514f-16f8-466d-9e58-b95c0bfb3f32/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:29:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b4514f-16f8-466d-9e58-b95c0bfb3f32/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:28 user nova-compute[72773]: DEBUG nova.network.neutron [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Successfully created port: 3c311267-1174-4333-8de6-e0872bb91c07 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:29:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b4514f-16f8-466d-9e58-b95c0bfb3f32/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:28 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Cannot resize image /opt/stack/data/nova/instances/60b4514f-16f8-466d-9e58-b95c0bfb3f32/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:29:28 user nova-compute[72773]: DEBUG nova.objects.instance [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lazy-loading 'migration_context' on Instance uuid 60b4514f-16f8-466d-9e58-b95c0bfb3f32 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:29:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:29:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Ensure instance console log exists: /opt/stack/data/nova/instances/60b4514f-16f8-466d-9e58-b95c0bfb3f32/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:29:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Acquiring lock "5aa5adad-599d-424f-bbfc-7d87ead31b57" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:29:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:29:29 user nova-compute[72773]: INFO nova.compute.claims [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Claim successful on node user
Aug 16 22:29:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:29 user nova-compute[72773]: DEBUG nova.network.neutron [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Successfully updated port: 3c311267-1174-4333-8de6-e0872bb91c07 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:29:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Acquiring lock "refresh_cache-60b4514f-16f8-466d-9e58-b95c0bfb3f32" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:29:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Acquired lock "refresh_cache-60b4514f-16f8-466d-9e58-b95c0bfb3f32" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:29:29 user nova-compute[72773]: DEBUG nova.network.neutron [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:29:29 user nova-compute[72773]: DEBUG nova.compute.manager [req-14766ea9-500e-4252-bb8e-7561a811d254 req-d79e714b-fe24-473d-b953-0db8a4263a5e service nova] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Received event network-changed-3c311267-1174-4333-8de6-e0872bb91c07 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:29 user nova-compute[72773]: DEBUG nova.compute.manager [req-14766ea9-500e-4252-bb8e-7561a811d254 req-d79e714b-fe24-473d-b953-0db8a4263a5e service nova] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Refreshing instance network info cache due to event network-changed-3c311267-1174-4333-8de6-e0872bb91c07. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:29:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-14766ea9-500e-4252-bb8e-7561a811d254 req-d79e714b-fe24-473d-b953-0db8a4263a5e service nova] Acquiring lock "refresh_cache-60b4514f-16f8-466d-9e58-b95c0bfb3f32" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:29:29 user nova-compute[72773]: DEBUG nova.network.neutron [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:29:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Acquiring lock "df2acdf5-7c83-4129-8cab-da9882e1ac69" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Acquiring lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:29 user nova-compute[72773]: INFO nova.compute.manager [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Terminating instance
Aug 16 22:29:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:29:29 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:29:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.722s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.compute.manager [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.compute.manager [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.network.neutron [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.network.neutron [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Updating instance_info_cache with network_info: [{"id": "3c311267-1174-4333-8de6-e0872bb91c07", "address": "fa:16:3e:80:b6:33", "network": {"id": "5cde2c8a-cc09-442d-b474-eb3cd32efbf1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1685780614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc5a319bbe5472b84c6fa3373d5c6e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c311267-11", "ovs_interfaceid": "3c311267-1174-4333-8de6-e0872bb91c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:30 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:29:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Releasing lock "refresh_cache-60b4514f-16f8-466d-9e58-b95c0bfb3f32" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.compute.manager [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Instance network_info: |[{"id": "3c311267-1174-4333-8de6-e0872bb91c07", "address": "fa:16:3e:80:b6:33", "network": {"id": "5cde2c8a-cc09-442d-b474-eb3cd32efbf1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1685780614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc5a319bbe5472b84c6fa3373d5c6e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c311267-11", "ovs_interfaceid": "3c311267-1174-4333-8de6-e0872bb91c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-14766ea9-500e-4252-bb8e-7561a811d254 req-d79e714b-fe24-473d-b953-0db8a4263a5e service nova] Acquired lock "refresh_cache-60b4514f-16f8-466d-9e58-b95c0bfb3f32" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.network.neutron [req-14766ea9-500e-4252-bb8e-7561a811d254 req-d79e714b-fe24-473d-b953-0db8a4263a5e service nova] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Refreshing network info cache for port 3c311267-1174-4333-8de6-e0872bb91c07 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Start _get_guest_xml network_info=[{"id": "3c311267-1174-4333-8de6-e0872bb91c07", "address": "fa:16:3e:80:b6:33", "network": {"id": "5cde2c8a-cc09-442d-b474-eb3cd32efbf1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1685780614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc5a319bbe5472b84c6fa3373d5c6e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c311267-11", "ovs_interfaceid": "3c311267-1174-4333-8de6-e0872bb91c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:30 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:29:30 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:29:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:29:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1353856131',display_name='tempest-VolumesActionsTest-instance-1353856131',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1353856131',id=15,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9fc5a319bbe5472b84c6fa3373d5c6e8',ramdisk_id='',reservation_id='r-057fgi21',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1300049092',owner_user_name='tempest-VolumesActionsTest-1300049092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:29:27Z,user_data=None,user_id='72a395fc29094394bbbe0411cbd4ccfc',uuid=60b4514f-16f8-466d-9e58-b95c0bfb3f32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c311267-1174-4333-8de6-e0872bb91c07", "address": "fa:16:3e:80:b6:33", "network": {"id": "5cde2c8a-cc09-442d-b474-eb3cd32efbf1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1685780614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc5a319bbe5472b84c6fa3373d5c6e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c311267-11", "ovs_interfaceid": "3c311267-1174-4333-8de6-e0872bb91c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Converting VIF {"id": "3c311267-1174-4333-8de6-e0872bb91c07", "address": "fa:16:3e:80:b6:33", "network": {"id": "5cde2c8a-cc09-442d-b474-eb3cd32efbf1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1685780614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc5a319bbe5472b84c6fa3373d5c6e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c311267-11", "ovs_interfaceid": "3c311267-1174-4333-8de6-e0872bb91c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:b6:33,bridge_name='br-int',has_traffic_filtering=True,id=3c311267-1174-4333-8de6-e0872bb91c07,network=Network(5cde2c8a-cc09-442d-b474-eb3cd32efbf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c311267-11') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.objects.instance [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lazy-loading 'pci_devices' on Instance uuid 60b4514f-16f8-466d-9e58-b95c0bfb3f32 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.compute.manager [req-2dcb4798-997b-49cd-9c60-de0ff4bd5827 req-1743098e-bdca-434e-b412-07a334d896de service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-unplugged-a2f04ed7-213b-4297-a13d-ad99a922f878 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2dcb4798-997b-49cd-9c60-de0ff4bd5827 req-1743098e-bdca-434e-b412-07a334d896de service nova] Acquiring lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2dcb4798-997b-49cd-9c60-de0ff4bd5827 req-1743098e-bdca-434e-b412-07a334d896de service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2dcb4798-997b-49cd-9c60-de0ff4bd5827 req-1743098e-bdca-434e-b412-07a334d896de service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.compute.manager [req-2dcb4798-997b-49cd-9c60-de0ff4bd5827 req-1743098e-bdca-434e-b412-07a334d896de service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] No waiting events found dispatching network-vif-unplugged-a2f04ed7-213b-4297-a13d-ad99a922f878 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.compute.manager [req-2dcb4798-997b-49cd-9c60-de0ff4bd5827 req-1743098e-bdca-434e-b412-07a334d896de service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-unplugged-a2f04ed7-213b-4297-a13d-ad99a922f878 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.compute.manager [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:29:30 user nova-compute[72773]:   <uuid>60b4514f-16f8-466d-9e58-b95c0bfb3f32</uuid>
Aug 16 22:29:30 user nova-compute[72773]:   <name>instance-0000000f</name>
Aug 16 22:29:30 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:29:30 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:29:30 user nova-compute[72773]:   <metadata>
Aug 16 22:29:30 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:29:30 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:29:30 user nova-compute[72773]:       <nova:name>tempest-VolumesActionsTest-instance-1353856131</nova:name>
Aug 16 22:29:30 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:29:30</nova:creationTime>
Aug 16 22:29:30 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:29:30 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:29:30 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:29:30 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:29:30 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:29:30 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:29:30 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:29:30 user nova-compute[72773]:       <nova:owner>
Aug 16 22:29:30 user nova-compute[72773]:         <nova:user uuid="72a395fc29094394bbbe0411cbd4ccfc">tempest-VolumesActionsTest-1300049092-project-member</nova:user>
Aug 16 22:29:30 user nova-compute[72773]:         <nova:project uuid="9fc5a319bbe5472b84c6fa3373d5c6e8">tempest-VolumesActionsTest-1300049092</nova:project>
Aug 16 22:29:30 user nova-compute[72773]:       </nova:owner>
Aug 16 22:29:30 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:29:30 user nova-compute[72773]:       <nova:ports>
Aug 16 22:29:30 user nova-compute[72773]:         <nova:port uuid="3c311267-1174-4333-8de6-e0872bb91c07">
Aug 16 22:29:30 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 22:29:30 user nova-compute[72773]:         </nova:port>
Aug 16 22:29:30 user nova-compute[72773]:       </nova:ports>
Aug 16 22:29:30 user nova-compute[72773]:     </nova:instance>
Aug 16 22:29:30 user nova-compute[72773]:   </metadata>
Aug 16 22:29:30 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:29:30 user nova-compute[72773]:     <system>
Aug 16 22:29:30 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:29:30 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:29:30 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:29:30 user nova-compute[72773]:       <entry name="serial">60b4514f-16f8-466d-9e58-b95c0bfb3f32</entry>
Aug 16 22:29:30 user nova-compute[72773]:       <entry name="uuid">60b4514f-16f8-466d-9e58-b95c0bfb3f32</entry>
Aug 16 22:29:30 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:29:30 user nova-compute[72773]:     </system>
Aug 16 22:29:30 user nova-compute[72773]:   </sysinfo>
Aug 16 22:29:30 user nova-compute[72773]:   <os>
Aug 16 22:29:30 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:29:30 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:29:30 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:29:30 user nova-compute[72773]:   </os>
Aug 16 22:29:30 user nova-compute[72773]:   <features>
Aug 16 22:29:30 user nova-compute[72773]:     <acpi/>
Aug 16 22:29:30 user nova-compute[72773]:     <apic/>
Aug 16 22:29:30 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:29:30 user nova-compute[72773]:   </features>
Aug 16 22:29:30 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:29:30 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:29:30 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:29:30 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:29:30 user nova-compute[72773]:   </clock>
Aug 16 22:29:30 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:29:30 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:29:30 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:29:30 user nova-compute[72773]:   </cpu>
Aug 16 22:29:30 user nova-compute[72773]:   <devices>
Aug 16 22:29:30 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:29:30 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:29:30 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/60b4514f-16f8-466d-9e58-b95c0bfb3f32/disk"/>
Aug 16 22:29:30 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:29:30 user nova-compute[72773]:     </disk>
Aug 16 22:29:30 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:29:30 user nova-compute[72773]:       <mac address="fa:16:3e:80:b6:33"/>
Aug 16 22:29:30 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:29:30 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:29:30 user nova-compute[72773]:       <target dev="tap3c311267-11"/>
Aug 16 22:29:30 user nova-compute[72773]:     </interface>
Aug 16 22:29:30 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:29:30 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/60b4514f-16f8-466d-9e58-b95c0bfb3f32/console.log" append="off"/>
Aug 16 22:29:30 user nova-compute[72773]:     </serial>
Aug 16 22:29:30 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:29:30 user nova-compute[72773]:     <video>
Aug 16 22:29:30 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:29:30 user nova-compute[72773]:     </video>
Aug 16 22:29:30 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:29:30 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:29:30 user nova-compute[72773]:     </rng>
Aug 16 22:29:30 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:29:30 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:29:30 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:29:30 user nova-compute[72773]:     </memballoon>
Aug 16 22:29:30 user nova-compute[72773]:   </devices>
Aug 16 22:29:30 user nova-compute[72773]: </domain>
Aug 16 22:29:30 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:29:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1353856131',display_name='tempest-VolumesActionsTest-instance-1353856131',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1353856131',id=15,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9fc5a319bbe5472b84c6fa3373d5c6e8',ramdisk_id='',reservation_id='r-057fgi21',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1300049092',owner_user_name='tempest-VolumesActionsTest-1300049092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:29:27Z,user_data=None,user_id='72a395fc29094394bbbe0411cbd4ccfc',uuid=60b4514f-16f8-466d-9e58-b95c0bfb3f32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c311267-1174-4333-8de6-e0872bb91c07", "address": "fa:16:3e:80:b6:33", "network": {"id": "5cde2c8a-cc09-442d-b474-eb3cd32efbf1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1685780614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc5a319bbe5472b84c6fa3373d5c6e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c311267-11", "ovs_interfaceid": "3c311267-1174-4333-8de6-e0872bb91c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Converting VIF {"id": "3c311267-1174-4333-8de6-e0872bb91c07", "address": "fa:16:3e:80:b6:33", "network": {"id": "5cde2c8a-cc09-442d-b474-eb3cd32efbf1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1685780614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc5a319bbe5472b84c6fa3373d5c6e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c311267-11", "ovs_interfaceid": "3c311267-1174-4333-8de6-e0872bb91c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:b6:33,bridge_name='br-int',has_traffic_filtering=True,id=3c311267-1174-4333-8de6-e0872bb91c07,network=Network(5cde2c8a-cc09-442d-b474-eb3cd32efbf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c311267-11') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG os_vif [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:b6:33,bridge_name='br-int',has_traffic_filtering=True,id=3c311267-1174-4333-8de6-e0872bb91c07,network=Network(5cde2c8a-cc09-442d-b474-eb3cd32efbf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c311267-11') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c311267-11, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3c311267-11, col_values=(('external_ids', {'iface-id': '3c311267-1174-4333-8de6-e0872bb91c07', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:b6:33', 'vm-uuid': '60b4514f-16f8-466d-9e58-b95c0bfb3f32'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:30 user nova-compute[72773]: INFO nova.virt.block_device [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Booting with volume 5c7ee644-475f-4522-adf6-704098fbda77 at /dev/vda
Aug 16 22:29:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:30 user nova-compute[72773]: INFO os_vif [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:b6:33,bridge_name='br-int',has_traffic_filtering=True,id=3c311267-1174-4333-8de6-e0872bb91c07,network=Network(5cde2c8a-cc09-442d-b474-eb3cd32efbf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c311267-11')
Aug 16 22:29:30 user nova-compute[72773]: DEBUG os_brick.utils [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2276b0ae-f231-4dd7-8426-0601042849d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.042s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[def6642b-e949-458c-b8cd-c52be41a4a87]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] No VIF found with MAC fa:16:3e:80:b6:33, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.034s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5dd14b-3584-47c1-8162-9ccbc4d8fa6d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa508e3b-1ae1-4e5a-933f-093688fdf248]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.policy [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4682d0544d4646099b16e3af92d6cc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3a13289351c4eb58e8a2b56e83763fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:29:30 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:29:30 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c7c09c-e003-4bd4-a6d5-7267edc2aa0f]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG os_brick.utils [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] <== get_connector_properties: return (220ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Updating existing volume attachment record: eb1715a7-c085-4a17-b7d8-7a726acda3d3 {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:31 user nova-compute[72773]: DEBUG nova.network.neutron [req-14766ea9-500e-4252-bb8e-7561a811d254 req-d79e714b-fe24-473d-b953-0db8a4263a5e service nova] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Updated VIF entry in instance network info cache for port 3c311267-1174-4333-8de6-e0872bb91c07. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:29:31 user nova-compute[72773]: DEBUG nova.network.neutron [req-14766ea9-500e-4252-bb8e-7561a811d254 req-d79e714b-fe24-473d-b953-0db8a4263a5e service nova] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Updating instance_info_cache with network_info: [{"id": "3c311267-1174-4333-8de6-e0872bb91c07", "address": "fa:16:3e:80:b6:33", "network": {"id": "5cde2c8a-cc09-442d-b474-eb3cd32efbf1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1685780614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc5a319bbe5472b84c6fa3373d5c6e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c311267-11", "ovs_interfaceid": "3c311267-1174-4333-8de6-e0872bb91c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:29:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-14766ea9-500e-4252-bb8e-7561a811d254 req-d79e714b-fe24-473d-b953-0db8a4263a5e service nova] Releasing lock "refresh_cache-60b4514f-16f8-466d-9e58-b95c0bfb3f32" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:29:31 user nova-compute[72773]: DEBUG nova.compute.manager [req-479e9188-936f-4678-ab29-9813f611ed40 req-018c6776-39aa-48c8-b0a7-a9fd9384cbc8 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-unplugged-c27765c1-ae78-4b0b-8abf-2514be5599a4 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-479e9188-936f-4678-ab29-9813f611ed40 req-018c6776-39aa-48c8-b0a7-a9fd9384cbc8 service nova] Acquiring lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-479e9188-936f-4678-ab29-9813f611ed40 req-018c6776-39aa-48c8-b0a7-a9fd9384cbc8 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-479e9188-936f-4678-ab29-9813f611ed40 req-018c6776-39aa-48c8-b0a7-a9fd9384cbc8 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:31 user nova-compute[72773]: DEBUG nova.compute.manager [req-479e9188-936f-4678-ab29-9813f611ed40 req-018c6776-39aa-48c8-b0a7-a9fd9384cbc8 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] No waiting events found dispatching network-vif-unplugged-c27765c1-ae78-4b0b-8abf-2514be5599a4 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:29:31 user nova-compute[72773]: DEBUG nova.compute.manager [req-479e9188-936f-4678-ab29-9813f611ed40 req-018c6776-39aa-48c8-b0a7-a9fd9384cbc8 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-unplugged-c27765c1-ae78-4b0b-8abf-2514be5599a4 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:29:31 user nova-compute[72773]: DEBUG nova.compute.manager [req-71c1dd44-c723-4a8e-baa6-b3e3c14679de req-7ffddc59-19dc-43cf-8c0c-3a5fbf73fee2 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-unplugged-213a2da6-430b-4976-b5f0-a18d8494f42c {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-71c1dd44-c723-4a8e-baa6-b3e3c14679de req-7ffddc59-19dc-43cf-8c0c-3a5fbf73fee2 service nova] Acquiring lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-71c1dd44-c723-4a8e-baa6-b3e3c14679de req-7ffddc59-19dc-43cf-8c0c-3a5fbf73fee2 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-71c1dd44-c723-4a8e-baa6-b3e3c14679de req-7ffddc59-19dc-43cf-8c0c-3a5fbf73fee2 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:31 user nova-compute[72773]: DEBUG nova.compute.manager [req-71c1dd44-c723-4a8e-baa6-b3e3c14679de req-7ffddc59-19dc-43cf-8c0c-3a5fbf73fee2 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] No waiting events found dispatching network-vif-unplugged-213a2da6-430b-4976-b5f0-a18d8494f42c {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:29:31 user nova-compute[72773]: DEBUG nova.compute.manager [req-71c1dd44-c723-4a8e-baa6-b3e3c14679de req-7ffddc59-19dc-43cf-8c0c-3a5fbf73fee2 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-unplugged-213a2da6-430b-4976-b5f0-a18d8494f42c for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:29:31 user nova-compute[72773]: DEBUG nova.compute.manager [req-71c1dd44-c723-4a8e-baa6-b3e3c14679de req-7ffddc59-19dc-43cf-8c0c-3a5fbf73fee2 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-plugged-213a2da6-430b-4976-b5f0-a18d8494f42c {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-71c1dd44-c723-4a8e-baa6-b3e3c14679de req-7ffddc59-19dc-43cf-8c0c-3a5fbf73fee2 service nova] Acquiring lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-71c1dd44-c723-4a8e-baa6-b3e3c14679de req-7ffddc59-19dc-43cf-8c0c-3a5fbf73fee2 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-71c1dd44-c723-4a8e-baa6-b3e3c14679de req-7ffddc59-19dc-43cf-8c0c-3a5fbf73fee2 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:31 user nova-compute[72773]: DEBUG nova.compute.manager [req-71c1dd44-c723-4a8e-baa6-b3e3c14679de req-7ffddc59-19dc-43cf-8c0c-3a5fbf73fee2 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] No waiting events found dispatching network-vif-plugged-213a2da6-430b-4976-b5f0-a18d8494f42c {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:29:31 user nova-compute[72773]: WARNING nova.compute.manager [req-71c1dd44-c723-4a8e-baa6-b3e3c14679de req-7ffddc59-19dc-43cf-8c0c-3a5fbf73fee2 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received unexpected event network-vif-plugged-213a2da6-430b-4976-b5f0-a18d8494f42c for instance with vm_state active and task_state deleting.
Aug 16 22:29:31 user nova-compute[72773]: DEBUG nova.compute.manager [req-71c1dd44-c723-4a8e-baa6-b3e3c14679de req-7ffddc59-19dc-43cf-8c0c-3a5fbf73fee2 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-unplugged-38eab1de-142b-4f98-a91e-bea564b65757 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-71c1dd44-c723-4a8e-baa6-b3e3c14679de req-7ffddc59-19dc-43cf-8c0c-3a5fbf73fee2 service nova] Acquiring lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-71c1dd44-c723-4a8e-baa6-b3e3c14679de req-7ffddc59-19dc-43cf-8c0c-3a5fbf73fee2 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-71c1dd44-c723-4a8e-baa6-b3e3c14679de req-7ffddc59-19dc-43cf-8c0c-3a5fbf73fee2 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:31 user nova-compute[72773]: DEBUG nova.compute.manager [req-71c1dd44-c723-4a8e-baa6-b3e3c14679de req-7ffddc59-19dc-43cf-8c0c-3a5fbf73fee2 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] No waiting events found dispatching network-vif-unplugged-38eab1de-142b-4f98-a91e-bea564b65757 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:29:31 user nova-compute[72773]: DEBUG nova.compute.manager [req-71c1dd44-c723-4a8e-baa6-b3e3c14679de req-7ffddc59-19dc-43cf-8c0c-3a5fbf73fee2 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-unplugged-38eab1de-142b-4f98-a91e-bea564b65757 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:29:32 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Instance destroyed successfully.
Aug 16 22:29:32 user nova-compute[72773]: DEBUG nova.objects.instance [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Lazy-loading 'resources' on Instance uuid df2acdf5-7c83-4129-8cab-da9882e1ac69 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG nova.network.neutron [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Successfully created port: b47506d5-cd81-498a-8f7b-d735d0601f49 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:26:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1052487575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1052487575',id=11,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMr61hRyHoiw7RLAcmFFbRkNzJ6KcXma/DRbPz67AtgnSN5y3RBjBLqcyKXMwTBi5sdTSeHxaM6LxiVQERZhG+rVcfO43p97rmIcySw2/GR43aK1f6KOgaRoN5sRtwVSVA==',key_name='tempest-keypair-1826579815',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:27:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07a1fa6998aa4972a3335aa78398e667',ramdisk_id='',reservation_id='r-5u37r3nl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-186566092',owner_user_name='tempest-TaggedBootDevicesTest-186566092-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:27:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='270300fb94e04ed5823a0eeab40a4703',uuid=df2acdf5-7c83-4129-8cab-da9882e1ac69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2f04ed7-213b-4297-a13d-ad99a922f878", "address": "fa:16:3e:ee:62:f5", "network": {"id": "78850332-7129-48d4-ad0f-222c6981d934", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-817612380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f04ed7-21", "ovs_interfaceid": "a2f04ed7-213b-4297-a13d-ad99a922f878", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converting VIF {"id": "a2f04ed7-213b-4297-a13d-ad99a922f878", "address": "fa:16:3e:ee:62:f5", "network": {"id": "78850332-7129-48d4-ad0f-222c6981d934", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-817612380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f04ed7-21", "ovs_interfaceid": "a2f04ed7-213b-4297-a13d-ad99a922f878", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:62:f5,bridge_name='br-int',has_traffic_filtering=True,id=a2f04ed7-213b-4297-a13d-ad99a922f878,network=Network(78850332-7129-48d4-ad0f-222c6981d934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2f04ed7-21') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG os_vif [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:62:f5,bridge_name='br-int',has_traffic_filtering=True,id=a2f04ed7-213b-4297-a13d-ad99a922f878,network=Network(78850332-7129-48d4-ad0f-222c6981d934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2f04ed7-21') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2f04ed7-21, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG nova.compute.manager [req-904eb657-fab2-4510-88f7-d5ffd501b378 req-ce8255d8-1c46-41a1-a410-115a068bd379 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-plugged-a2f04ed7-213b-4297-a13d-ad99a922f878 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-904eb657-fab2-4510-88f7-d5ffd501b378 req-ce8255d8-1c46-41a1-a410-115a068bd379 service nova] Acquiring lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-904eb657-fab2-4510-88f7-d5ffd501b378 req-ce8255d8-1c46-41a1-a410-115a068bd379 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-904eb657-fab2-4510-88f7-d5ffd501b378 req-ce8255d8-1c46-41a1-a410-115a068bd379 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG nova.compute.manager [req-904eb657-fab2-4510-88f7-d5ffd501b378 req-ce8255d8-1c46-41a1-a410-115a068bd379 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] No waiting events found dispatching network-vif-plugged-a2f04ed7-213b-4297-a13d-ad99a922f878 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:29:32 user nova-compute[72773]: WARNING nova.compute.manager [req-904eb657-fab2-4510-88f7-d5ffd501b378 req-ce8255d8-1c46-41a1-a410-115a068bd379 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received unexpected event network-vif-plugged-a2f04ed7-213b-4297-a13d-ad99a922f878 for instance with vm_state active and task_state deleting.
Aug 16 22:29:32 user nova-compute[72773]: DEBUG nova.compute.manager [req-904eb657-fab2-4510-88f7-d5ffd501b378 req-ce8255d8-1c46-41a1-a410-115a068bd379 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-unplugged-69942063-04a7-4cd3-87dd-42952e5fc667 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-904eb657-fab2-4510-88f7-d5ffd501b378 req-ce8255d8-1c46-41a1-a410-115a068bd379 service nova] Acquiring lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-904eb657-fab2-4510-88f7-d5ffd501b378 req-ce8255d8-1c46-41a1-a410-115a068bd379 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-904eb657-fab2-4510-88f7-d5ffd501b378 req-ce8255d8-1c46-41a1-a410-115a068bd379 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG nova.compute.manager [req-904eb657-fab2-4510-88f7-d5ffd501b378 req-ce8255d8-1c46-41a1-a410-115a068bd379 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] No waiting events found dispatching network-vif-unplugged-69942063-04a7-4cd3-87dd-42952e5fc667 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG nova.compute.manager [req-904eb657-fab2-4510-88f7-d5ffd501b378 req-ce8255d8-1c46-41a1-a410-115a068bd379 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-unplugged-69942063-04a7-4cd3-87dd-42952e5fc667 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG nova.compute.manager [req-904eb657-fab2-4510-88f7-d5ffd501b378 req-ce8255d8-1c46-41a1-a410-115a068bd379 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-plugged-69942063-04a7-4cd3-87dd-42952e5fc667 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-904eb657-fab2-4510-88f7-d5ffd501b378 req-ce8255d8-1c46-41a1-a410-115a068bd379 service nova] Acquiring lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-904eb657-fab2-4510-88f7-d5ffd501b378 req-ce8255d8-1c46-41a1-a410-115a068bd379 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-904eb657-fab2-4510-88f7-d5ffd501b378 req-ce8255d8-1c46-41a1-a410-115a068bd379 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG nova.compute.manager [req-904eb657-fab2-4510-88f7-d5ffd501b378 req-ce8255d8-1c46-41a1-a410-115a068bd379 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] No waiting events found dispatching network-vif-plugged-69942063-04a7-4cd3-87dd-42952e5fc667 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:29:32 user nova-compute[72773]: WARNING nova.compute.manager [req-904eb657-fab2-4510-88f7-d5ffd501b378 req-ce8255d8-1c46-41a1-a410-115a068bd379 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received unexpected event network-vif-plugged-69942063-04a7-4cd3-87dd-42952e5fc667 for instance with vm_state active and task_state deleting.
Aug 16 22:29:32 user nova-compute[72773]: DEBUG nova.compute.manager [req-904eb657-fab2-4510-88f7-d5ffd501b378 req-ce8255d8-1c46-41a1-a410-115a068bd379 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-unplugged-f77f6c81-0377-4531-8c95-07be0a197bcc {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-904eb657-fab2-4510-88f7-d5ffd501b378 req-ce8255d8-1c46-41a1-a410-115a068bd379 service nova] Acquiring lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-904eb657-fab2-4510-88f7-d5ffd501b378 req-ce8255d8-1c46-41a1-a410-115a068bd379 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-904eb657-fab2-4510-88f7-d5ffd501b378 req-ce8255d8-1c46-41a1-a410-115a068bd379 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG nova.compute.manager [req-904eb657-fab2-4510-88f7-d5ffd501b378 req-ce8255d8-1c46-41a1-a410-115a068bd379 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] No waiting events found dispatching network-vif-unplugged-f77f6c81-0377-4531-8c95-07be0a197bcc {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG nova.compute.manager [req-904eb657-fab2-4510-88f7-d5ffd501b378 req-ce8255d8-1c46-41a1-a410-115a068bd379 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-unplugged-f77f6c81-0377-4531-8c95-07be0a197bcc for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:32 user nova-compute[72773]: INFO os_vif [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:62:f5,bridge_name='br-int',has_traffic_filtering=True,id=a2f04ed7-213b-4297-a13d-ad99a922f878,network=Network(78850332-7129-48d4-ad0f-222c6981d934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2f04ed7-21')
Aug 16 22:29:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:26:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1052487575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1052487575',id=11,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMr61hRyHoiw7RLAcmFFbRkNzJ6KcXma/DRbPz67AtgnSN5y3RBjBLqcyKXMwTBi5sdTSeHxaM6LxiVQERZhG+rVcfO43p97rmIcySw2/GR43aK1f6KOgaRoN5sRtwVSVA==',key_name='tempest-keypair-1826579815',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:27:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07a1fa6998aa4972a3335aa78398e667',ramdisk_id='',reservation_id='r-5u37r3nl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-186566092',owner_user_name='tempest-TaggedBootDevicesTest-186566092-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:27:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='270300fb94e04ed5823a0eeab40a4703',uuid=df2acdf5-7c83-4129-8cab-da9882e1ac69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "213a2da6-430b-4976-b5f0-a18d8494f42c", "address": "fa:16:3e:62:39:b6", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213a2da6-43", "ovs_interfaceid": "213a2da6-430b-4976-b5f0-a18d8494f42c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converting VIF {"id": "213a2da6-430b-4976-b5f0-a18d8494f42c", "address": "fa:16:3e:62:39:b6", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213a2da6-43", "ovs_interfaceid": "213a2da6-430b-4976-b5f0-a18d8494f42c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:39:b6,bridge_name='br-int',has_traffic_filtering=True,id=213a2da6-430b-4976-b5f0-a18d8494f42c,network=Network(a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap213a2da6-43') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG os_vif [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:39:b6,bridge_name='br-int',has_traffic_filtering=True,id=213a2da6-430b-4976-b5f0-a18d8494f42c,network=Network(a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap213a2da6-43') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap213a2da6-43, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:32 user nova-compute[72773]: INFO os_vif [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:39:b6,bridge_name='br-int',has_traffic_filtering=True,id=213a2da6-430b-4976-b5f0-a18d8494f42c,network=Network(a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap213a2da6-43')
Aug 16 22:29:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:26:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1052487575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1052487575',id=11,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMr61hRyHoiw7RLAcmFFbRkNzJ6KcXma/DRbPz67AtgnSN5y3RBjBLqcyKXMwTBi5sdTSeHxaM6LxiVQERZhG+rVcfO43p97rmIcySw2/GR43aK1f6KOgaRoN5sRtwVSVA==',key_name='tempest-keypair-1826579815',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:27:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07a1fa6998aa4972a3335aa78398e667',ramdisk_id='',reservation_id='r-5u37r3nl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-186566092',owner_user_name='tempest-TaggedBootDevicesTest-186566092-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:27:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='270300fb94e04ed5823a0eeab40a4703',uuid=df2acdf5-7c83-4129-8cab-da9882e1ac69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c27765c1-ae78-4b0b-8abf-2514be5599a4", "address": "fa:16:3e:12:84:13", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc27765c1-ae", "ovs_interfaceid": "c27765c1-ae78-4b0b-8abf-2514be5599a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converting VIF {"id": "c27765c1-ae78-4b0b-8abf-2514be5599a4", "address": "fa:16:3e:12:84:13", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc27765c1-ae", "ovs_interfaceid": "c27765c1-ae78-4b0b-8abf-2514be5599a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:84:13,bridge_name='br-int',has_traffic_filtering=True,id=c27765c1-ae78-4b0b-8abf-2514be5599a4,network=Network(a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc27765c1-ae') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG os_vif [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:84:13,bridge_name='br-int',has_traffic_filtering=True,id=c27765c1-ae78-4b0b-8abf-2514be5599a4,network=Network(a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc27765c1-ae') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc27765c1-ae, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:32 user nova-compute[72773]: INFO os_vif [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:84:13,bridge_name='br-int',has_traffic_filtering=True,id=c27765c1-ae78-4b0b-8abf-2514be5599a4,network=Network(a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc27765c1-ae')
Aug 16 22:29:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:26:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1052487575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1052487575',id=11,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMr61hRyHoiw7RLAcmFFbRkNzJ6KcXma/DRbPz67AtgnSN5y3RBjBLqcyKXMwTBi5sdTSeHxaM6LxiVQERZhG+rVcfO43p97rmIcySw2/GR43aK1f6KOgaRoN5sRtwVSVA==',key_name='tempest-keypair-1826579815',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:27:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07a1fa6998aa4972a3335aa78398e667',ramdisk_id='',reservation_id='r-5u37r3nl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-186566092',owner_user_name='tempest-TaggedBootDevicesTest-186566092-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:27:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='270300fb94e04ed5823a0eeab40a4703',uuid=df2acdf5-7c83-4129-8cab-da9882e1ac69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69942063-04a7-4cd3-87dd-42952e5fc667", "address": "fa:16:3e:8c:1b:60", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69942063-04", "ovs_interfaceid": "69942063-04a7-4cd3-87dd-42952e5fc667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converting VIF {"id": "69942063-04a7-4cd3-87dd-42952e5fc667", "address": "fa:16:3e:8c:1b:60", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69942063-04", "ovs_interfaceid": "69942063-04a7-4cd3-87dd-42952e5fc667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:1b:60,bridge_name='br-int',has_traffic_filtering=True,id=69942063-04a7-4cd3-87dd-42952e5fc667,network=Network(a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69942063-04') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG os_vif [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:1b:60,bridge_name='br-int',has_traffic_filtering=True,id=69942063-04a7-4cd3-87dd-42952e5fc667,network=Network(a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69942063-04') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69942063-04, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:32 user nova-compute[72773]: INFO os_vif [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:1b:60,bridge_name='br-int',has_traffic_filtering=True,id=69942063-04a7-4cd3-87dd-42952e5fc667,network=Network(a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69942063-04')
Aug 16 22:29:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:26:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1052487575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1052487575',id=11,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMr61hRyHoiw7RLAcmFFbRkNzJ6KcXma/DRbPz67AtgnSN5y3RBjBLqcyKXMwTBi5sdTSeHxaM6LxiVQERZhG+rVcfO43p97rmIcySw2/GR43aK1f6KOgaRoN5sRtwVSVA==',key_name='tempest-keypair-1826579815',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:27:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07a1fa6998aa4972a3335aa78398e667',ramdisk_id='',reservation_id='r-5u37r3nl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-186566092',owner_user_name='tempest-TaggedBootDevicesTest-186566092-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:27:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='270300fb94e04ed5823a0eeab40a4703',uuid=df2acdf5-7c83-4129-8cab-da9882e1ac69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38eab1de-142b-4f98-a91e-bea564b65757", "address": "fa:16:3e:a8:88:1c", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38eab1de-14", "ovs_interfaceid": "38eab1de-142b-4f98-a91e-bea564b65757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converting VIF {"id": "38eab1de-142b-4f98-a91e-bea564b65757", "address": "fa:16:3e:a8:88:1c", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38eab1de-14", "ovs_interfaceid": "38eab1de-142b-4f98-a91e-bea564b65757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:88:1c,bridge_name='br-int',has_traffic_filtering=True,id=38eab1de-142b-4f98-a91e-bea564b65757,network=Network(a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38eab1de-14') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG os_vif [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:88:1c,bridge_name='br-int',has_traffic_filtering=True,id=38eab1de-142b-4f98-a91e-bea564b65757,network=Network(a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38eab1de-14') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38eab1de-14, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:32 user nova-compute[72773]: INFO os_vif [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:88:1c,bridge_name='br-int',has_traffic_filtering=True,id=38eab1de-142b-4f98-a91e-bea564b65757,network=Network(a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38eab1de-14')
Aug 16 22:29:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:26:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1052487575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1052487575',id=11,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMr61hRyHoiw7RLAcmFFbRkNzJ6KcXma/DRbPz67AtgnSN5y3RBjBLqcyKXMwTBi5sdTSeHxaM6LxiVQERZhG+rVcfO43p97rmIcySw2/GR43aK1f6KOgaRoN5sRtwVSVA==',key_name='tempest-keypair-1826579815',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:27:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07a1fa6998aa4972a3335aa78398e667',ramdisk_id='',reservation_id='r-5u37r3nl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-186566092',owner_user_name='tempest-TaggedBootDevicesTest-186566092-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:27:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='270300fb94e04ed5823a0eeab40a4703',uuid=df2acdf5-7c83-4129-8cab-da9882e1ac69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f77f6c81-0377-4531-8c95-07be0a197bcc", "address": "fa:16:3e:f0:3c:4a", "network": {"id": "9e71d1ff-9a5b-4a29-ad7e-6b4da698415d", "bridge": "br-int", "label": "tempest-device-tagging-net2-584203226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f6c81-03", "ovs_interfaceid": "f77f6c81-0377-4531-8c95-07be0a197bcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converting VIF {"id": "f77f6c81-0377-4531-8c95-07be0a197bcc", "address": "fa:16:3e:f0:3c:4a", "network": {"id": "9e71d1ff-9a5b-4a29-ad7e-6b4da698415d", "bridge": "br-int", "label": "tempest-device-tagging-net2-584203226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f6c81-03", "ovs_interfaceid": "f77f6c81-0377-4531-8c95-07be0a197bcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:3c:4a,bridge_name='br-int',has_traffic_filtering=True,id=f77f6c81-0377-4531-8c95-07be0a197bcc,network=Network(9e71d1ff-9a5b-4a29-ad7e-6b4da698415d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf77f6c81-03') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG os_vif [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:3c:4a,bridge_name='br-int',has_traffic_filtering=True,id=f77f6c81-0377-4531-8c95-07be0a197bcc,network=Network(9e71d1ff-9a5b-4a29-ad7e-6b4da698415d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf77f6c81-03') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf77f6c81-03, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:32 user nova-compute[72773]: INFO os_vif [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:3c:4a,bridge_name='br-int',has_traffic_filtering=True,id=f77f6c81-0377-4531-8c95-07be0a197bcc,network=Network(9e71d1ff-9a5b-4a29-ad7e-6b4da698415d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf77f6c81-03')
Aug 16 22:29:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:26:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1052487575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1052487575',id=11,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMr61hRyHoiw7RLAcmFFbRkNzJ6KcXma/DRbPz67AtgnSN5y3RBjBLqcyKXMwTBi5sdTSeHxaM6LxiVQERZhG+rVcfO43p97rmIcySw2/GR43aK1f6KOgaRoN5sRtwVSVA==',key_name='tempest-keypair-1826579815',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:27:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07a1fa6998aa4972a3335aa78398e667',ramdisk_id='',reservation_id='r-5u37r3nl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-186566092',owner_user_name='tempest-TaggedBootDevicesTest-186566092-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:27:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='270300fb94e04ed5823a0eeab40a4703',uuid=df2acdf5-7c83-4129-8cab-da9882e1ac69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b07374e-822f-4550-bcf1-c0259ca3624b", "address": "fa:16:3e:5f:15:a3", "network": {"id": "9e71d1ff-9a5b-4a29-ad7e-6b4da698415d", "bridge": "br-int", "label": "tempest-device-tagging-net2-584203226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b07374e-82", "ovs_interfaceid": "4b07374e-822f-4550-bcf1-c0259ca3624b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converting VIF {"id": "4b07374e-822f-4550-bcf1-c0259ca3624b", "address": "fa:16:3e:5f:15:a3", "network": {"id": "9e71d1ff-9a5b-4a29-ad7e-6b4da698415d", "bridge": "br-int", "label": "tempest-device-tagging-net2-584203226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b07374e-82", "ovs_interfaceid": "4b07374e-822f-4550-bcf1-c0259ca3624b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:15:a3,bridge_name='br-int',has_traffic_filtering=True,id=4b07374e-822f-4550-bcf1-c0259ca3624b,network=Network(9e71d1ff-9a5b-4a29-ad7e-6b4da698415d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b07374e-82') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG os_vif [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:15:a3,bridge_name='br-int',has_traffic_filtering=True,id=4b07374e-822f-4550-bcf1-c0259ca3624b,network=Network(9e71d1ff-9a5b-4a29-ad7e-6b4da698415d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b07374e-82') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b07374e-82, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:29:32 user nova-compute[72773]: INFO os_vif [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:15:a3,bridge_name='br-int',has_traffic_filtering=True,id=4b07374e-822f-4550-bcf1-c0259ca3624b,network=Network(9e71d1ff-9a5b-4a29-ad7e-6b4da698415d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b07374e-82')
Aug 16 22:29:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btrAaxGC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:29:32 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:29:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b5ecc6-75a3-4f2f-9ccf-89f883a9c5af]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd7f28a-00e8-49b5-8789-01ea2859aa85]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:29:33 user nova-compute[72773]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:29:33 user nova-compute[72773]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 (non-flash)
Aug 16 22:29:33 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:29:33 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:29:33 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:29:33 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:29:33 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:29:33 user nova-compute[72773]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:29:33 user nova-compute[72773]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 (non-flash)
Aug 16 22:29:33 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:29:33 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:29:33 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:29:33 user nova-compute[72773]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 (non-flash)
Aug 16 22:29:33 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef800fe200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0'): ({'sdg'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Removing single pathed devices sdg {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6043e9c6-c6e1-4468-834e-0d1978d7f09f]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.032s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[602df9c0-4aea-47b8-bd5f-6f4d8f3bbcf6]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Flushing IO for device /dev/sdg {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.036s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a8d278-6d67-48b1-973f-ccf0743d3eaa]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.050s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9db607-6dab-438d-897e-eb680ab49624]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] SCSI volumes sdg have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[564e863f-18d1-451a-91ab-5844e709f55c]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3e806e-4da8-4422-846d-074e06a3127a]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0, portal: 172.16.0.220,3260]
Aug 16 22:29:33 user nova-compute[72773]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0, portal: 172.16.0.220,3260] successful.
Aug 16 22:29:33 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423d5c85-4fe4-454e-9164-709647d701f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.051s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ec3935-a1b3-485b-b84c-1f273f348c8c]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.451s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] <== disconnect_volume: return (454ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJPsTpKL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:29:33 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd4aab8-1ce6-4c8d-b57c-0654b424cee5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.056s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee25fb76-dfa5-449f-bec8-0368f2976fde]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:29:33 user nova-compute[72773]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:29:33 user nova-compute[72773]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 (non-flash)
Aug 16 22:29:33 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:29:33 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:29:33 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:29:33 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:29:33 user nova-compute[72773]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:29:33 user nova-compute[72773]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 (non-flash)
Aug 16 22:29:33 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:29:33 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:29:33 user nova-compute[72773]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d (non-flash)
Aug 16 22:29:33 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef800fe200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d'): ({'sde'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Removing single pathed devices sde {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2aa14e-6b4d-4d1f-b894-7a3a39d7f347]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.031s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[17841ec8-3914-433c-a574-ed579ffbd555]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Flushing IO for device /dev/sde {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG nova.network.neutron [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Successfully created port: 2581ab2b-5a7c-4c9a-8f59-f3c5a7228044 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c889a2-daac-415c-9764-91c3fd43e12b]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48ec849-ee4a-4c05-900e-6777365ca6e1]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] SCSI volumes sde have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8250ac07-7b94-4af2-bd0b-0933aea244f9]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG nova.compute.manager [req-9c4dc6ff-a346-4656-b198-33505935f158 req-843c8ce4-1d91-44ff-846c-7ce1b7977b05 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-plugged-c27765c1-ae78-4b0b-8abf-2514be5599a4 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9c4dc6ff-a346-4656-b198-33505935f158 req-843c8ce4-1d91-44ff-846c-7ce1b7977b05 service nova] Acquiring lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9c4dc6ff-a346-4656-b198-33505935f158 req-843c8ce4-1d91-44ff-846c-7ce1b7977b05 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9c4dc6ff-a346-4656-b198-33505935f158 req-843c8ce4-1d91-44ff-846c-7ce1b7977b05 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG nova.compute.manager [req-9c4dc6ff-a346-4656-b198-33505935f158 req-843c8ce4-1d91-44ff-846c-7ce1b7977b05 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] No waiting events found dispatching network-vif-plugged-c27765c1-ae78-4b0b-8abf-2514be5599a4 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:29:33 user nova-compute[72773]: WARNING nova.compute.manager [req-9c4dc6ff-a346-4656-b198-33505935f158 req-843c8ce4-1d91-44ff-846c-7ce1b7977b05 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received unexpected event network-vif-plugged-c27765c1-ae78-4b0b-8abf-2514be5599a4 for instance with vm_state active and task_state deleting.
Aug 16 22:29:33 user nova-compute[72773]: DEBUG nova.compute.manager [req-9c4dc6ff-a346-4656-b198-33505935f158 req-843c8ce4-1d91-44ff-846c-7ce1b7977b05 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-unplugged-4b07374e-822f-4550-bcf1-c0259ca3624b {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9c4dc6ff-a346-4656-b198-33505935f158 req-843c8ce4-1d91-44ff-846c-7ce1b7977b05 service nova] Acquiring lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9c4dc6ff-a346-4656-b198-33505935f158 req-843c8ce4-1d91-44ff-846c-7ce1b7977b05 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9c4dc6ff-a346-4656-b198-33505935f158 req-843c8ce4-1d91-44ff-846c-7ce1b7977b05 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG nova.compute.manager [req-9c4dc6ff-a346-4656-b198-33505935f158 req-843c8ce4-1d91-44ff-846c-7ce1b7977b05 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] No waiting events found dispatching network-vif-unplugged-4b07374e-822f-4550-bcf1-c0259ca3624b {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG nova.compute.manager [req-9c4dc6ff-a346-4656-b198-33505935f158 req-843c8ce4-1d91-44ff-846c-7ce1b7977b05 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-unplugged-4b07374e-822f-4550-bcf1-c0259ca3624b for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG nova.compute.manager [req-9c4dc6ff-a346-4656-b198-33505935f158 req-843c8ce4-1d91-44ff-846c-7ce1b7977b05 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-plugged-4b07374e-822f-4550-bcf1-c0259ca3624b {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9c4dc6ff-a346-4656-b198-33505935f158 req-843c8ce4-1d91-44ff-846c-7ce1b7977b05 service nova] Acquiring lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9c4dc6ff-a346-4656-b198-33505935f158 req-843c8ce4-1d91-44ff-846c-7ce1b7977b05 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9c4dc6ff-a346-4656-b198-33505935f158 req-843c8ce4-1d91-44ff-846c-7ce1b7977b05 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG nova.compute.manager [req-9c4dc6ff-a346-4656-b198-33505935f158 req-843c8ce4-1d91-44ff-846c-7ce1b7977b05 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] No waiting events found dispatching network-vif-plugged-4b07374e-822f-4550-bcf1-c0259ca3624b {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:29:33 user nova-compute[72773]: WARNING nova.compute.manager [req-9c4dc6ff-a346-4656-b198-33505935f158 req-843c8ce4-1d91-44ff-846c-7ce1b7977b05 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received unexpected event network-vif-plugged-4b07374e-822f-4550-bcf1-c0259ca3624b for instance with vm_state active and task_state deleting.
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9912879d-266b-4ee4-a677-b40e473af1a3]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d, portal: 172.16.0.220,3260]
Aug 16 22:29:33 user nova-compute[72773]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d, portal: 172.16.0.220,3260] successful.
Aug 16 22:29:33 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8469fb8-1df6-4bb2-be19-7878c4d4cd9d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1af78ae-1410-4cb2-a7b5-0be729ff30ab]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.451s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] <== disconnect_volume: return (453ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VrJFCIxz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:29:33 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6f88ef-a991-4dd6-b8e5-faece06ca293]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG nova.compute.manager [req-bf6e5a68-5b04-4ea7-acdc-39485073bfb2 req-8732a71b-1923-4c7e-bcb7-f71d6271c097 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-plugged-38eab1de-142b-4f98-a91e-bea564b65757 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-bf6e5a68-5b04-4ea7-acdc-39485073bfb2 req-8732a71b-1923-4c7e-bcb7-f71d6271c097 service nova] Acquiring lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-bf6e5a68-5b04-4ea7-acdc-39485073bfb2 req-8732a71b-1923-4c7e-bcb7-f71d6271c097 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-bf6e5a68-5b04-4ea7-acdc-39485073bfb2 req-8732a71b-1923-4c7e-bcb7-f71d6271c097 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG nova.compute.manager [req-bf6e5a68-5b04-4ea7-acdc-39485073bfb2 req-8732a71b-1923-4c7e-bcb7-f71d6271c097 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] No waiting events found dispatching network-vif-plugged-38eab1de-142b-4f98-a91e-bea564b65757 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:29:33 user nova-compute[72773]: WARNING nova.compute.manager [req-bf6e5a68-5b04-4ea7-acdc-39485073bfb2 req-8732a71b-1923-4c7e-bcb7-f71d6271c097 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received unexpected event network-vif-plugged-38eab1de-142b-4f98-a91e-bea564b65757 for instance with vm_state active and task_state deleting.
Aug 16 22:29:33 user nova-compute[72773]: DEBUG nova.compute.manager [req-bf6e5a68-5b04-4ea7-acdc-39485073bfb2 req-8732a71b-1923-4c7e-bcb7-f71d6271c097 service nova] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Received event network-vif-plugged-3c311267-1174-4333-8de6-e0872bb91c07 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-bf6e5a68-5b04-4ea7-acdc-39485073bfb2 req-8732a71b-1923-4c7e-bcb7-f71d6271c097 service nova] Acquiring lock "60b4514f-16f8-466d-9e58-b95c0bfb3f32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-bf6e5a68-5b04-4ea7-acdc-39485073bfb2 req-8732a71b-1923-4c7e-bcb7-f71d6271c097 service nova] Lock "60b4514f-16f8-466d-9e58-b95c0bfb3f32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-bf6e5a68-5b04-4ea7-acdc-39485073bfb2 req-8732a71b-1923-4c7e-bcb7-f71d6271c097 service nova] Lock "60b4514f-16f8-466d-9e58-b95c0bfb3f32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG nova.compute.manager [req-bf6e5a68-5b04-4ea7-acdc-39485073bfb2 req-8732a71b-1923-4c7e-bcb7-f71d6271c097 service nova] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] No waiting events found dispatching network-vif-plugged-3c311267-1174-4333-8de6-e0872bb91c07 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:29:33 user nova-compute[72773]: WARNING nova.compute.manager [req-bf6e5a68-5b04-4ea7-acdc-39485073bfb2 req-8732a71b-1923-4c7e-bcb7-f71d6271c097 service nova] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Received unexpected event network-vif-plugged-3c311267-1174-4333-8de6-e0872bb91c07 for instance with vm_state building and task_state spawning.
Aug 16 22:29:33 user nova-compute[72773]: DEBUG nova.compute.manager [req-bf6e5a68-5b04-4ea7-acdc-39485073bfb2 req-8732a71b-1923-4c7e-bcb7-f71d6271c097 service nova] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Received event network-vif-plugged-3c311267-1174-4333-8de6-e0872bb91c07 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-bf6e5a68-5b04-4ea7-acdc-39485073bfb2 req-8732a71b-1923-4c7e-bcb7-f71d6271c097 service nova] Acquiring lock "60b4514f-16f8-466d-9e58-b95c0bfb3f32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-bf6e5a68-5b04-4ea7-acdc-39485073bfb2 req-8732a71b-1923-4c7e-bcb7-f71d6271c097 service nova] Lock "60b4514f-16f8-466d-9e58-b95c0bfb3f32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-bf6e5a68-5b04-4ea7-acdc-39485073bfb2 req-8732a71b-1923-4c7e-bcb7-f71d6271c097 service nova] Lock "60b4514f-16f8-466d-9e58-b95c0bfb3f32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG nova.compute.manager [req-bf6e5a68-5b04-4ea7-acdc-39485073bfb2 req-8732a71b-1923-4c7e-bcb7-f71d6271c097 service nova] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] No waiting events found dispatching network-vif-plugged-3c311267-1174-4333-8de6-e0872bb91c07 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:29:33 user nova-compute[72773]: WARNING nova.compute.manager [req-bf6e5a68-5b04-4ea7-acdc-39485073bfb2 req-8732a71b-1923-4c7e-bcb7-f71d6271c097 service nova] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Received unexpected event network-vif-plugged-3c311267-1174-4333-8de6-e0872bb91c07 for instance with vm_state building and task_state spawning.
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[746958d5-b765-4369-afd0-5ae4b0161d19]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:29:33 user nova-compute[72773]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:29:33 user nova-compute[72773]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 (non-flash)
Aug 16 22:29:33 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:29:33 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:29:33 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:29:33 user nova-compute[72773]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:29:33 user nova-compute[72773]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 (non-flash)
Aug 16 22:29:33 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:29:33 user nova-compute[72773]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d (non-flash)
Aug 16 22:29:33 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef5c4260e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d'): ({'sdd'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Removing single pathed devices sdd {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8d9f0e-2a67-4d9d-af58-813298569e7c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.029s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[74df0dc4-e4f6-4491-8eb7-87da993203d2]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Flushing IO for device /dev/sdd {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:29:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[572f3db4-acba-47dd-be1d-f74281c1af60]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:34 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:29:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7273882e-af7c-4afc-b158-436de5521de9]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:34 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:29:34 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] SCSI volumes sdd have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:29:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:29:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e03f80-21a7-476d-a21c-a31ebd3a52a5]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1000b87d-5214-4b47-a135-39105bf85c57]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d, portal: 172.16.0.220,3260]
Aug 16 22:29:34 user nova-compute[72773]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d, portal: 172.16.0.220,3260] successful.
Aug 16 22:29:34 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffd4a5d3-43a9-42f6-9e81-78036352413d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.104s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5d2294-e1a5-4316-9776-2957a63dc3cd]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.444s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:29:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] <== disconnect_volume: return (445ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:29:34 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:29:34 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Deleting instance files /opt/stack/data/nova/instances/df2acdf5-7c83-4129-8cab-da9882e1ac69_del
Aug 16 22:29:34 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Deletion of /opt/stack/data/nova/instances/df2acdf5-7c83-4129-8cab-da9882e1ac69_del complete
Aug 16 22:29:34 user nova-compute[72773]: DEBUG nova.network.neutron [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Successfully created port: 464fb40c-7053-464f-b788-d285f283fb56 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:29:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:34 user nova-compute[72773]: DEBUG nova.compute.manager [req-ae2d47e6-2ce3-4424-bcb8-3a64a5634434 req-9fe5d43f-ec97-4efb-8a33-3f821f202122 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-plugged-f77f6c81-0377-4531-8c95-07be0a197bcc {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ae2d47e6-2ce3-4424-bcb8-3a64a5634434 req-9fe5d43f-ec97-4efb-8a33-3f821f202122 service nova] Acquiring lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ae2d47e6-2ce3-4424-bcb8-3a64a5634434 req-9fe5d43f-ec97-4efb-8a33-3f821f202122 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ae2d47e6-2ce3-4424-bcb8-3a64a5634434 req-9fe5d43f-ec97-4efb-8a33-3f821f202122 service nova] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:34 user nova-compute[72773]: DEBUG nova.compute.manager [req-ae2d47e6-2ce3-4424-bcb8-3a64a5634434 req-9fe5d43f-ec97-4efb-8a33-3f821f202122 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] No waiting events found dispatching network-vif-plugged-f77f6c81-0377-4531-8c95-07be0a197bcc {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:29:34 user nova-compute[72773]: WARNING nova.compute.manager [req-ae2d47e6-2ce3-4424-bcb8-3a64a5634434 req-9fe5d43f-ec97-4efb-8a33-3f821f202122 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received unexpected event network-vif-plugged-f77f6c81-0377-4531-8c95-07be0a197bcc for instance with vm_state active and task_state deleting.
Aug 16 22:29:34 user nova-compute[72773]: INFO nova.compute.manager [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Took 4.88 seconds to destroy the instance on the hypervisor.
Aug 16 22:29:34 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:29:34 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:29:34 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:29:35 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224975.8198311, 60b4514f-16f8-466d-9e58-b95c0bfb3f32 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:29:35 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] VM Resumed (Lifecycle Event)
Aug 16 22:29:35 user nova-compute[72773]: DEBUG nova.compute.manager [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:29:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:29:35 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:29:35 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Instance spawned successfully.
Aug 16 22:29:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:29:35 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:29:35 user nova-compute[72773]: DEBUG nova.network.neutron [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Successfully created port: 44f58154-ceae-45ef-a169-0681e0e9a3fb {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:29:35 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:29:35 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224975.8207712, 60b4514f-16f8-466d-9e58-b95c0bfb3f32 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:29:35 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] VM Started (Lifecycle Event)
Aug 16 22:29:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:29:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:29:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:29:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:29:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:29:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:29:35 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:29:35 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:29:35 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:29:36 user nova-compute[72773]: INFO nova.compute.manager [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Took 8.66 seconds to spawn the instance on the hypervisor.
Aug 16 22:29:36 user nova-compute[72773]: DEBUG nova.compute.manager [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:29:36 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:36 user nova-compute[72773]: INFO nova.compute.manager [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Took 9.65 seconds to build instance.
Aug 16 22:29:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e701f453-9284-4954-b206-a4953229cae6 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lock "60b4514f-16f8-466d-9e58-b95c0bfb3f32" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.757s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:36 user nova-compute[72773]: DEBUG nova.network.neutron [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Successfully created port: 0230e8bd-c876-4793-96f6-9ccc72deaa73 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:29:37 user nova-compute[72773]: DEBUG nova.compute.manager [req-77783b94-49b0-47da-b288-d6a983884bfd req-64c6562e-47be-47d9-99d5-944e77f3861e service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-deleted-69942063-04a7-4cd3-87dd-42952e5fc667 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:37 user nova-compute[72773]: INFO nova.compute.manager [req-77783b94-49b0-47da-b288-d6a983884bfd req-64c6562e-47be-47d9-99d5-944e77f3861e service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Neutron deleted interface 69942063-04a7-4cd3-87dd-42952e5fc667; detaching it from the instance and deleting it from the info cache
Aug 16 22:29:37 user nova-compute[72773]: DEBUG nova.network.neutron [req-77783b94-49b0-47da-b288-d6a983884bfd req-64c6562e-47be-47d9-99d5-944e77f3861e service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Updating instance_info_cache with network_info: [{"id": "a2f04ed7-213b-4297-a13d-ad99a922f878", "address": "fa:16:3e:ee:62:f5", "network": {"id": "78850332-7129-48d4-ad0f-222c6981d934", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-817612380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f04ed7-21", "ovs_interfaceid": "a2f04ed7-213b-4297-a13d-ad99a922f878", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "213a2da6-430b-4976-b5f0-a18d8494f42c", "address": "fa:16:3e:62:39:b6", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213a2da6-43", "ovs_interfaceid": "213a2da6-430b-4976-b5f0-a18d8494f42c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c27765c1-ae78-4b0b-8abf-2514be5599a4", "address": "fa:16:3e:12:84:13", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc27765c1-ae", "ovs_interfaceid": "c27765c1-ae78-4b0b-8abf-2514be5599a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "38eab1de-142b-4f98-a91e-bea564b65757", "address": "fa:16:3e:a8:88:1c", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38eab1de-14", "ovs_interfaceid": "38eab1de-142b-4f98-a91e-bea564b65757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f77f6c81-0377-4531-8c95-07be0a197bcc", "address": "fa:16:3e:f0:3c:4a", "network": {"id": "9e71d1ff-9a5b-4a29-ad7e-6b4da698415d", "bridge": "br-int", "label": "tempest-device-tagging-net2-584203226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f6c81-03", "ovs_interfaceid": "f77f6c81-0377-4531-8c95-07be0a197bcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b07374e-822f-4550-bcf1-c0259ca3624b", "address": "fa:16:3e:5f:15:a3", "network": {"id": "9e71d1ff-9a5b-4a29-ad7e-6b4da698415d", "bridge": "br-int", "label": "tempest-device-tagging-net2-584203226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b07374e-82", "ovs_interfaceid": "4b07374e-822f-4550-bcf1-c0259ca3624b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:29:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:37 user nova-compute[72773]: DEBUG nova.compute.manager [req-77783b94-49b0-47da-b288-d6a983884bfd req-64c6562e-47be-47d9-99d5-944e77f3861e service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Detach interface failed, port_id=69942063-04a7-4cd3-87dd-42952e5fc667, reason: Instance df2acdf5-7c83-4129-8cab-da9882e1ac69 could not be found. {{(pid=72773) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 22:29:38 user nova-compute[72773]: DEBUG nova.network.neutron [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Successfully updated port: b47506d5-cd81-498a-8f7b-d735d0601f49 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:29:38 user nova-compute[72773]: DEBUG nova.compute.manager [req-adf227f0-d450-4926-bee5-bf2f2a739c37 req-6cc6ad41-21dc-4d06-a57c-d4f50bf6f0e8 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-changed-b47506d5-cd81-498a-8f7b-d735d0601f49 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:38 user nova-compute[72773]: DEBUG nova.compute.manager [req-adf227f0-d450-4926-bee5-bf2f2a739c37 req-6cc6ad41-21dc-4d06-a57c-d4f50bf6f0e8 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Refreshing instance network info cache due to event network-changed-b47506d5-cd81-498a-8f7b-d735d0601f49. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:29:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-adf227f0-d450-4926-bee5-bf2f2a739c37 req-6cc6ad41-21dc-4d06-a57c-d4f50bf6f0e8 service nova] Acquiring lock "refresh_cache-5aa5adad-599d-424f-bbfc-7d87ead31b57" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:29:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-adf227f0-d450-4926-bee5-bf2f2a739c37 req-6cc6ad41-21dc-4d06-a57c-d4f50bf6f0e8 service nova] Acquired lock "refresh_cache-5aa5adad-599d-424f-bbfc-7d87ead31b57" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:29:38 user nova-compute[72773]: DEBUG nova.network.neutron [req-adf227f0-d450-4926-bee5-bf2f2a739c37 req-6cc6ad41-21dc-4d06-a57c-d4f50bf6f0e8 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Refreshing network info cache for port b47506d5-cd81-498a-8f7b-d735d0601f49 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:29:38 user nova-compute[72773]: DEBUG nova.network.neutron [req-adf227f0-d450-4926-bee5-bf2f2a739c37 req-6cc6ad41-21dc-4d06-a57c-d4f50bf6f0e8 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:29:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:38 user nova-compute[72773]: DEBUG nova.network.neutron [req-adf227f0-d450-4926-bee5-bf2f2a739c37 req-6cc6ad41-21dc-4d06-a57c-d4f50bf6f0e8 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:29:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-adf227f0-d450-4926-bee5-bf2f2a739c37 req-6cc6ad41-21dc-4d06-a57c-d4f50bf6f0e8 service nova] Releasing lock "refresh_cache-5aa5adad-599d-424f-bbfc-7d87ead31b57" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:29:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:39 user nova-compute[72773]: DEBUG nova.network.neutron [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Successfully updated port: 4188d812-137b-448e-acb1-42dea2d8eb91 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:29:39 user nova-compute[72773]: DEBUG nova.compute.manager [req-a7692f03-433c-4f5a-876f-b7f178c3f05b req-4c6e6765-ce5f-40f7-9cc8-20f0a17dce9d service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-deleted-4b07374e-822f-4550-bcf1-c0259ca3624b {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:39 user nova-compute[72773]: INFO nova.compute.manager [req-a7692f03-433c-4f5a-876f-b7f178c3f05b req-4c6e6765-ce5f-40f7-9cc8-20f0a17dce9d service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Neutron deleted interface 4b07374e-822f-4550-bcf1-c0259ca3624b; detaching it from the instance and deleting it from the info cache
Aug 16 22:29:39 user nova-compute[72773]: DEBUG nova.network.neutron [req-a7692f03-433c-4f5a-876f-b7f178c3f05b req-4c6e6765-ce5f-40f7-9cc8-20f0a17dce9d service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Updating instance_info_cache with network_info: [{"id": "a2f04ed7-213b-4297-a13d-ad99a922f878", "address": "fa:16:3e:ee:62:f5", "network": {"id": "78850332-7129-48d4-ad0f-222c6981d934", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-817612380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f04ed7-21", "ovs_interfaceid": "a2f04ed7-213b-4297-a13d-ad99a922f878", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "213a2da6-430b-4976-b5f0-a18d8494f42c", "address": "fa:16:3e:62:39:b6", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213a2da6-43", "ovs_interfaceid": "213a2da6-430b-4976-b5f0-a18d8494f42c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c27765c1-ae78-4b0b-8abf-2514be5599a4", "address": "fa:16:3e:12:84:13", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc27765c1-ae", "ovs_interfaceid": "c27765c1-ae78-4b0b-8abf-2514be5599a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "38eab1de-142b-4f98-a91e-bea564b65757", "address": "fa:16:3e:a8:88:1c", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38eab1de-14", "ovs_interfaceid": "38eab1de-142b-4f98-a91e-bea564b65757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f77f6c81-0377-4531-8c95-07be0a197bcc", "address": "fa:16:3e:f0:3c:4a", "network": {"id": "9e71d1ff-9a5b-4a29-ad7e-6b4da698415d", "bridge": "br-int", "label": "tempest-device-tagging-net2-584203226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f6c81-03", "ovs_interfaceid": "f77f6c81-0377-4531-8c95-07be0a197bcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:29:39 user nova-compute[72773]: DEBUG nova.compute.manager [req-a7692f03-433c-4f5a-876f-b7f178c3f05b req-4c6e6765-ce5f-40f7-9cc8-20f0a17dce9d service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Detach interface failed, port_id=4b07374e-822f-4550-bcf1-c0259ca3624b, reason: Instance df2acdf5-7c83-4129-8cab-da9882e1ac69 could not be found. {{(pid=72773) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 22:29:39 user nova-compute[72773]: DEBUG nova.compute.manager [req-a7692f03-433c-4f5a-876f-b7f178c3f05b req-4c6e6765-ce5f-40f7-9cc8-20f0a17dce9d service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-deleted-38eab1de-142b-4f98-a91e-bea564b65757 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:39 user nova-compute[72773]: INFO nova.compute.manager [req-a7692f03-433c-4f5a-876f-b7f178c3f05b req-4c6e6765-ce5f-40f7-9cc8-20f0a17dce9d service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Neutron deleted interface 38eab1de-142b-4f98-a91e-bea564b65757; detaching it from the instance and deleting it from the info cache
Aug 16 22:29:40 user nova-compute[72773]: DEBUG nova.network.neutron [req-a7692f03-433c-4f5a-876f-b7f178c3f05b req-4c6e6765-ce5f-40f7-9cc8-20f0a17dce9d service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Updating instance_info_cache with network_info: [{"id": "a2f04ed7-213b-4297-a13d-ad99a922f878", "address": "fa:16:3e:ee:62:f5", "network": {"id": "78850332-7129-48d4-ad0f-222c6981d934", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-817612380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f04ed7-21", "ovs_interfaceid": "a2f04ed7-213b-4297-a13d-ad99a922f878", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "213a2da6-430b-4976-b5f0-a18d8494f42c", "address": "fa:16:3e:62:39:b6", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213a2da6-43", "ovs_interfaceid": "213a2da6-430b-4976-b5f0-a18d8494f42c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c27765c1-ae78-4b0b-8abf-2514be5599a4", "address": "fa:16:3e:12:84:13", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc27765c1-ae", "ovs_interfaceid": "c27765c1-ae78-4b0b-8abf-2514be5599a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f77f6c81-0377-4531-8c95-07be0a197bcc", "address": "fa:16:3e:f0:3c:4a", "network": {"id": "9e71d1ff-9a5b-4a29-ad7e-6b4da698415d", "bridge": "br-int", "label": "tempest-device-tagging-net2-584203226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f6c81-03", "ovs_interfaceid": "f77f6c81-0377-4531-8c95-07be0a197bcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:29:40 user nova-compute[72773]: DEBUG nova.compute.manager [req-a7692f03-433c-4f5a-876f-b7f178c3f05b req-4c6e6765-ce5f-40f7-9cc8-20f0a17dce9d service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Detach interface failed, port_id=38eab1de-142b-4f98-a91e-bea564b65757, reason: Instance df2acdf5-7c83-4129-8cab-da9882e1ac69 could not be found. {{(pid=72773) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 22:29:40 user nova-compute[72773]: DEBUG nova.compute.manager [req-a7692f03-433c-4f5a-876f-b7f178c3f05b req-4c6e6765-ce5f-40f7-9cc8-20f0a17dce9d service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-deleted-a2f04ed7-213b-4297-a13d-ad99a922f878 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:40 user nova-compute[72773]: INFO nova.compute.manager [req-a7692f03-433c-4f5a-876f-b7f178c3f05b req-4c6e6765-ce5f-40f7-9cc8-20f0a17dce9d service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Neutron deleted interface a2f04ed7-213b-4297-a13d-ad99a922f878; detaching it from the instance and deleting it from the info cache
Aug 16 22:29:40 user nova-compute[72773]: DEBUG nova.network.neutron [req-a7692f03-433c-4f5a-876f-b7f178c3f05b req-4c6e6765-ce5f-40f7-9cc8-20f0a17dce9d service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Updating instance_info_cache with network_info: [{"id": "213a2da6-430b-4976-b5f0-a18d8494f42c", "address": "fa:16:3e:62:39:b6", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap213a2da6-43", "ovs_interfaceid": "213a2da6-430b-4976-b5f0-a18d8494f42c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c27765c1-ae78-4b0b-8abf-2514be5599a4", "address": "fa:16:3e:12:84:13", "network": {"id": "a1b6b61b-14d3-4ca3-bfc5-2038c7dc2727", "bridge": "br-int", "label": "tempest-device-tagging-net1-723435094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc27765c1-ae", "ovs_interfaceid": "c27765c1-ae78-4b0b-8abf-2514be5599a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f77f6c81-0377-4531-8c95-07be0a197bcc", "address": "fa:16:3e:f0:3c:4a", "network": {"id": "9e71d1ff-9a5b-4a29-ad7e-6b4da698415d", "bridge": "br-int", "label": "tempest-device-tagging-net2-584203226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "07a1fa6998aa4972a3335aa78398e667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f6c81-03", "ovs_interfaceid": "f77f6c81-0377-4531-8c95-07be0a197bcc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:29:40 user nova-compute[72773]: DEBUG nova.compute.manager [req-a7692f03-433c-4f5a-876f-b7f178c3f05b req-4c6e6765-ce5f-40f7-9cc8-20f0a17dce9d service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Detach interface failed, port_id=a2f04ed7-213b-4297-a13d-ad99a922f878, reason: Instance df2acdf5-7c83-4129-8cab-da9882e1ac69 could not be found. {{(pid=72773) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 22:29:40 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:29:40 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Took 5.45 seconds to deallocate network for instance.
Aug 16 22:29:40 user nova-compute[72773]: DEBUG nova.compute.manager [req-40bc931b-7326-4836-b3ea-c116f92dbdc7 req-956b53b8-54a5-4f80-ac68-aa05bcdbbb16 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-changed-4188d812-137b-448e-acb1-42dea2d8eb91 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:40 user nova-compute[72773]: DEBUG nova.compute.manager [req-40bc931b-7326-4836-b3ea-c116f92dbdc7 req-956b53b8-54a5-4f80-ac68-aa05bcdbbb16 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Refreshing instance network info cache due to event network-changed-4188d812-137b-448e-acb1-42dea2d8eb91. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:29:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-40bc931b-7326-4836-b3ea-c116f92dbdc7 req-956b53b8-54a5-4f80-ac68-aa05bcdbbb16 service nova] Acquiring lock "refresh_cache-5aa5adad-599d-424f-bbfc-7d87ead31b57" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:29:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-40bc931b-7326-4836-b3ea-c116f92dbdc7 req-956b53b8-54a5-4f80-ac68-aa05bcdbbb16 service nova] Acquired lock "refresh_cache-5aa5adad-599d-424f-bbfc-7d87ead31b57" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:29:40 user nova-compute[72773]: DEBUG nova.network.neutron [req-40bc931b-7326-4836-b3ea-c116f92dbdc7 req-956b53b8-54a5-4f80-ac68-aa05bcdbbb16 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Refreshing network info cache for port 4188d812-137b-448e-acb1-42dea2d8eb91 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:29:40 user nova-compute[72773]: DEBUG nova.network.neutron [req-40bc931b-7326-4836-b3ea-c116f92dbdc7 req-956b53b8-54a5-4f80-ac68-aa05bcdbbb16 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:29:40 user nova-compute[72773]: DEBUG nova.network.neutron [req-40bc931b-7326-4836-b3ea-c116f92dbdc7 req-956b53b8-54a5-4f80-ac68-aa05bcdbbb16 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:29:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-40bc931b-7326-4836-b3ea-c116f92dbdc7 req-956b53b8-54a5-4f80-ac68-aa05bcdbbb16 service nova] Releasing lock "refresh_cache-5aa5adad-599d-424f-bbfc-7d87ead31b57" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:29:40 user nova-compute[72773]: INFO nova.compute.manager [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Rescuing
Aug 16 22:29:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "refresh_cache-030d076d-5099-4236-ae31-6025017eb51e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:29:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquired lock "refresh_cache-030d076d-5099-4236-ae31-6025017eb51e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:29:40 user nova-compute[72773]: DEBUG nova.network.neutron [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:29:41 user nova-compute[72773]: DEBUG nova.network.neutron [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Successfully updated port: 2dc74ea7-4f01-465f-8e7a-f5b4299ace47 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:29:41 user nova-compute[72773]: DEBUG nova.network.neutron [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Updating instance_info_cache with network_info: [{"id": "bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c", "address": "fa:16:3e:27:b6:2b", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc3b07d-2b", "ovs_interfaceid": "bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:29:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Releasing lock "refresh_cache-030d076d-5099-4236-ae31-6025017eb51e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:29:41 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:41 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:41 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:42 user nova-compute[72773]: DEBUG nova.compute.manager [req-a275633a-471a-4197-a356-4f33c9e418fd req-058aa833-c48e-476a-9bb4-2958aa0a5332 service nova] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Received event network-vif-deleted-f77f6c81-0377-4531-8c95-07be0a197bcc {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:42 user nova-compute[72773]: DEBUG nova.network.neutron [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Successfully updated port: 2581ab2b-5a7c-4c9a-8f59-f3c5a7228044 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:29:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:42 user nova-compute[72773]: DEBUG nova.compute.manager [req-d30ed638-de1a-4681-8da0-ed6a421ba663 req-1db46fde-25dc-4a11-a926-e77a40902b0f service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-changed-2dc74ea7-4f01-465f-8e7a-f5b4299ace47 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:42 user nova-compute[72773]: DEBUG nova.compute.manager [req-d30ed638-de1a-4681-8da0-ed6a421ba663 req-1db46fde-25dc-4a11-a926-e77a40902b0f service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Refreshing instance network info cache due to event network-changed-2dc74ea7-4f01-465f-8e7a-f5b4299ace47. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:29:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d30ed638-de1a-4681-8da0-ed6a421ba663 req-1db46fde-25dc-4a11-a926-e77a40902b0f service nova] Acquiring lock "refresh_cache-5aa5adad-599d-424f-bbfc-7d87ead31b57" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:29:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d30ed638-de1a-4681-8da0-ed6a421ba663 req-1db46fde-25dc-4a11-a926-e77a40902b0f service nova] Acquired lock "refresh_cache-5aa5adad-599d-424f-bbfc-7d87ead31b57" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:29:42 user nova-compute[72773]: DEBUG nova.network.neutron [req-d30ed638-de1a-4681-8da0-ed6a421ba663 req-1db46fde-25dc-4a11-a926-e77a40902b0f service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Refreshing network info cache for port 2dc74ea7-4f01-465f-8e7a-f5b4299ace47 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:29:42 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Instance destroyed successfully.
Aug 16 22:29:42 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Attempting a stable device rescue
Aug 16 22:29:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72773) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 22:29:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Instance directory exists: not creating {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 22:29:42 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Creating image(s)
Aug 16 22:29:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "/opt/stack/data/nova/instances/030d076d-5099-4236-ae31-6025017eb51e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "/opt/stack/data/nova/instances/030d076d-5099-4236-ae31-6025017eb51e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "/opt/stack/data/nova/instances/030d076d-5099-4236-ae31-6025017eb51e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:42 user nova-compute[72773]: DEBUG nova.objects.instance [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lazy-loading 'trusted_certs' on Instance uuid 030d076d-5099-4236-ae31-6025017eb51e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:29:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "d12b9dea1355878c9993ea3318dabe2f1b626dbe" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "d12b9dea1355878c9993ea3318dabe2f1b626dbe" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:42 user nova-compute[72773]: DEBUG nova.network.neutron [req-d30ed638-de1a-4681-8da0-ed6a421ba663 req-1db46fde-25dc-4a11-a926-e77a40902b0f service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:29:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d12b9dea1355878c9993ea3318dabe2f1b626dbe.part --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:43 user nova-compute[72773]: DEBUG nova.network.neutron [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Successfully updated port: 464fb40c-7053-464f-b788-d285f283fb56 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:29:43 user nova-compute[72773]: INFO nova.compute.manager [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Took 3.70 seconds to detach 3 volumes for instance.
Aug 16 22:29:43 user nova-compute[72773]: DEBUG nova.network.neutron [req-d30ed638-de1a-4681-8da0-ed6a421ba663 req-1db46fde-25dc-4a11-a926-e77a40902b0f service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:29:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d30ed638-de1a-4681-8da0-ed6a421ba663 req-1db46fde-25dc-4a11-a926-e77a40902b0f service nova] Releasing lock "refresh_cache-5aa5adad-599d-424f-bbfc-7d87ead31b57" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:29:43 user nova-compute[72773]: DEBUG nova.compute.manager [req-d30ed638-de1a-4681-8da0-ed6a421ba663 req-1db46fde-25dc-4a11-a926-e77a40902b0f service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-changed-2581ab2b-5a7c-4c9a-8f59-f3c5a7228044 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:43 user nova-compute[72773]: DEBUG nova.compute.manager [req-d30ed638-de1a-4681-8da0-ed6a421ba663 req-1db46fde-25dc-4a11-a926-e77a40902b0f service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Refreshing instance network info cache due to event network-changed-2581ab2b-5a7c-4c9a-8f59-f3c5a7228044. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:29:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d30ed638-de1a-4681-8da0-ed6a421ba663 req-1db46fde-25dc-4a11-a926-e77a40902b0f service nova] Acquiring lock "refresh_cache-5aa5adad-599d-424f-bbfc-7d87ead31b57" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:29:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d30ed638-de1a-4681-8da0-ed6a421ba663 req-1db46fde-25dc-4a11-a926-e77a40902b0f service nova] Acquired lock "refresh_cache-5aa5adad-599d-424f-bbfc-7d87ead31b57" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:29:43 user nova-compute[72773]: DEBUG nova.network.neutron [req-d30ed638-de1a-4681-8da0-ed6a421ba663 req-1db46fde-25dc-4a11-a926-e77a40902b0f service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Refreshing network info cache for port 2581ab2b-5a7c-4c9a-8f59-f3c5a7228044 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:29:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d12b9dea1355878c9993ea3318dabe2f1b626dbe.part --force-share --output=json" returned: 0 in 0.295s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:43 user nova-compute[72773]: DEBUG nova.virt.images [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] 3c864de6-a6c4-4cf9-b0fd-4cfd6f22882f was qcow2, converting to raw {{(pid=72773) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 22:29:43 user nova-compute[72773]: DEBUG nova.privsep.utils [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72773) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 22:29:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d12b9dea1355878c9993ea3318dabe2f1b626dbe.part /opt/stack/data/nova/instances/_base/d12b9dea1355878c9993ea3318dabe2f1b626dbe.converted {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.compute.manager [req-ff9f3110-7807-4bdd-b2d3-9de4230fc26c req-a5ab8fa4-47e7-4954-80c2-47e1e1e117f5 service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Received event network-vif-unplugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ff9f3110-7807-4bdd-b2d3-9de4230fc26c req-a5ab8fa4-47e7-4954-80c2-47e1e1e117f5 service nova] Acquiring lock "030d076d-5099-4236-ae31-6025017eb51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ff9f3110-7807-4bdd-b2d3-9de4230fc26c req-a5ab8fa4-47e7-4954-80c2-47e1e1e117f5 service nova] Lock "030d076d-5099-4236-ae31-6025017eb51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ff9f3110-7807-4bdd-b2d3-9de4230fc26c req-a5ab8fa4-47e7-4954-80c2-47e1e1e117f5 service nova] Lock "030d076d-5099-4236-ae31-6025017eb51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.compute.manager [req-ff9f3110-7807-4bdd-b2d3-9de4230fc26c req-a5ab8fa4-47e7-4954-80c2-47e1e1e117f5 service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] No waiting events found dispatching network-vif-unplugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:29:44 user nova-compute[72773]: WARNING nova.compute.manager [req-ff9f3110-7807-4bdd-b2d3-9de4230fc26c req-a5ab8fa4-47e7-4954-80c2-47e1e1e117f5 service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Received unexpected event network-vif-unplugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c for instance with vm_state active and task_state rescuing.
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.compute.manager [req-ff9f3110-7807-4bdd-b2d3-9de4230fc26c req-a5ab8fa4-47e7-4954-80c2-47e1e1e117f5 service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Received event network-vif-plugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ff9f3110-7807-4bdd-b2d3-9de4230fc26c req-a5ab8fa4-47e7-4954-80c2-47e1e1e117f5 service nova] Acquiring lock "030d076d-5099-4236-ae31-6025017eb51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ff9f3110-7807-4bdd-b2d3-9de4230fc26c req-a5ab8fa4-47e7-4954-80c2-47e1e1e117f5 service nova] Lock "030d076d-5099-4236-ae31-6025017eb51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ff9f3110-7807-4bdd-b2d3-9de4230fc26c req-a5ab8fa4-47e7-4954-80c2-47e1e1e117f5 service nova] Lock "030d076d-5099-4236-ae31-6025017eb51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.compute.manager [req-ff9f3110-7807-4bdd-b2d3-9de4230fc26c req-a5ab8fa4-47e7-4954-80c2-47e1e1e117f5 service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] No waiting events found dispatching network-vif-plugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:29:44 user nova-compute[72773]: WARNING nova.compute.manager [req-ff9f3110-7807-4bdd-b2d3-9de4230fc26c req-a5ab8fa4-47e7-4954-80c2-47e1e1e117f5 service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Received unexpected event network-vif-plugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c for instance with vm_state active and task_state rescuing.
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.network.neutron [req-d30ed638-de1a-4681-8da0-ed6a421ba663 req-1db46fde-25dc-4a11-a926-e77a40902b0f service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d12b9dea1355878c9993ea3318dabe2f1b626dbe.part /opt/stack/data/nova/instances/_base/d12b9dea1355878c9993ea3318dabe2f1b626dbe.converted" returned: 0 in 0.231s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d12b9dea1355878c9993ea3318dabe2f1b626dbe.converted --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d12b9dea1355878c9993ea3318dabe2f1b626dbe.converted --force-share --output=json" returned: 0 in 0.211s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "d12b9dea1355878c9993ea3318dabe2f1b626dbe" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.854s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "d12b9dea1355878c9993ea3318dabe2f1b626dbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "d12b9dea1355878c9993ea3318dabe2f1b626dbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d12b9dea1355878c9993ea3318dabe2f1b626dbe --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.compute.manager [req-1630e015-7064-4eaa-8380-532835fcf1b1 req-f4db3032-1e54-460c-9355-f8819ef24102 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-changed-464fb40c-7053-464f-b788-d285f283fb56 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.compute.manager [req-1630e015-7064-4eaa-8380-532835fcf1b1 req-f4db3032-1e54-460c-9355-f8819ef24102 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Refreshing instance network info cache due to event network-changed-464fb40c-7053-464f-b788-d285f283fb56. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-1630e015-7064-4eaa-8380-532835fcf1b1 req-f4db3032-1e54-460c-9355-f8819ef24102 service nova] Acquiring lock "refresh_cache-5aa5adad-599d-424f-bbfc-7d87ead31b57" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.network.neutron [req-d30ed638-de1a-4681-8da0-ed6a421ba663 req-1db46fde-25dc-4a11-a926-e77a40902b0f service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d30ed638-de1a-4681-8da0-ed6a421ba663 req-1db46fde-25dc-4a11-a926-e77a40902b0f service nova] Releasing lock "refresh_cache-5aa5adad-599d-424f-bbfc-7d87ead31b57" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-1630e015-7064-4eaa-8380-532835fcf1b1 req-f4db3032-1e54-460c-9355-f8819ef24102 service nova] Acquired lock "refresh_cache-5aa5adad-599d-424f-bbfc-7d87ead31b57" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.network.neutron [req-1630e015-7064-4eaa-8380-532835fcf1b1 req-f4db3032-1e54-460c-9355-f8819ef24102 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Refreshing network info cache for port 464fb40c-7053-464f-b788-d285f283fb56 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d12b9dea1355878c9993ea3318dabe2f1b626dbe --force-share --output=json" returned: 0 in 0.227s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d12b9dea1355878c9993ea3318dabe2f1b626dbe,backing_fmt=raw /opt/stack/data/nova/instances/030d076d-5099-4236-ae31-6025017eb51e/disk.rescue {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.network.neutron [req-1630e015-7064-4eaa-8380-532835fcf1b1 req-f4db3032-1e54-460c-9355-f8819ef24102 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d12b9dea1355878c9993ea3318dabe2f1b626dbe,backing_fmt=raw /opt/stack/data/nova/instances/030d076d-5099-4236-ae31-6025017eb51e/disk.rescue" returned: 0 in 0.079s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "d12b9dea1355878c9993ea3318dabe2f1b626dbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.objects.instance [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lazy-loading 'migration_context' on Instance uuid 030d076d-5099-4236-ae31-6025017eb51e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.network.neutron [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Successfully updated port: 44f58154-ceae-45ef-a169-0681e0e9a3fb {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Start _get_guest_xml network_info=[{"id": "bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c", "address": "fa:16:3e:27:b6:2b", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "vif_mac": "fa:16:3e:27:b6:2b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc3b07d-2b", "ovs_interfaceid": "bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3c864de6-a6c4-4cf9-b0fd-4cfd6f22882f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '75c59d5c-72e4-480c-908e-188afb9f4b3b', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GWPeHDmK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '030d076d-5099-4236-ae31-6025017eb51e', 'attached_at': '', 'detached_at': '', 'volume_id': 'e1b2bca5-6794-44b5-ae2b-66771ff9d706', 'serial': 'e1b2bca5-6794-44b5-ae2b-66771ff9d706'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.objects.instance [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lazy-loading 'resources' on Instance uuid 030d076d-5099-4236-ae31-6025017eb51e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.845s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.objects.instance [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lazy-loading 'numa_topology' on Instance uuid 030d076d-5099-4236-ae31-6025017eb51e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:29:44 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:29:44 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:29:44 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Deleted allocations for instance df2acdf5-7c83-4129-8cab-da9882e1ac69
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.objects.instance [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lazy-loading 'vcpu_model' on Instance uuid 030d076d-5099-4236-ae31-6025017eb51e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GWPeHDmK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:29:44 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:29:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:29:44 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:29:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:29:44 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:29:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-839bef2a-90f3-4697-bda2-f3f3bfa4a40e tempest-TaggedBootDevicesTest-186566092 tempest-TaggedBootDevicesTest-186566092-project-member] Lock "df2acdf5-7c83-4129-8cab-da9882e1ac69" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.118s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 -p 172.16.0.220:3260" returned: 0 in 0.036s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0893b437-ddbd-494e-98d2-674ccd6f1cf4]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = GWPeHDmK\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 16 22:29:44 user nova-compute[72773]: node.name = iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706
Aug 16 22:29:44 user nova-compute[72773]: node.tpgt = -1
Aug 16 22:29:44 user nova-compute[72773]: node.startup = automatic
Aug 16 22:29:44 user nova-compute[72773]: node.leading_login = No
Aug 16 22:29:44 user nova-compute[72773]: iface.iscsi_ifacename = default
Aug 16 22:29:44 user nova-compute[72773]: iface.net_ifacename = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.ipaddress = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.prefix_len = 0
Aug 16 22:29:44 user nova-compute[72773]: iface.hwaddress = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.transport_name = tcp
Aug 16 22:29:44 user nova-compute[72773]: iface.initiatorname = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.state = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.vlan_id = 0
Aug 16 22:29:44 user nova-compute[72773]: iface.vlan_priority = 0
Aug 16 22:29:44 user nova-compute[72773]: iface.vlan_state = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.iface_num = 0
Aug 16 22:29:44 user nova-compute[72773]: iface.mtu = 0
Aug 16 22:29:44 user nova-compute[72773]: iface.port = 0
Aug 16 22:29:44 user nova-compute[72773]: iface.bootproto = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.subnet_mask = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.gateway = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.dhcp_alt_client_id_state = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.dhcp_alt_client_id = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.dhcp_dns = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.dhcp_learn_iqn = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.dhcp_req_vendor_id_state = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.dhcp_vendor_id_state = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.dhcp_vendor_id = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.dhcp_slp_da = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.fragmentation = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.gratuitous_arp = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.incoming_forwarding = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.tos_state = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.tos = 0
Aug 16 22:29:44 user nova-compute[72773]: iface.ttl = 0
Aug 16 22:29:44 user nova-compute[72773]: iface.delayed_ack = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.tcp_nagle = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.tcp_wsf_state = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.tcp_wsf = 0
Aug 16 22:29:44 user nova-compute[72773]: iface.tcp_timer_scale = 0
Aug 16 22:29:44 user nova-compute[72773]: iface.tcp_timestamp = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.redirect = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.def_task_mgmt_timeout = 0
Aug 16 22:29:44 user nova-compute[72773]: iface.header_digest = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.data_digest = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.immediate_data = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.initial_r2t = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.data_seq_inorder = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.data_pdu_inorder = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.erl = 0
Aug 16 22:29:44 user nova-compute[72773]: iface.max_receive_data_len = 0
Aug 16 22:29:44 user nova-compute[72773]: iface.first_burst_len = 0
Aug 16 22:29:44 user nova-compute[72773]: iface.max_outstanding_r2t = 0
Aug 16 22:29:44 user nova-compute[72773]: iface.max_burst_len = 0
Aug 16 22:29:44 user nova-compute[72773]: iface.chap_auth = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.bidi_chap = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.strict_login_compliance = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.discovery_auth = <empty>
Aug 16 22:29:44 user nova-compute[72773]: iface.discovery_logout = <empty>
Aug 16 22:29:44 user nova-compute[72773]: node.discovery_address = <empty>
Aug 16 22:29:44 user nova-compute[72773]: node.discovery_port = 0
Aug 16 22:29:44 user nova-compute[72773]: node.discovery_type = static
Aug 16 22:29:44 user nova-compute[72773]: node.session.initial_cmdsn = 0
Aug 16 22:29:44 user nova-compute[72773]: node.session.initial_login_retry_max = 8
Aug 16 22:29:44 user nova-compute[72773]: node.session.xmit_thread_priority = -20
Aug 16 22:29:44 user nova-compute[72773]: node.session.cmds_max = 128
Aug 16 22:29:44 user nova-compute[72773]: node.session.queue_depth = 32
Aug 16 22:29:44 user nova-compute[72773]: node.session.nr_sessions = 1
Aug 16 22:29:44 user nova-compute[72773]: node.session.auth.authmethod = CHAP
Aug 16 22:29:44 user nova-compute[72773]: node.session.auth.username = GWPeHDmK
Aug 16 22:29:44 user nova-compute[72773]: node.session.auth.password = ***
Aug 16 22:29:44 user nova-compute[72773]: node.session.auth.username_in = <empty>
Aug 16 22:29:44 user nova-compute[72773]: node.session.auth.password_in = <empty>
Aug 16 22:29:44 user nova-compute[72773]: node.session.auth.chap_algs = MD5
Aug 16 22:29:44 user nova-compute[72773]: node.session.timeo.replacement_timeout = 120
Aug 16 22:29:44 user nova-compute[72773]: node.session.err_timeo.abort_timeout = 15
Aug 16 22:29:44 user nova-compute[72773]: node.session.err_timeo.lu_reset_timeout = 30
Aug 16 22:29:44 user nova-compute[72773]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 16 22:29:44 user nova-compute[72773]: node.session.err_timeo.host_reset_timeout = 60
Aug 16 22:29:44 user nova-compute[72773]: node.session.iscsi.FastAbort = Yes
Aug 16 22:29:44 user nova-compute[72773]: node.session.iscsi.InitialR2T = No
Aug 16 22:29:44 user nova-compute[72773]: node.session.iscsi.ImmediateData = Yes
Aug 16 22:29:44 user nova-compute[72773]: node.session.iscsi.FirstBurstLength = 262144
Aug 16 22:29:44 user nova-compute[72773]: node.session.iscsi.MaxBurstLength = 16776192
Aug 16 22:29:44 user nova-compute[72773]: node.session.iscsi.DefaultTime2Retain = 0
Aug 16 22:29:44 user nova-compute[72773]: node.session.iscsi.DefaultTime2Wait = 2
Aug 16 22:29:44 user nova-compute[72773]: node.session.iscsi.MaxConnections = 1
Aug 16 22:29:44 user nova-compute[72773]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 16 22:29:44 user nova-compute[72773]: node.session.iscsi.ERL = 0
Aug 16 22:29:44 user nova-compute[72773]: node.session.scan = manual
Aug 16 22:29:44 user nova-compute[72773]: node.session.reopen_max = 0
Aug 16 22:29:44 user nova-compute[72773]: node.conn[0].address = 172.16.0.220
Aug 16 22:29:44 user nova-compute[72773]: node.conn[0].port = 3260
Aug 16 22:29:44 user nova-compute[72773]: node.conn[0].startup = manual
Aug 16 22:29:44 user nova-compute[72773]: node.conn[0].tcp.window_size = 524288
Aug 16 22:29:44 user nova-compute[72773]: node.conn[0].tcp.type_of_service = 0
Aug 16 22:29:44 user nova-compute[72773]: node.conn[0].timeo.logout_timeout = 15
Aug 16 22:29:44 user nova-compute[72773]: node.conn[0].timeo.login_timeout = 15
Aug 16 22:29:44 user nova-compute[72773]: node.conn[0].timeo.auth_timeout = 45
Aug 16 22:29:44 user nova-compute[72773]: node.conn[0].timeo.noop_out_interval = 5
Aug 16 22:29:44 user nova-compute[72773]: node.conn[0].timeo.noop_out_timeout = 5
Aug 16 22:29:44 user nova-compute[72773]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 16 22:29:44 user nova-compute[72773]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 16 22:29:44 user nova-compute[72773]: node.conn[0].iscsi.HeaderDigest = None
Aug 16 22:29:44 user nova-compute[72773]: node.conn[0].iscsi.DataDigest = None
Aug 16 22:29:44 user nova-compute[72773]: node.conn[0].iscsi.IFMarker = No
Aug 16 22:29:44 user nova-compute[72773]: node.conn[0].iscsi.OFMarker = No
Aug 16 22:29:44 user nova-compute[72773]: # END RECORD
Aug 16 22:29:44 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadd5148-1e34-4b2b-9804-2f129e4a1ef7]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b44a6a-0f67-4a8e-9fd8-8db2e6e889a3]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GWPeHDmK {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GWPeHDmK" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[248f3e8d-11c3-4d5f-9671-3f0fd36d43d1]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GWPeHDmK'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d192cef-35bd-4570-8ae5-91b28116e782]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5d611a-5dd7-4667-8576-f216e43eb471]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:29:45 user nova-compute[72773]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:29:45 user nova-compute[72773]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 (non-flash)
Aug 16 22:29:45 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:29:45 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:29:45 user nova-compute[72773]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:29:45 user nova-compute[72773]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 (non-flash)
Aug 16 22:29:45 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:29:45 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.181s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] HCTL ('33', '0', '0', 0) found on session 12 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ea0cf6-6896-4d7f-9fec-8d9d6c886a43]: (4, ('0 0 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Searching for a device in session 12 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GWPeHDmK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.206s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] <== connect_volume: return (208ms) {'type': 'block', 'scsi_wwn': '23739346336616231', 'path': '/dev/sdb'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739346336616231', 'path': '/dev/sdb'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:27:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-481632116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-481632116',id=12,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:28:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f496354017e467e9b7a537c73248fe2',ramdisk_id='',reservation_id='r-1jyekcam',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648946443',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:28:34Z,user_data=None,user_id='42e8c8d0806e45ed9d1126aad24a034b',uuid=030d076d-5099-4236-ae31-6025017eb51e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c", "address": "fa:16:3e:27:b6:2b", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "vif_mac": "fa:16:3e:27:b6:2b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc3b07d-2b", "ovs_interfaceid": "bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Converting VIF {"id": "bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c", "address": "fa:16:3e:27:b6:2b", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "vif_mac": "fa:16:3e:27:b6:2b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc3b07d-2b", "ovs_interfaceid": "bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:b6:2b,bridge_name='br-int',has_traffic_filtering=True,id=bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c,network=Network(0a6ec813-28f9-4716-bf41-20722c69fe20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc3b07d-2b') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG nova.objects.instance [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lazy-loading 'pci_devices' on Instance uuid 030d076d-5099-4236-ae31-6025017eb51e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:29:45 user nova-compute[72773]:   <uuid>030d076d-5099-4236-ae31-6025017eb51e</uuid>
Aug 16 22:29:45 user nova-compute[72773]:   <name>instance-0000000c</name>
Aug 16 22:29:45 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:29:45 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:29:45 user nova-compute[72773]:   <metadata>
Aug 16 22:29:45 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:29:45 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:29:45 user nova-compute[72773]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-481632116</nova:name>
Aug 16 22:29:45 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:29:44</nova:creationTime>
Aug 16 22:29:45 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:29:45 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:29:45 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:29:45 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:29:45 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:29:45 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:29:45 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:29:45 user nova-compute[72773]:       <nova:owner>
Aug 16 22:29:45 user nova-compute[72773]:         <nova:user uuid="42e8c8d0806e45ed9d1126aad24a034b">tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member</nova:user>
Aug 16 22:29:45 user nova-compute[72773]:         <nova:project uuid="4f496354017e467e9b7a537c73248fe2">tempest-ServerBootFromVolumeStableRescueTest-1648946443</nova:project>
Aug 16 22:29:45 user nova-compute[72773]:       </nova:owner>
Aug 16 22:29:45 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:29:45 user nova-compute[72773]:       <nova:ports>
Aug 16 22:29:45 user nova-compute[72773]:         <nova:port uuid="bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c">
Aug 16 22:29:45 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 22:29:45 user nova-compute[72773]:         </nova:port>
Aug 16 22:29:45 user nova-compute[72773]:       </nova:ports>
Aug 16 22:29:45 user nova-compute[72773]:     </nova:instance>
Aug 16 22:29:45 user nova-compute[72773]:   </metadata>
Aug 16 22:29:45 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:29:45 user nova-compute[72773]:     <system>
Aug 16 22:29:45 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:29:45 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:29:45 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:29:45 user nova-compute[72773]:       <entry name="serial">030d076d-5099-4236-ae31-6025017eb51e</entry>
Aug 16 22:29:45 user nova-compute[72773]:       <entry name="uuid">030d076d-5099-4236-ae31-6025017eb51e</entry>
Aug 16 22:29:45 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:29:45 user nova-compute[72773]:     </system>
Aug 16 22:29:45 user nova-compute[72773]:   </sysinfo>
Aug 16 22:29:45 user nova-compute[72773]:   <os>
Aug 16 22:29:45 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:29:45 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:29:45 user nova-compute[72773]:   </os>
Aug 16 22:29:45 user nova-compute[72773]:   <features>
Aug 16 22:29:45 user nova-compute[72773]:     <acpi/>
Aug 16 22:29:45 user nova-compute[72773]:     <apic/>
Aug 16 22:29:45 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:29:45 user nova-compute[72773]:   </features>
Aug 16 22:29:45 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:29:45 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:29:45 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:29:45 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:29:45 user nova-compute[72773]:   </clock>
Aug 16 22:29:45 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:29:45 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:29:45 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:29:45 user nova-compute[72773]:   </cpu>
Aug 16 22:29:45 user nova-compute[72773]:   <devices>
Aug 16 22:29:45 user nova-compute[72773]:     <disk type="block" device="disk">
Aug 16 22:29:45 user nova-compute[72773]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:29:45 user nova-compute[72773]:       <source dev="/dev/sdb"/>
Aug 16 22:29:45 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:29:45 user nova-compute[72773]:       <serial>e1b2bca5-6794-44b5-ae2b-66771ff9d706</serial>
Aug 16 22:29:45 user nova-compute[72773]:     </disk>
Aug 16 22:29:45 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:29:45 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:29:45 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/030d076d-5099-4236-ae31-6025017eb51e/disk.rescue"/>
Aug 16 22:29:45 user nova-compute[72773]:       <target dev="vdb" bus="virtio"/>
Aug 16 22:29:45 user nova-compute[72773]:       <boot order="1"/>
Aug 16 22:29:45 user nova-compute[72773]:     </disk>
Aug 16 22:29:45 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:29:45 user nova-compute[72773]:       <mac address="fa:16:3e:27:b6:2b"/>
Aug 16 22:29:45 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:29:45 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:29:45 user nova-compute[72773]:       <target dev="tapbdc3b07d-2b"/>
Aug 16 22:29:45 user nova-compute[72773]:     </interface>
Aug 16 22:29:45 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:29:45 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/030d076d-5099-4236-ae31-6025017eb51e/console.log" append="off"/>
Aug 16 22:29:45 user nova-compute[72773]:     </serial>
Aug 16 22:29:45 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:29:45 user nova-compute[72773]:     <video>
Aug 16 22:29:45 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:29:45 user nova-compute[72773]:     </video>
Aug 16 22:29:45 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:29:45 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:29:45 user nova-compute[72773]:     </rng>
Aug 16 22:29:45 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:29:45 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:29:45 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:29:45 user nova-compute[72773]:     </memballoon>
Aug 16 22:29:45 user nova-compute[72773]:   </devices>
Aug 16 22:29:45 user nova-compute[72773]: </domain>
Aug 16 22:29:45 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:29:45 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Instance destroyed successfully.
Aug 16 22:29:45 user nova-compute[72773]: DEBUG nova.network.neutron [req-1630e015-7064-4eaa-8380-532835fcf1b1 req-f4db3032-1e54-460c-9355-f8819ef24102 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] No VIF found with MAC fa:16:3e:27:b6:2b, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-1630e015-7064-4eaa-8380-532835fcf1b1 req-f4db3032-1e54-460c-9355-f8819ef24102 service nova] Releasing lock "refresh_cache-5aa5adad-599d-424f-bbfc-7d87ead31b57" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG nova.network.neutron [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Successfully updated port: 0230e8bd-c876-4793-96f6-9ccc72deaa73 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Acquiring lock "refresh_cache-5aa5adad-599d-424f-bbfc-7d87ead31b57" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Acquired lock "refresh_cache-5aa5adad-599d-424f-bbfc-7d87ead31b57" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:29:45 user nova-compute[72773]: DEBUG nova.network.neutron [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:29:46 user nova-compute[72773]: DEBUG nova.network.neutron [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:29:46 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:29:46 user nova-compute[72773]: DEBUG nova.compute.manager [req-2ac1a614-dd30-4f16-960f-2f4219c71adb req-19d23ba9-be67-4ad7-9fcc-87cea2c2e182 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-changed-44f58154-ceae-45ef-a169-0681e0e9a3fb {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:46 user nova-compute[72773]: DEBUG nova.compute.manager [req-2ac1a614-dd30-4f16-960f-2f4219c71adb req-19d23ba9-be67-4ad7-9fcc-87cea2c2e182 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Refreshing instance network info cache due to event network-changed-44f58154-ceae-45ef-a169-0681e0e9a3fb. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:29:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2ac1a614-dd30-4f16-960f-2f4219c71adb req-19d23ba9-be67-4ad7-9fcc-87cea2c2e182 service nova] Acquiring lock "refresh_cache-5aa5adad-599d-424f-bbfc-7d87ead31b57" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:29:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:47 user nova-compute[72773]: DEBUG nova.compute.manager [req-6797f27a-ae22-4d6a-bb73-373405bba8b1 req-08ce61e5-ead8-43c1-b0d6-2257bdc9a18b service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Received event network-vif-plugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6797f27a-ae22-4d6a-bb73-373405bba8b1 req-08ce61e5-ead8-43c1-b0d6-2257bdc9a18b service nova] Acquiring lock "030d076d-5099-4236-ae31-6025017eb51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6797f27a-ae22-4d6a-bb73-373405bba8b1 req-08ce61e5-ead8-43c1-b0d6-2257bdc9a18b service nova] Lock "030d076d-5099-4236-ae31-6025017eb51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6797f27a-ae22-4d6a-bb73-373405bba8b1 req-08ce61e5-ead8-43c1-b0d6-2257bdc9a18b service nova] Lock "030d076d-5099-4236-ae31-6025017eb51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:47 user nova-compute[72773]: DEBUG nova.compute.manager [req-6797f27a-ae22-4d6a-bb73-373405bba8b1 req-08ce61e5-ead8-43c1-b0d6-2257bdc9a18b service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] No waiting events found dispatching network-vif-plugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:29:47 user nova-compute[72773]: WARNING nova.compute.manager [req-6797f27a-ae22-4d6a-bb73-373405bba8b1 req-08ce61e5-ead8-43c1-b0d6-2257bdc9a18b service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Received unexpected event network-vif-plugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c for instance with vm_state active and task_state rescuing.
Aug 16 22:29:47 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692224972.3146079, df2acdf5-7c83-4129-8cab-da9882e1ac69 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:29:47 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] VM Stopped (Lifecycle Event)
Aug 16 22:29:47 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a9e923f6-1d99-41a2-b247-f3e03b14b8df None None] [instance: df2acdf5-7c83-4129-8cab-da9882e1ac69] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:29:47 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:29:47 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:29:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7cccfdc9-beae-4160-adf5-d3ac161627e7 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "3cd33603-83f3-4d7f-8bed-7db4b4d67c32" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7cccfdc9-beae-4160-adf5-d3ac161627e7 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "3cd33603-83f3-4d7f-8bed-7db4b4d67c32" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7cccfdc9-beae-4160-adf5-d3ac161627e7 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "3cd33603-83f3-4d7f-8bed-7db4b4d67c32-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7cccfdc9-beae-4160-adf5-d3ac161627e7 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "3cd33603-83f3-4d7f-8bed-7db4b4d67c32-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7cccfdc9-beae-4160-adf5-d3ac161627e7 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "3cd33603-83f3-4d7f-8bed-7db4b4d67c32-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:48 user nova-compute[72773]: INFO nova.compute.manager [None req-7cccfdc9-beae-4160-adf5-d3ac161627e7 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Terminating instance
Aug 16 22:29:48 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7cccfdc9-beae-4160-adf5-d3ac161627e7 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:29:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:48 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:29:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:48 user nova-compute[72773]: DEBUG nova.compute.manager [req-1a6d8516-89d8-4ef1-8ae6-f6d0e7b65dde req-903edc88-e16a-4b56-839a-e8f99f0ee576 service nova] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Received event network-changed-29bed5bd-e561-4bfa-bdb6-76c2063ffd52 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:48 user nova-compute[72773]: DEBUG nova.compute.manager [req-1a6d8516-89d8-4ef1-8ae6-f6d0e7b65dde req-903edc88-e16a-4b56-839a-e8f99f0ee576 service nova] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Refreshing instance network info cache due to event network-changed-29bed5bd-e561-4bfa-bdb6-76c2063ffd52. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:29:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-1a6d8516-89d8-4ef1-8ae6-f6d0e7b65dde req-903edc88-e16a-4b56-839a-e8f99f0ee576 service nova] Acquiring lock "refresh_cache-3cd33603-83f3-4d7f-8bed-7db4b4d67c32" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:29:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-1a6d8516-89d8-4ef1-8ae6-f6d0e7b65dde req-903edc88-e16a-4b56-839a-e8f99f0ee576 service nova] Acquired lock "refresh_cache-3cd33603-83f3-4d7f-8bed-7db4b4d67c32" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:29:48 user nova-compute[72773]: DEBUG nova.network.neutron [req-1a6d8516-89d8-4ef1-8ae6-f6d0e7b65dde req-903edc88-e16a-4b56-839a-e8f99f0ee576 service nova] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Refreshing network info cache for port 29bed5bd-e561-4bfa-bdb6-76c2063ffd52 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:29:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:49 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Instance destroyed successfully.
Aug 16 22:29:49 user nova-compute[72773]: DEBUG nova.objects.instance [None req-7cccfdc9-beae-4160-adf5-d3ac161627e7 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lazy-loading 'resources' on Instance uuid 3cd33603-83f3-4d7f-8bed-7db4b4d67c32 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-7cccfdc9-beae-4160-adf5-d3ac161627e7 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:27:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-499787982',display_name='tempest-AttachVolumeNegativeTest-server-499787982',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-499787982',id=13,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCbNKTERiF/S4xtp3tjZL4XwGIGeREa7GsR/o8e7qYORSi/1lH0uri5dOaxrcPwQEZJl3DV94o22pKQEOOMwV1ZZbMHBT96+LfMkQC3gIjIMiOl0dBwH0nhW01TSFXXsQ==',key_name='tempest-keypair-778648690',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:28:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc49739a140d40508ea307eedceb9aaa',ramdisk_id='',reservation_id='r-89pip05e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-801754299',owner_user_name='tempest-AttachVolumeNegativeTest-801754299-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:28:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3b873f599fc4a2686c154d856bd5f06',uuid=3cd33603-83f3-4d7f-8bed-7db4b4d67c32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29bed5bd-e561-4bfa-bdb6-76c2063ffd52", "address": "fa:16:3e:0c:0c:6f", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bed5bd-e5", "ovs_interfaceid": "29bed5bd-e561-4bfa-bdb6-76c2063ffd52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-7cccfdc9-beae-4160-adf5-d3ac161627e7 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Converting VIF {"id": "29bed5bd-e561-4bfa-bdb6-76c2063ffd52", "address": "fa:16:3e:0c:0c:6f", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bed5bd-e5", "ovs_interfaceid": "29bed5bd-e561-4bfa-bdb6-76c2063ffd52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-7cccfdc9-beae-4160-adf5-d3ac161627e7 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:0c:6f,bridge_name='br-int',has_traffic_filtering=True,id=29bed5bd-e561-4bfa-bdb6-76c2063ffd52,network=Network(e0974c13-ec74-4a35-95b4-afae254c04a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29bed5bd-e5') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG os_vif [None req-7cccfdc9-beae-4160-adf5-d3ac161627e7 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:0c:6f,bridge_name='br-int',has_traffic_filtering=True,id=29bed5bd-e561-4bfa-bdb6-76c2063ffd52,network=Network(e0974c13-ec74-4a35-95b4-afae254c04a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29bed5bd-e5') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29bed5bd-e5, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:29:49 user nova-compute[72773]: INFO os_vif [None req-7cccfdc9-beae-4160-adf5-d3ac161627e7 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:0c:6f,bridge_name='br-int',has_traffic_filtering=True,id=29bed5bd-e561-4bfa-bdb6-76c2063ffd52,network=Network(e0974c13-ec74-4a35-95b4-afae254c04a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29bed5bd-e5')
Aug 16 22:29:49 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-7cccfdc9-beae-4160-adf5-d3ac161627e7 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Deleting instance files /opt/stack/data/nova/instances/3cd33603-83f3-4d7f-8bed-7db4b4d67c32_del
Aug 16 22:29:49 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-7cccfdc9-beae-4160-adf5-d3ac161627e7 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Deletion of /opt/stack/data/nova/instances/3cd33603-83f3-4d7f-8bed-7db4b4d67c32_del complete
Aug 16 22:29:49 user nova-compute[72773]: INFO nova.compute.manager [None req-7cccfdc9-beae-4160-adf5-d3ac161627e7 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 16 22:29:49 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-7cccfdc9-beae-4160-adf5-d3ac161627e7 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG nova.compute.manager [req-3b8d0990-5fe0-4804-8fa1-e9a3d38e9c93 req-d2e38ec2-38a5-46f4-991c-836b7d69cf51 service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Received event network-vif-plugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3b8d0990-5fe0-4804-8fa1-e9a3d38e9c93 req-d2e38ec2-38a5-46f4-991c-836b7d69cf51 service nova] Acquiring lock "030d076d-5099-4236-ae31-6025017eb51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3b8d0990-5fe0-4804-8fa1-e9a3d38e9c93 req-d2e38ec2-38a5-46f4-991c-836b7d69cf51 service nova] Lock "030d076d-5099-4236-ae31-6025017eb51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3b8d0990-5fe0-4804-8fa1-e9a3d38e9c93 req-d2e38ec2-38a5-46f4-991c-836b7d69cf51 service nova] Lock "030d076d-5099-4236-ae31-6025017eb51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG nova.compute.manager [req-3b8d0990-5fe0-4804-8fa1-e9a3d38e9c93 req-d2e38ec2-38a5-46f4-991c-836b7d69cf51 service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] No waiting events found dispatching network-vif-plugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:29:49 user nova-compute[72773]: WARNING nova.compute.manager [req-3b8d0990-5fe0-4804-8fa1-e9a3d38e9c93 req-d2e38ec2-38a5-46f4-991c-836b7d69cf51 service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Received unexpected event network-vif-plugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c for instance with vm_state active and task_state rescuing.
Aug 16 22:29:49 user nova-compute[72773]: DEBUG nova.compute.manager [req-3b8d0990-5fe0-4804-8fa1-e9a3d38e9c93 req-d2e38ec2-38a5-46f4-991c-836b7d69cf51 service nova] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Received event network-vif-unplugged-29bed5bd-e561-4bfa-bdb6-76c2063ffd52 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3b8d0990-5fe0-4804-8fa1-e9a3d38e9c93 req-d2e38ec2-38a5-46f4-991c-836b7d69cf51 service nova] Acquiring lock "3cd33603-83f3-4d7f-8bed-7db4b4d67c32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3b8d0990-5fe0-4804-8fa1-e9a3d38e9c93 req-d2e38ec2-38a5-46f4-991c-836b7d69cf51 service nova] Lock "3cd33603-83f3-4d7f-8bed-7db4b4d67c32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3b8d0990-5fe0-4804-8fa1-e9a3d38e9c93 req-d2e38ec2-38a5-46f4-991c-836b7d69cf51 service nova] Lock "3cd33603-83f3-4d7f-8bed-7db4b4d67c32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG nova.compute.manager [req-3b8d0990-5fe0-4804-8fa1-e9a3d38e9c93 req-d2e38ec2-38a5-46f4-991c-836b7d69cf51 service nova] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] No waiting events found dispatching network-vif-unplugged-29bed5bd-e561-4bfa-bdb6-76c2063ffd52 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG nova.compute.manager [req-3b8d0990-5fe0-4804-8fa1-e9a3d38e9c93 req-d2e38ec2-38a5-46f4-991c-836b7d69cf51 service nova] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Received event network-vif-unplugged-29bed5bd-e561-4bfa-bdb6-76c2063ffd52 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-c6adfa95-47ac-40d3-abc1-0c6027507f07" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-c6adfa95-47ac-40d3-abc1-0c6027507f07" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 22:29:49 user nova-compute[72773]: INFO nova.virt.block_device [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Booting with volume a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 at /dev/vdb
Aug 16 22:29:49 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Removed pending event for 030d076d-5099-4236-ae31-6025017eb51e due to event {{(pid=72773) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224989.6384482, 030d076d-5099-4236-ae31-6025017eb51e => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:29:49 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 030d076d-5099-4236-ae31-6025017eb51e] VM Resumed (Lifecycle Event)
Aug 16 22:29:49 user nova-compute[72773]: DEBUG nova.compute.manager [None req-19c0b6e8-1f9b-44e5-a617-a4b7a8ecd70c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:29:49 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 030d076d-5099-4236-ae31-6025017eb51e] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 22:29:49 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692224989.640373, 030d076d-5099-4236-ae31-6025017eb51e => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:29:49 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 030d076d-5099-4236-ae31-6025017eb51e] VM Started (Lifecycle Event)
Aug 16 22:29:49 user nova-compute[72773]: DEBUG nova.network.neutron [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Updating instance_info_cache with network_info: [{"id": "b47506d5-cd81-498a-8f7b-d735d0601f49", "address": "fa:16:3e:14:c3:e5", "network": {"id": "8b3d0165-9b35-42e8-bb94-f9cb7d76409d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1320393408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47506d5-cd", "ovs_interfaceid": "b47506d5-cd81-498a-8f7b-d735d0601f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4188d812-137b-448e-acb1-42dea2d8eb91", "address": "fa:16:3e:0f:fc:e8", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4188d812-13", "ovs_interfaceid": "4188d812-137b-448e-acb1-42dea2d8eb91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2dc74ea7-4f01-465f-8e7a-f5b4299ace47", "address": "fa:16:3e:cc:b0:44", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc74ea7-4f", "ovs_interfaceid": "2dc74ea7-4f01-465f-8e7a-f5b4299ace47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2581ab2b-5a7c-4c9a-8f59-f3c5a7228044", "address": "fa:16:3e:cc:9c:eb", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2581ab2b-5a", "ovs_interfaceid": "2581ab2b-5a7c-4c9a-8f59-f3c5a7228044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "464fb40c-7053-464f-b788-d285f283fb56", "address": "fa:16:3e:ce:aa:1f", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464fb40c-70", "ovs_interfaceid": "464fb40c-7053-464f-b788-d285f283fb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44f58154-ceae-45ef-a169-0681e0e9a3fb", "address": "fa:16:3e:95:7a:63", "network": {"id": "a2682c6d-c949-41e3-8efe-546921aea554", "bridge": "br-int", "label": "tempest-device-tagging-net2-870198650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44f58154-ce", "ovs_interfaceid": "44f58154-ceae-45ef-a169-0681e0e9a3fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0230e8bd-c876-4793-96f6-9ccc72deaa73", "address": "fa:16:3e:9d:92:42", "network": {"id": "a2682c6d-c949-41e3-8efe-546921aea554", "bridge": "br-int", "label": "tempest-device-tagging-net2-870198650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0230e8bd-c8", "ovs_interfaceid": "0230e8bd-c876-4793-96f6-9ccc72deaa73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Releasing lock "refresh_cache-5aa5adad-599d-424f-bbfc-7d87ead31b57" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG nova.compute.manager [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Instance network_info: |[{"id": "b47506d5-cd81-498a-8f7b-d735d0601f49", "address": "fa:16:3e:14:c3:e5", "network": {"id": "8b3d0165-9b35-42e8-bb94-f9cb7d76409d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1320393408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47506d5-cd", "ovs_interfaceid": "b47506d5-cd81-498a-8f7b-d735d0601f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4188d812-137b-448e-acb1-42dea2d8eb91", "address": "fa:16:3e:0f:fc:e8", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4188d812-13", "ovs_interfaceid": "4188d812-137b-448e-acb1-42dea2d8eb91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2dc74ea7-4f01-465f-8e7a-f5b4299ace47", "address": "fa:16:3e:cc:b0:44", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc74ea7-4f", "ovs_interfaceid": "2dc74ea7-4f01-465f-8e7a-f5b4299ace47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2581ab2b-5a7c-4c9a-8f59-f3c5a7228044", "address": "fa:16:3e:cc:9c:eb", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2581ab2b-5a", "ovs_interfaceid": "2581ab2b-5a7c-4c9a-8f59-f3c5a7228044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "464fb40c-7053-464f-b788-d285f283fb56", "address": "fa:16:3e:ce:aa:1f", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464fb40c-70", "ovs_interfaceid": "464fb40c-7053-464f-b788-d285f283fb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44f58154-ceae-45ef-a169-0681e0e9a3fb", "address": "fa:16:3e:95:7a:63", "network": {"id": "a2682c6d-c949-41e3-8efe-546921aea554", "bridge": "br-int", "label": "tempest-device-tagging-net2-870198650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44f58154-ce", "ovs_interfaceid": "44f58154-ceae-45ef-a169-0681e0e9a3fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0230e8bd-c876-4793-96f6-9ccc72deaa73", "address": "fa:16:3e:9d:92:42", "network": {"id": "a2682c6d-c949-41e3-8efe-546921aea554", "bridge": "br-int", "label": "tempest-device-tagging-net2-870198650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0230e8bd-c8", "ovs_interfaceid": "0230e8bd-c876-4793-96f6-9ccc72deaa73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2ac1a614-dd30-4f16-960f-2f4219c71adb req-19d23ba9-be67-4ad7-9fcc-87cea2c2e182 service nova] Acquired lock "refresh_cache-5aa5adad-599d-424f-bbfc-7d87ead31b57" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG nova.network.neutron [req-2ac1a614-dd30-4f16-960f-2f4219c71adb req-19d23ba9-be67-4ad7-9fcc-87cea2c2e182 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Refreshing network info cache for port 44f58154-ceae-45ef-a169-0681e0e9a3fb {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG os_brick.utils [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89d26f4-60cc-4ac2-8836-5438ee338ae0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:50 user nova-compute[72773]: DEBUG nova.network.neutron [req-1a6d8516-89d8-4ef1-8ae6-f6d0e7b65dde req-903edc88-e16a-4b56-839a-e8f99f0ee576 service nova] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Updated VIF entry in instance network info cache for port 29bed5bd-e561-4bfa-bdb6-76c2063ffd52. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:29:50 user nova-compute[72773]: DEBUG nova.network.neutron [req-1a6d8516-89d8-4ef1-8ae6-f6d0e7b65dde req-903edc88-e16a-4b56-839a-e8f99f0ee576 service nova] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Updating instance_info_cache with network_info: [{"id": "29bed5bd-e561-4bfa-bdb6-76c2063ffd52", "address": "fa:16:3e:0c:0c:6f", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29bed5bd-e5", "ovs_interfaceid": "29bed5bd-e561-4bfa-bdb6-76c2063ffd52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:29:50 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:50 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4edc5f3-f486-49f7-ab3d-f633efdef152]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:50 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-1a6d8516-89d8-4ef1-8ae6-f6d0e7b65dde req-903edc88-e16a-4b56-839a-e8f99f0ee576 service nova] Releasing lock "refresh_cache-3cd33603-83f3-4d7f-8bed-7db4b4d67c32" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:29:50 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:50 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc3f9ab-70c8-4c14-9508-b965f2b73e43]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:50 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[65261ff7-9b21-4b13-9bfc-a0eef9e46917]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:50 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:50 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:29:50 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:29:50 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:50 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:29:50 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:29:50 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[32129d2d-f605-4f6d-801f-127de4e87353]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:29:50 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:29:50 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:29:50 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:29:50 user nova-compute[72773]: DEBUG os_brick.utils [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:29:50 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Updating existing volume attachment record: fbcec4dc-c88c-4851-a812-9c80c8c90772 {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:29:50 user nova-compute[72773]: DEBUG nova.network.neutron [req-2ac1a614-dd30-4f16-960f-2f4219c71adb req-19d23ba9-be67-4ad7-9fcc-87cea2c2e182 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Updated VIF entry in instance network info cache for port 44f58154-ceae-45ef-a169-0681e0e9a3fb. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:29:50 user nova-compute[72773]: DEBUG nova.network.neutron [req-2ac1a614-dd30-4f16-960f-2f4219c71adb req-19d23ba9-be67-4ad7-9fcc-87cea2c2e182 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Updating instance_info_cache with network_info: [{"id": "b47506d5-cd81-498a-8f7b-d735d0601f49", "address": "fa:16:3e:14:c3:e5", "network": {"id": "8b3d0165-9b35-42e8-bb94-f9cb7d76409d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1320393408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47506d5-cd", "ovs_interfaceid": "b47506d5-cd81-498a-8f7b-d735d0601f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4188d812-137b-448e-acb1-42dea2d8eb91", "address": "fa:16:3e:0f:fc:e8", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4188d812-13", "ovs_interfaceid": "4188d812-137b-448e-acb1-42dea2d8eb91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2dc74ea7-4f01-465f-8e7a-f5b4299ace47", "address": "fa:16:3e:cc:b0:44", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc74ea7-4f", "ovs_interfaceid": "2dc74ea7-4f01-465f-8e7a-f5b4299ace47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2581ab2b-5a7c-4c9a-8f59-f3c5a7228044", "address": "fa:16:3e:cc:9c:eb", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2581ab2b-5a", "ovs_interfaceid": "2581ab2b-5a7c-4c9a-8f59-f3c5a7228044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "464fb40c-7053-464f-b788-d285f283fb56", "address": "fa:16:3e:ce:aa:1f", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464fb40c-70", "ovs_interfaceid": "464fb40c-7053-464f-b788-d285f283fb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44f58154-ceae-45ef-a169-0681e0e9a3fb", "address": "fa:16:3e:95:7a:63", "network": {"id": "a2682c6d-c949-41e3-8efe-546921aea554", "bridge": "br-int", "label": "tempest-device-tagging-net2-870198650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44f58154-ce", "ovs_interfaceid": "44f58154-ceae-45ef-a169-0681e0e9a3fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0230e8bd-c876-4793-96f6-9ccc72deaa73", "address": "fa:16:3e:9d:92:42", "network": {"id": "a2682c6d-c949-41e3-8efe-546921aea554", "bridge": "br-int", "label": "tempest-device-tagging-net2-870198650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0230e8bd-c8", "ovs_interfaceid": "0230e8bd-c876-4793-96f6-9ccc72deaa73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:29:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2ac1a614-dd30-4f16-960f-2f4219c71adb req-19d23ba9-be67-4ad7-9fcc-87cea2c2e182 service nova] Releasing lock "refresh_cache-5aa5adad-599d-424f-bbfc-7d87ead31b57" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:29:50 user nova-compute[72773]: DEBUG nova.compute.manager [req-2ac1a614-dd30-4f16-960f-2f4219c71adb req-19d23ba9-be67-4ad7-9fcc-87cea2c2e182 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-changed-0230e8bd-c876-4793-96f6-9ccc72deaa73 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:50 user nova-compute[72773]: DEBUG nova.compute.manager [req-2ac1a614-dd30-4f16-960f-2f4219c71adb req-19d23ba9-be67-4ad7-9fcc-87cea2c2e182 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Refreshing instance network info cache due to event network-changed-0230e8bd-c876-4793-96f6-9ccc72deaa73. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:29:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2ac1a614-dd30-4f16-960f-2f4219c71adb req-19d23ba9-be67-4ad7-9fcc-87cea2c2e182 service nova] Acquiring lock "refresh_cache-5aa5adad-599d-424f-bbfc-7d87ead31b57" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:29:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2ac1a614-dd30-4f16-960f-2f4219c71adb req-19d23ba9-be67-4ad7-9fcc-87cea2c2e182 service nova] Acquired lock "refresh_cache-5aa5adad-599d-424f-bbfc-7d87ead31b57" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:29:50 user nova-compute[72773]: DEBUG nova.network.neutron [req-2ac1a614-dd30-4f16-960f-2f4219c71adb req-19d23ba9-be67-4ad7-9fcc-87cea2c2e182 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Refreshing network info cache for port 0230e8bd-c876-4793-96f6-9ccc72deaa73 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:29:50 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Updating instance_info_cache with network_info: [{"id": "813736f3-3cf2-4d52-9bf5-239b93647ee2", "address": "fa:16:3e:55:99:4d", "network": {"id": "db5b9d7a-8d3c-409c-961b-9bd7d882664c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1507737858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9086072338454300bb7a455bff6d0757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813736f3-3c", "ovs_interfaceid": "813736f3-3cf2-4d52-9bf5-239b93647ee2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:29:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-c6adfa95-47ac-40d3-abc1-0c6027507f07" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:29:50 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 22:29:50 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:29:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:50 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:29:51 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:29:51 user nova-compute[72773]: DEBUG nova.compute.manager [req-cae968dd-9ac9-4a5b-bc3c-c39057966fd8 req-f5f829ba-63ef-4ae7-8167-780296862f22 service nova] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Received event network-vif-deleted-29bed5bd-e561-4bfa-bdb6-76c2063ffd52 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:51 user nova-compute[72773]: INFO nova.compute.manager [req-cae968dd-9ac9-4a5b-bc3c-c39057966fd8 req-f5f829ba-63ef-4ae7-8167-780296862f22 service nova] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Neutron deleted interface 29bed5bd-e561-4bfa-bdb6-76c2063ffd52; detaching it from the instance and deleting it from the info cache
Aug 16 22:29:51 user nova-compute[72773]: DEBUG nova.network.neutron [req-cae968dd-9ac9-4a5b-bc3c-c39057966fd8 req-f5f829ba-63ef-4ae7-8167-780296862f22 service nova] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:29:51 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Took 1.80 seconds to deallocate network for instance.
Aug 16 22:29:51 user nova-compute[72773]: DEBUG nova.compute.manager [req-cae968dd-9ac9-4a5b-bc3c-c39057966fd8 req-f5f829ba-63ef-4ae7-8167-780296862f22 service nova] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Detach interface failed, port_id=29bed5bd-e561-4bfa-bdb6-76c2063ffd52, reason: Instance 3cd33603-83f3-4d7f-8bed-7db4b4d67c32 could not be found. {{(pid=72773) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 22:29:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94ae5694-f56f-4560-a3cc-edc4a59def18/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7cccfdc9-beae-4160-adf5-d3ac161627e7 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7cccfdc9-beae-4160-adf5-d3ac161627e7 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94ae5694-f56f-4560-a3cc-edc4a59def18/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94ae5694-f56f-4560-a3cc-edc4a59def18/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:51 user nova-compute[72773]: DEBUG nova.compute.manager [req-058bba7b-f036-4d00-98b1-c3846a5bbb37 req-e11ead4b-d715-480a-b119-0000b2b29afa service nova] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Received event network-vif-plugged-29bed5bd-e561-4bfa-bdb6-76c2063ffd52 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:29:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-058bba7b-f036-4d00-98b1-c3846a5bbb37 req-e11ead4b-d715-480a-b119-0000b2b29afa service nova] Acquiring lock "3cd33603-83f3-4d7f-8bed-7db4b4d67c32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-058bba7b-f036-4d00-98b1-c3846a5bbb37 req-e11ead4b-d715-480a-b119-0000b2b29afa service nova] Lock "3cd33603-83f3-4d7f-8bed-7db4b4d67c32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-058bba7b-f036-4d00-98b1-c3846a5bbb37 req-e11ead4b-d715-480a-b119-0000b2b29afa service nova] Lock "3cd33603-83f3-4d7f-8bed-7db4b4d67c32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:51 user nova-compute[72773]: DEBUG nova.compute.manager [req-058bba7b-f036-4d00-98b1-c3846a5bbb37 req-e11ead4b-d715-480a-b119-0000b2b29afa service nova] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] No waiting events found dispatching network-vif-plugged-29bed5bd-e561-4bfa-bdb6-76c2063ffd52 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:29:51 user nova-compute[72773]: WARNING nova.compute.manager [req-058bba7b-f036-4d00-98b1-c3846a5bbb37 req-e11ead4b-d715-480a-b119-0000b2b29afa service nova] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Received unexpected event network-vif-plugged-29bed5bd-e561-4bfa-bdb6-76c2063ffd52 for instance with vm_state deleted and task_state None.
Aug 16 22:29:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94ae5694-f56f-4560-a3cc-edc4a59def18/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbb196d-e352-47a5-86fb-a819723c2ce8/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:51 user nova-compute[72773]: DEBUG nova.network.neutron [req-2ac1a614-dd30-4f16-960f-2f4219c71adb req-19d23ba9-be67-4ad7-9fcc-87cea2c2e182 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Updated VIF entry in instance network info cache for port 0230e8bd-c876-4793-96f6-9ccc72deaa73. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:29:51 user nova-compute[72773]: DEBUG nova.network.neutron [req-2ac1a614-dd30-4f16-960f-2f4219c71adb req-19d23ba9-be67-4ad7-9fcc-87cea2c2e182 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Updating instance_info_cache with network_info: [{"id": "b47506d5-cd81-498a-8f7b-d735d0601f49", "address": "fa:16:3e:14:c3:e5", "network": {"id": "8b3d0165-9b35-42e8-bb94-f9cb7d76409d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1320393408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47506d5-cd", "ovs_interfaceid": "b47506d5-cd81-498a-8f7b-d735d0601f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4188d812-137b-448e-acb1-42dea2d8eb91", "address": "fa:16:3e:0f:fc:e8", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4188d812-13", "ovs_interfaceid": "4188d812-137b-448e-acb1-42dea2d8eb91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2dc74ea7-4f01-465f-8e7a-f5b4299ace47", "address": "fa:16:3e:cc:b0:44", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc74ea7-4f", "ovs_interfaceid": "2dc74ea7-4f01-465f-8e7a-f5b4299ace47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2581ab2b-5a7c-4c9a-8f59-f3c5a7228044", "address": "fa:16:3e:cc:9c:eb", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2581ab2b-5a", "ovs_interfaceid": "2581ab2b-5a7c-4c9a-8f59-f3c5a7228044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "464fb40c-7053-464f-b788-d285f283fb56", "address": "fa:16:3e:ce:aa:1f", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464fb40c-70", "ovs_interfaceid": "464fb40c-7053-464f-b788-d285f283fb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44f58154-ceae-45ef-a169-0681e0e9a3fb", "address": "fa:16:3e:95:7a:63", "network": {"id": "a2682c6d-c949-41e3-8efe-546921aea554", "bridge": "br-int", "label": "tempest-device-tagging-net2-870198650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44f58154-ce", "ovs_interfaceid": "44f58154-ceae-45ef-a169-0681e0e9a3fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0230e8bd-c876-4793-96f6-9ccc72deaa73", "address": "fa:16:3e:9d:92:42", "network": {"id": "a2682c6d-c949-41e3-8efe-546921aea554", "bridge": "br-int", "label": "tempest-device-tagging-net2-870198650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0230e8bd-c8", "ovs_interfaceid": "0230e8bd-c876-4793-96f6-9ccc72deaa73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:29:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2ac1a614-dd30-4f16-960f-2f4219c71adb req-19d23ba9-be67-4ad7-9fcc-87cea2c2e182 service nova] Releasing lock "refresh_cache-5aa5adad-599d-424f-bbfc-7d87ead31b57" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:29:51 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-7cccfdc9-beae-4160-adf5-d3ac161627e7 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:29:51 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-7cccfdc9-beae-4160-adf5-d3ac161627e7 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:29:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7cccfdc9-beae-4160-adf5-d3ac161627e7 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.617s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:51 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-7cccfdc9-beae-4160-adf5-d3ac161627e7 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Deleted allocations for instance 3cd33603-83f3-4d7f-8bed-7db4b4d67c32
Aug 16 22:29:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbb196d-e352-47a5-86fb-a819723c2ce8/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbb196d-e352-47a5-86fb-a819723c2ce8/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7cccfdc9-beae-4160-adf5-d3ac161627e7 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "3cd33603-83f3-4d7f-8bed-7db4b4d67c32" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.765s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbb196d-e352-47a5-86fb-a819723c2ce8/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:52 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:29:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/030d076d-5099-4236-ae31-6025017eb51e/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/030d076d-5099-4236-ae31-6025017eb51e/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/030d076d-5099-4236-ae31-6025017eb51e/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/030d076d-5099-4236-ae31-6025017eb51e/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:29:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:54 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:54 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:54 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:29:54 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b4514f-16f8-466d-9e58-b95c0bfb3f32/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b4514f-16f8-466d-9e58-b95c0bfb3f32/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b4514f-16f8-466d-9e58-b95c0bfb3f32/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:29:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b4514f-16f8-466d-9e58-b95c0bfb3f32/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:29:54 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:29:55 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:29:55 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:29:55 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=7514MB free_disk=25.752132415771484GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:29:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:55 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 956d334e-f190-4625-b144-ab44d2f3321a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:29:55 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 4efab321-f2aa-456c-a1ae-b32f399f694d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:29:55 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance c6adfa95-47ac-40d3-abc1-0c6027507f07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:29:55 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 8bbb196d-e352-47a5-86fb-a819723c2ce8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:29:55 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 2c1c948f-c541-41ea-ba51-23ff78d1c0db actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:29:55 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 030d076d-5099-4236-ae31-6025017eb51e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:29:55 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 94ae5694-f56f-4560-a3cc-edc4a59def18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:29:55 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 02227d9f-5ddf-42fe-91a8-ce56d76aa274 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:29:55 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 60b4514f-16f8-466d-9e58-b95c0bfb3f32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:29:55 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 5aa5adad-599d-424f-bbfc-7d87ead31b57 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:29:55 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:29:55 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:29:55 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:29:55 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:29:55 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:29:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.542s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:56 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:29:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-0b27c62a-95f0-4570-9135-15ba685037f6 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Acquiring lock "8bbb196d-e352-47a5-86fb-a819723c2ce8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-0b27c62a-95f0-4570-9135-15ba685037f6 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Lock "8bbb196d-e352-47a5-86fb-a819723c2ce8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-0b27c62a-95f0-4570-9135-15ba685037f6 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Acquiring lock "8bbb196d-e352-47a5-86fb-a819723c2ce8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:29:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-0b27c62a-95f0-4570-9135-15ba685037f6 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Lock "8bbb196d-e352-47a5-86fb-a819723c2ce8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:29:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-0b27c62a-95f0-4570-9135-15ba685037f6 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Lock "8bbb196d-e352-47a5-86fb-a819723c2ce8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:29:59 user nova-compute[72773]: INFO nova.compute.manager [None req-0b27c62a-95f0-4570-9135-15ba685037f6 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Terminating instance
Aug 16 22:29:59 user nova-compute[72773]: DEBUG nova.compute.manager [None req-0b27c62a-95f0-4570-9135-15ba685037f6 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:29:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:29:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:00 user nova-compute[72773]: DEBUG nova.compute.manager [req-4cba14f0-9346-412b-b3e0-63bfb9fc1645 req-d2ad0452-cbfe-4a2f-87a4-e364510adf9c service nova] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Received event network-vif-unplugged-8fabc876-8281-4305-8c4e-94cf1e316cf5 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:30:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4cba14f0-9346-412b-b3e0-63bfb9fc1645 req-d2ad0452-cbfe-4a2f-87a4-e364510adf9c service nova] Acquiring lock "8bbb196d-e352-47a5-86fb-a819723c2ce8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4cba14f0-9346-412b-b3e0-63bfb9fc1645 req-d2ad0452-cbfe-4a2f-87a4-e364510adf9c service nova] Lock "8bbb196d-e352-47a5-86fb-a819723c2ce8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4cba14f0-9346-412b-b3e0-63bfb9fc1645 req-d2ad0452-cbfe-4a2f-87a4-e364510adf9c service nova] Lock "8bbb196d-e352-47a5-86fb-a819723c2ce8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:00 user nova-compute[72773]: DEBUG nova.compute.manager [req-4cba14f0-9346-412b-b3e0-63bfb9fc1645 req-d2ad0452-cbfe-4a2f-87a4-e364510adf9c service nova] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] No waiting events found dispatching network-vif-unplugged-8fabc876-8281-4305-8c4e-94cf1e316cf5 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:30:00 user nova-compute[72773]: DEBUG nova.compute.manager [req-4cba14f0-9346-412b-b3e0-63bfb9fc1645 req-d2ad0452-cbfe-4a2f-87a4-e364510adf9c service nova] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Received event network-vif-unplugged-8fabc876-8281-4305-8c4e-94cf1e316cf5 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:30:00 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Instance destroyed successfully.
Aug 16 22:30:00 user nova-compute[72773]: DEBUG nova.objects.instance [None req-0b27c62a-95f0-4570-9135-15ba685037f6 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Lazy-loading 'resources' on Instance uuid 8bbb196d-e352-47a5-86fb-a819723c2ce8 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:30:00 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-0b27c62a-95f0-4570-9135-15ba685037f6 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:25:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2109003385',display_name='tempest-TestVolumeSwap-server-2109003385',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2109003385',id=8,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhGvwzUQvzE0hv787F07q+EM989/AxpcxUxTKwwep+vVOp7IXuws1pgQodlZr0ljJlsRCC8Je/Zp1aJmEwnTWb/EJA6jL6eR09GcsNTE33X3QIcpYVCTyZHPk6wTwEa3A==',key_name='tempest-keypair-192268623',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:25:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='228b8b05cdb54990b21e671e31fb51ff',ramdisk_id='',reservation_id='r-a50uu0mm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-2095876552',owner_user_name='tempest-TestVolumeSwap-2095876552-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:25:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da019859d25d4bc7851a549f35e3dadd',uuid=8bbb196d-e352-47a5-86fb-a819723c2ce8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fabc876-8281-4305-8c4e-94cf1e316cf5", "address": "fa:16:3e:54:d7:ac", "network": {"id": "3b558f9d-f82f-4407-8a9d-59e024e4c7a6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-974724272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228b8b05cdb54990b21e671e31fb51ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fabc876-82", "ovs_interfaceid": "8fabc876-8281-4305-8c4e-94cf1e316cf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:30:00 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-0b27c62a-95f0-4570-9135-15ba685037f6 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Converting VIF {"id": "8fabc876-8281-4305-8c4e-94cf1e316cf5", "address": "fa:16:3e:54:d7:ac", "network": {"id": "3b558f9d-f82f-4407-8a9d-59e024e4c7a6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-974724272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228b8b05cdb54990b21e671e31fb51ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fabc876-82", "ovs_interfaceid": "8fabc876-8281-4305-8c4e-94cf1e316cf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:30:00 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-0b27c62a-95f0-4570-9135-15ba685037f6 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:d7:ac,bridge_name='br-int',has_traffic_filtering=True,id=8fabc876-8281-4305-8c4e-94cf1e316cf5,network=Network(3b558f9d-f82f-4407-8a9d-59e024e4c7a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fabc876-82') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:30:00 user nova-compute[72773]: DEBUG os_vif [None req-0b27c62a-95f0-4570-9135-15ba685037f6 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:d7:ac,bridge_name='br-int',has_traffic_filtering=True,id=8fabc876-8281-4305-8c4e-94cf1e316cf5,network=Network(3b558f9d-f82f-4407-8a9d-59e024e4c7a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fabc876-82') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:30:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fabc876-82, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:30:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:30:00 user nova-compute[72773]: INFO os_vif [None req-0b27c62a-95f0-4570-9135-15ba685037f6 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:d7:ac,bridge_name='br-int',has_traffic_filtering=True,id=8fabc876-8281-4305-8c4e-94cf1e316cf5,network=Network(3b558f9d-f82f-4407-8a9d-59e024e4c7a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fabc876-82')
Aug 16 22:30:00 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-0b27c62a-95f0-4570-9135-15ba685037f6 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Deleting instance files /opt/stack/data/nova/instances/8bbb196d-e352-47a5-86fb-a819723c2ce8_del
Aug 16 22:30:00 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-0b27c62a-95f0-4570-9135-15ba685037f6 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Deletion of /opt/stack/data/nova/instances/8bbb196d-e352-47a5-86fb-a819723c2ce8_del complete
Aug 16 22:30:00 user nova-compute[72773]: INFO nova.compute.manager [None req-0b27c62a-95f0-4570-9135-15ba685037f6 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 16 22:30:00 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-0b27c62a-95f0-4570-9135-15ba685037f6 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:30:00 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:30:00 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:30:02 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:30:02 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Took 1.70 seconds to deallocate network for instance.
Aug 16 22:30:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-0b27c62a-95f0-4570-9135-15ba685037f6 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-0b27c62a-95f0-4570-9135-15ba685037f6 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:02 user nova-compute[72773]: DEBUG nova.compute.manager [req-d691bcdd-4cad-49f1-8da0-a97973b543ba req-be3b929d-5ad5-44ff-aa2c-b51a51906309 service nova] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Received event network-vif-plugged-8fabc876-8281-4305-8c4e-94cf1e316cf5 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:30:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d691bcdd-4cad-49f1-8da0-a97973b543ba req-be3b929d-5ad5-44ff-aa2c-b51a51906309 service nova] Acquiring lock "8bbb196d-e352-47a5-86fb-a819723c2ce8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d691bcdd-4cad-49f1-8da0-a97973b543ba req-be3b929d-5ad5-44ff-aa2c-b51a51906309 service nova] Lock "8bbb196d-e352-47a5-86fb-a819723c2ce8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d691bcdd-4cad-49f1-8da0-a97973b543ba req-be3b929d-5ad5-44ff-aa2c-b51a51906309 service nova] Lock "8bbb196d-e352-47a5-86fb-a819723c2ce8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:02 user nova-compute[72773]: DEBUG nova.compute.manager [req-d691bcdd-4cad-49f1-8da0-a97973b543ba req-be3b929d-5ad5-44ff-aa2c-b51a51906309 service nova] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] No waiting events found dispatching network-vif-plugged-8fabc876-8281-4305-8c4e-94cf1e316cf5 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:30:02 user nova-compute[72773]: WARNING nova.compute.manager [req-d691bcdd-4cad-49f1-8da0-a97973b543ba req-be3b929d-5ad5-44ff-aa2c-b51a51906309 service nova] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Received unexpected event network-vif-plugged-8fabc876-8281-4305-8c4e-94cf1e316cf5 for instance with vm_state deleted and task_state None.
Aug 16 22:30:02 user nova-compute[72773]: DEBUG nova.compute.manager [req-d691bcdd-4cad-49f1-8da0-a97973b543ba req-be3b929d-5ad5-44ff-aa2c-b51a51906309 service nova] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Received event network-vif-deleted-8fabc876-8281-4305-8c4e-94cf1e316cf5 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:30:02 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-0b27c62a-95f0-4570-9135-15ba685037f6 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:30:02 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-0b27c62a-95f0-4570-9135-15ba685037f6 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:30:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-0b27c62a-95f0-4570-9135-15ba685037f6 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:02 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-0b27c62a-95f0-4570-9135-15ba685037f6 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Deleted allocations for instance 8bbb196d-e352-47a5-86fb-a819723c2ce8
Aug 16 22:30:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-0b27c62a-95f0-4570-9135-15ba685037f6 tempest-TestVolumeSwap-2095876552 tempest-TestVolumeSwap-2095876552-project-member] Lock "8bbb196d-e352-47a5-86fb-a819723c2ce8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.256s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:04 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692224989.2057312, 3cd33603-83f3-4d7f-8bed-7db4b4d67c32 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:30:04 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] VM Stopped (Lifecycle Event)
Aug 16 22:30:04 user nova-compute[72773]: DEBUG nova.compute.manager [None req-53956958-e111-4c92-8726-d27788022232 None None] [instance: 3cd33603-83f3-4d7f-8bed-7db4b4d67c32] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:30:04 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Acquiring lock "384d4037-bac4-423f-bc7a-e64fe14d7f77" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lock "384d4037-bac4-423f-bc7a-e64fe14d7f77" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:30:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:14 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:30:14 user nova-compute[72773]: INFO nova.compute.claims [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Claim successful on node user
Aug 16 22:30:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:14 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:30:14 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:30:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:30:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:30:14 user nova-compute[72773]: DEBUG nova.network.neutron [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:30:14 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:30:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:30:14 user nova-compute[72773]: DEBUG nova.policy [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c282abb16d84eedbf4703c3a68ec3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf394e6df5cf44698ab7a57554816db8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:30:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:30:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:30:14 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Creating image(s)
Aug 16 22:30:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Acquiring lock "/opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lock "/opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lock "/opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.226s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:15 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692225000.3297741, 8bbb196d-e352-47a5-86fb-a819723c2ce8 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:30:15 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] VM Stopped (Lifecycle Event)
Aug 16 22:30:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:15 user nova-compute[72773]: DEBUG nova.compute.manager [None req-fb1020d1-0ae6-4d34-9f05-f58c992e2c8f None None] [instance: 8bbb196d-e352-47a5-86fb-a819723c2ce8] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:30:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.269s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/disk 1073741824" returned: 0 in 0.066s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.343s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.197s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:15 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Checking if we can resize image /opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:30:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:15 user nova-compute[72773]: DEBUG nova.network.neutron [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Successfully created port: 1b75dfbd-e31b-435b-9adf-ea722cb75caf {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:30:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:15 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Cannot resize image /opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:30:15 user nova-compute[72773]: DEBUG nova.objects.instance [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lazy-loading 'migration_context' on Instance uuid 384d4037-bac4-423f-bc7a-e64fe14d7f77 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:30:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:30:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Ensure instance console log exists: /opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:30:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.network.neutron [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Successfully updated port: 1b75dfbd-e31b-435b-9adf-ea722cb75caf {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Acquiring lock "refresh_cache-384d4037-bac4-423f-bc7a-e64fe14d7f77" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Acquired lock "refresh_cache-384d4037-bac4-423f-bc7a-e64fe14d7f77" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.network.neutron [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.compute.manager [req-b9a7f125-78e3-4c5d-9944-970f069404cb req-1c4cd519-2419-4f53-aaf3-7f52c5195969 service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Received event network-changed-1b75dfbd-e31b-435b-9adf-ea722cb75caf {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.compute.manager [req-b9a7f125-78e3-4c5d-9944-970f069404cb req-1c4cd519-2419-4f53-aaf3-7f52c5195969 service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Refreshing instance network info cache due to event network-changed-1b75dfbd-e31b-435b-9adf-ea722cb75caf. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b9a7f125-78e3-4c5d-9944-970f069404cb req-1c4cd519-2419-4f53-aaf3-7f52c5195969 service nova] Acquiring lock "refresh_cache-384d4037-bac4-423f-bc7a-e64fe14d7f77" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.network.neutron [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.network.neutron [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Updating instance_info_cache with network_info: [{"id": "1b75dfbd-e31b-435b-9adf-ea722cb75caf", "address": "fa:16:3e:19:aa:35", "network": {"id": "6713e8d9-0a25-439f-bf23-793daef39f3d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1456160285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf394e6df5cf44698ab7a57554816db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b75dfbd-e3", "ovs_interfaceid": "1b75dfbd-e31b-435b-9adf-ea722cb75caf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Releasing lock "refresh_cache-384d4037-bac4-423f-bc7a-e64fe14d7f77" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.compute.manager [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Instance network_info: |[{"id": "1b75dfbd-e31b-435b-9adf-ea722cb75caf", "address": "fa:16:3e:19:aa:35", "network": {"id": "6713e8d9-0a25-439f-bf23-793daef39f3d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1456160285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf394e6df5cf44698ab7a57554816db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b75dfbd-e3", "ovs_interfaceid": "1b75dfbd-e31b-435b-9adf-ea722cb75caf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b9a7f125-78e3-4c5d-9944-970f069404cb req-1c4cd519-2419-4f53-aaf3-7f52c5195969 service nova] Acquired lock "refresh_cache-384d4037-bac4-423f-bc7a-e64fe14d7f77" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.network.neutron [req-b9a7f125-78e3-4c5d-9944-970f069404cb req-1c4cd519-2419-4f53-aaf3-7f52c5195969 service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Refreshing network info cache for port 1b75dfbd-e31b-435b-9adf-ea722cb75caf {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Start _get_guest_xml network_info=[{"id": "1b75dfbd-e31b-435b-9adf-ea722cb75caf", "address": "fa:16:3e:19:aa:35", "network": {"id": "6713e8d9-0a25-439f-bf23-793daef39f3d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1456160285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf394e6df5cf44698ab7a57554816db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b75dfbd-e3", "ovs_interfaceid": "1b75dfbd-e31b-435b-9adf-ea722cb75caf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:30:17 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:30:17 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:30:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1108383111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1108383111',id=17,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvb+XXJ07gUgM7WTapGtd5zb0H3iNTtoq/EYxrHakBL6gizVJGYx1kgeqKzUw19L3aJYy8W16uUXKArptPekGSHwpwooFaxqZLsCatgnClHk+8k8Wbl/vcIiJqX7kwpeQ==',key_name='tempest-keypair-382369375',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf394e6df5cf44698ab7a57554816db8',ramdisk_id='',reservation_id='r-rihg7lgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-740368644',owner_user_name='tempest-TaggedAttachmentsTest-740368644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:30:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c282abb16d84eedbf4703c3a68ec3a2',uuid=384d4037-bac4-423f-bc7a-e64fe14d7f77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b75dfbd-e31b-435b-9adf-ea722cb75caf", "address": "fa:16:3e:19:aa:35", "network": {"id": "6713e8d9-0a25-439f-bf23-793daef39f3d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1456160285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf394e6df5cf44698ab7a57554816db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b75dfbd-e3", "ovs_interfaceid": "1b75dfbd-e31b-435b-9adf-ea722cb75caf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Converting VIF {"id": "1b75dfbd-e31b-435b-9adf-ea722cb75caf", "address": "fa:16:3e:19:aa:35", "network": {"id": "6713e8d9-0a25-439f-bf23-793daef39f3d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1456160285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf394e6df5cf44698ab7a57554816db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b75dfbd-e3", "ovs_interfaceid": "1b75dfbd-e31b-435b-9adf-ea722cb75caf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:aa:35,bridge_name='br-int',has_traffic_filtering=True,id=1b75dfbd-e31b-435b-9adf-ea722cb75caf,network=Network(6713e8d9-0a25-439f-bf23-793daef39f3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b75dfbd-e3') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.objects.instance [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lazy-loading 'pci_devices' on Instance uuid 384d4037-bac4-423f-bc7a-e64fe14d7f77 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:30:17 user nova-compute[72773]:   <uuid>384d4037-bac4-423f-bc7a-e64fe14d7f77</uuid>
Aug 16 22:30:17 user nova-compute[72773]:   <name>instance-00000011</name>
Aug 16 22:30:17 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:30:17 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:30:17 user nova-compute[72773]:   <metadata>
Aug 16 22:30:17 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:30:17 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:30:17 user nova-compute[72773]:       <nova:name>tempest-device-tagging-server-1108383111</nova:name>
Aug 16 22:30:17 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:30:17</nova:creationTime>
Aug 16 22:30:17 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:30:17 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:30:17 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:30:17 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:30:17 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:30:17 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:30:17 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:30:17 user nova-compute[72773]:       <nova:owner>
Aug 16 22:30:17 user nova-compute[72773]:         <nova:user uuid="1c282abb16d84eedbf4703c3a68ec3a2">tempest-TaggedAttachmentsTest-740368644-project-member</nova:user>
Aug 16 22:30:17 user nova-compute[72773]:         <nova:project uuid="cf394e6df5cf44698ab7a57554816db8">tempest-TaggedAttachmentsTest-740368644</nova:project>
Aug 16 22:30:17 user nova-compute[72773]:       </nova:owner>
Aug 16 22:30:17 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:30:17 user nova-compute[72773]:       <nova:ports>
Aug 16 22:30:17 user nova-compute[72773]:         <nova:port uuid="1b75dfbd-e31b-435b-9adf-ea722cb75caf">
Aug 16 22:30:17 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 22:30:17 user nova-compute[72773]:         </nova:port>
Aug 16 22:30:17 user nova-compute[72773]:       </nova:ports>
Aug 16 22:30:17 user nova-compute[72773]:     </nova:instance>
Aug 16 22:30:17 user nova-compute[72773]:   </metadata>
Aug 16 22:30:17 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:30:17 user nova-compute[72773]:     <system>
Aug 16 22:30:17 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:30:17 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:30:17 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:30:17 user nova-compute[72773]:       <entry name="serial">384d4037-bac4-423f-bc7a-e64fe14d7f77</entry>
Aug 16 22:30:17 user nova-compute[72773]:       <entry name="uuid">384d4037-bac4-423f-bc7a-e64fe14d7f77</entry>
Aug 16 22:30:17 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:30:17 user nova-compute[72773]:     </system>
Aug 16 22:30:17 user nova-compute[72773]:   </sysinfo>
Aug 16 22:30:17 user nova-compute[72773]:   <os>
Aug 16 22:30:17 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:30:17 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:30:17 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:30:17 user nova-compute[72773]:   </os>
Aug 16 22:30:17 user nova-compute[72773]:   <features>
Aug 16 22:30:17 user nova-compute[72773]:     <acpi/>
Aug 16 22:30:17 user nova-compute[72773]:     <apic/>
Aug 16 22:30:17 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:30:17 user nova-compute[72773]:   </features>
Aug 16 22:30:17 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:30:17 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:30:17 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:30:17 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:30:17 user nova-compute[72773]:   </clock>
Aug 16 22:30:17 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:30:17 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:30:17 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:30:17 user nova-compute[72773]:   </cpu>
Aug 16 22:30:17 user nova-compute[72773]:   <devices>
Aug 16 22:30:17 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:30:17 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:30:17 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/disk"/>
Aug 16 22:30:17 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:30:17 user nova-compute[72773]:     </disk>
Aug 16 22:30:17 user nova-compute[72773]:     <disk type="file" device="cdrom">
Aug 16 22:30:17 user nova-compute[72773]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 22:30:17 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/disk.config"/>
Aug 16 22:30:17 user nova-compute[72773]:       <target dev="hda" bus="ide"/>
Aug 16 22:30:17 user nova-compute[72773]:     </disk>
Aug 16 22:30:17 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:30:17 user nova-compute[72773]:       <mac address="fa:16:3e:19:aa:35"/>
Aug 16 22:30:17 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:30:17 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:30:17 user nova-compute[72773]:       <target dev="tap1b75dfbd-e3"/>
Aug 16 22:30:17 user nova-compute[72773]:     </interface>
Aug 16 22:30:17 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:30:17 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/console.log" append="off"/>
Aug 16 22:30:17 user nova-compute[72773]:     </serial>
Aug 16 22:30:17 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:30:17 user nova-compute[72773]:     <video>
Aug 16 22:30:17 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:30:17 user nova-compute[72773]:     </video>
Aug 16 22:30:17 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:30:17 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:30:17 user nova-compute[72773]:     </rng>
Aug 16 22:30:17 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:30:17 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:30:17 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:30:17 user nova-compute[72773]:     </memballoon>
Aug 16 22:30:17 user nova-compute[72773]:   </devices>
Aug 16 22:30:17 user nova-compute[72773]: </domain>
Aug 16 22:30:17 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:30:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1108383111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1108383111',id=17,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvb+XXJ07gUgM7WTapGtd5zb0H3iNTtoq/EYxrHakBL6gizVJGYx1kgeqKzUw19L3aJYy8W16uUXKArptPekGSHwpwooFaxqZLsCatgnClHk+8k8Wbl/vcIiJqX7kwpeQ==',key_name='tempest-keypair-382369375',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf394e6df5cf44698ab7a57554816db8',ramdisk_id='',reservation_id='r-rihg7lgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-740368644',owner_user_name='tempest-TaggedAttachmentsTest-740368644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:30:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c282abb16d84eedbf4703c3a68ec3a2',uuid=384d4037-bac4-423f-bc7a-e64fe14d7f77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b75dfbd-e31b-435b-9adf-ea722cb75caf", "address": "fa:16:3e:19:aa:35", "network": {"id": "6713e8d9-0a25-439f-bf23-793daef39f3d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1456160285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf394e6df5cf44698ab7a57554816db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b75dfbd-e3", "ovs_interfaceid": "1b75dfbd-e31b-435b-9adf-ea722cb75caf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Converting VIF {"id": "1b75dfbd-e31b-435b-9adf-ea722cb75caf", "address": "fa:16:3e:19:aa:35", "network": {"id": "6713e8d9-0a25-439f-bf23-793daef39f3d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1456160285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf394e6df5cf44698ab7a57554816db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b75dfbd-e3", "ovs_interfaceid": "1b75dfbd-e31b-435b-9adf-ea722cb75caf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:aa:35,bridge_name='br-int',has_traffic_filtering=True,id=1b75dfbd-e31b-435b-9adf-ea722cb75caf,network=Network(6713e8d9-0a25-439f-bf23-793daef39f3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b75dfbd-e3') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG os_vif [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:aa:35,bridge_name='br-int',has_traffic_filtering=True,id=1b75dfbd-e31b-435b-9adf-ea722cb75caf,network=Network(6713e8d9-0a25-439f-bf23-793daef39f3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b75dfbd-e3') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b75dfbd-e3, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1b75dfbd-e3, col_values=(('external_ids', {'iface-id': '1b75dfbd-e31b-435b-9adf-ea722cb75caf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:aa:35', 'vm-uuid': '384d4037-bac4-423f-bc7a-e64fe14d7f77'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:17 user nova-compute[72773]: INFO os_vif [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:aa:35,bridge_name='br-int',has_traffic_filtering=True,id=1b75dfbd-e31b-435b-9adf-ea722cb75caf,network=Network(6713e8d9-0a25-439f-bf23-793daef39f3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b75dfbd-e3')
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] No BDM found with device name hda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] No VIF found with MAC fa:16:3e:19:aa:35, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:30:17 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Using config drive
Aug 16 22:30:17 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Creating config drive at /opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/disk.config
Aug 16 22:30:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpztb7cso4 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpztb7cso4" returned: 0 in 0.061s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:18 user nova-compute[72773]: DEBUG nova.network.neutron [req-b9a7f125-78e3-4c5d-9944-970f069404cb req-1c4cd519-2419-4f53-aaf3-7f52c5195969 service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Updated VIF entry in instance network info cache for port 1b75dfbd-e31b-435b-9adf-ea722cb75caf. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:30:18 user nova-compute[72773]: DEBUG nova.network.neutron [req-b9a7f125-78e3-4c5d-9944-970f069404cb req-1c4cd519-2419-4f53-aaf3-7f52c5195969 service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Updating instance_info_cache with network_info: [{"id": "1b75dfbd-e31b-435b-9adf-ea722cb75caf", "address": "fa:16:3e:19:aa:35", "network": {"id": "6713e8d9-0a25-439f-bf23-793daef39f3d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1456160285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf394e6df5cf44698ab7a57554816db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b75dfbd-e3", "ovs_interfaceid": "1b75dfbd-e31b-435b-9adf-ea722cb75caf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:30:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b9a7f125-78e3-4c5d-9944-970f069404cb req-1c4cd519-2419-4f53-aaf3-7f52c5195969 service nova] Releasing lock "refresh_cache-384d4037-bac4-423f-bc7a-e64fe14d7f77" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:30:19 user nova-compute[72773]: INFO nova.virt.block_device [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Booting with volume e8c0936b-a479-498d-bd29-84f5509e841d at /dev/vdc
Aug 16 22:30:19 user nova-compute[72773]: DEBUG os_brick.utils [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:30:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.029s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:19 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b88d00-da4e-497a-9ff4-ac3b0c451eb4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:19 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbddbae-b34d-4801-a5bc-85f3380fa857]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:19 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3249fdd-eb7b-4db7-9810-35a655196d57]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:19 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee64f577-54c3-4d1a-83f9-f3a5b1bb0914]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:30:19 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:30:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:30:19 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:30:19 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[73907de2-1fe4-468a-b680-007e6aa92e54]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:19 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:30:19 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:30:19 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:30:19 user nova-compute[72773]: DEBUG os_brick.utils [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] <== get_connector_properties: return (186ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:30:19 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Updating existing volume attachment record: 195abcc7-6f6b-49bb-ab61-dc311b8b86ea {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:30:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-735df6f9-7b8c-49e8-900e-dded65972304 req-a4e7e0f3-1b92-49d2-9554-cd3de0583222 service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Received event network-vif-plugged-1b75dfbd-e31b-435b-9adf-ea722cb75caf {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:30:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-735df6f9-7b8c-49e8-900e-dded65972304 req-a4e7e0f3-1b92-49d2-9554-cd3de0583222 service nova] Acquiring lock "384d4037-bac4-423f-bc7a-e64fe14d7f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-735df6f9-7b8c-49e8-900e-dded65972304 req-a4e7e0f3-1b92-49d2-9554-cd3de0583222 service nova] Lock "384d4037-bac4-423f-bc7a-e64fe14d7f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-735df6f9-7b8c-49e8-900e-dded65972304 req-a4e7e0f3-1b92-49d2-9554-cd3de0583222 service nova] Lock "384d4037-bac4-423f-bc7a-e64fe14d7f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-735df6f9-7b8c-49e8-900e-dded65972304 req-a4e7e0f3-1b92-49d2-9554-cd3de0583222 service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] No waiting events found dispatching network-vif-plugged-1b75dfbd-e31b-435b-9adf-ea722cb75caf {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:30:20 user nova-compute[72773]: WARNING nova.compute.manager [req-735df6f9-7b8c-49e8-900e-dded65972304 req-a4e7e0f3-1b92-49d2-9554-cd3de0583222 service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Received unexpected event network-vif-plugged-1b75dfbd-e31b-435b-9adf-ea722cb75caf for instance with vm_state building and task_state spawning.
Aug 16 22:30:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:21 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225021.8031864, 384d4037-bac4-423f-bc7a-e64fe14d7f77 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:30:21 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] VM Resumed (Lifecycle Event)
Aug 16 22:30:21 user nova-compute[72773]: DEBUG nova.compute.manager [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:30:21 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:30:21 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Instance spawned successfully.
Aug 16 22:30:21 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:30:21 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:30:21 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:30:21 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:30:21 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:30:21 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:30:21 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:30:21 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:30:21 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:30:21 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:30:21 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225021.8083353, 384d4037-bac4-423f-bc7a-e64fe14d7f77 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:30:21 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] VM Started (Lifecycle Event)
Aug 16 22:30:21 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:30:21 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:30:21 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:30:21 user nova-compute[72773]: INFO nova.compute.manager [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Took 6.96 seconds to spawn the instance on the hypervisor.
Aug 16 22:30:21 user nova-compute[72773]: DEBUG nova.compute.manager [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:30:22 user nova-compute[72773]: INFO nova.compute.manager [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Took 7.77 seconds to build instance.
Aug 16 22:30:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dce0ce1d-1da2-47d3-ad28-aa32990adc3b tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lock "384d4037-bac4-423f-bc7a-e64fe14d7f77" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.866s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:22 user nova-compute[72773]: DEBUG nova.compute.manager [req-d93f2448-04aa-4c41-a156-c83942769707 req-3e681105-d00b-44de-a534-3548acf60283 service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Received event network-vif-plugged-1b75dfbd-e31b-435b-9adf-ea722cb75caf {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:30:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d93f2448-04aa-4c41-a156-c83942769707 req-3e681105-d00b-44de-a534-3548acf60283 service nova] Acquiring lock "384d4037-bac4-423f-bc7a-e64fe14d7f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d93f2448-04aa-4c41-a156-c83942769707 req-3e681105-d00b-44de-a534-3548acf60283 service nova] Lock "384d4037-bac4-423f-bc7a-e64fe14d7f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d93f2448-04aa-4c41-a156-c83942769707 req-3e681105-d00b-44de-a534-3548acf60283 service nova] Lock "384d4037-bac4-423f-bc7a-e64fe14d7f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:22 user nova-compute[72773]: DEBUG nova.compute.manager [req-d93f2448-04aa-4c41-a156-c83942769707 req-3e681105-d00b-44de-a534-3548acf60283 service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] No waiting events found dispatching network-vif-plugged-1b75dfbd-e31b-435b-9adf-ea722cb75caf {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:30:22 user nova-compute[72773]: WARNING nova.compute.manager [req-d93f2448-04aa-4c41-a156-c83942769707 req-3e681105-d00b-44de-a534-3548acf60283 service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Received unexpected event network-vif-plugged-1b75dfbd-e31b-435b-9adf-ea722cb75caf for instance with vm_state active and task_state None.
Aug 16 22:30:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:39 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6e562687-c8a3-45db-9269-5aa3889b8f26 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "4efab321-f2aa-456c-a1ae-b32f399f694d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:39 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6e562687-c8a3-45db-9269-5aa3889b8f26 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "4efab321-f2aa-456c-a1ae-b32f399f694d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:39 user nova-compute[72773]: INFO nova.compute.manager [None req-6e562687-c8a3-45db-9269-5aa3889b8f26 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Detaching volume c6852443-e1d9-4227-bfa5-a9179c28be11
Aug 16 22:30:40 user nova-compute[72773]: INFO nova.virt.block_device [None req-6e562687-c8a3-45db-9269-5aa3889b8f26 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Attempting to driver detach volume c6852443-e1d9-4227-bfa5-a9179c28be11 from mountpoint /dev/vdb
Aug 16 22:30:40 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6e562687-c8a3-45db-9269-5aa3889b8f26 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Attempting to detach device vdb from instance 4efab321-f2aa-456c-a1ae-b32f399f694d from the persistent domain config. {{(pid=72773) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-6e562687-c8a3-45db-9269-5aa3889b8f26 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:30:40 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:30:40 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 22:30:40 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:30:40 user nova-compute[72773]:   <serial>c6852443-e1d9-4227-bfa5-a9179c28be11</serial>
Aug 16 22:30:40 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:30:40 user nova-compute[72773]: </disk>
Aug 16 22:30:40 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:30:40 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-6e562687-c8a3-45db-9269-5aa3889b8f26 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Successfully detached device vdb from instance 4efab321-f2aa-456c-a1ae-b32f399f694d from the persistent domain config.
Aug 16 22:30:40 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6e562687-c8a3-45db-9269-5aa3889b8f26 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4efab321-f2aa-456c-a1ae-b32f399f694d from the live domain config. {{(pid=72773) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-6e562687-c8a3-45db-9269-5aa3889b8f26 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:30:40 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:30:40 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 22:30:40 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:30:40 user nova-compute[72773]:   <serial>c6852443-e1d9-4227-bfa5-a9179c28be11</serial>
Aug 16 22:30:40 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:30:40 user nova-compute[72773]: </disk>
Aug 16 22:30:40 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Received event <DeviceRemovedEvent: 1692225040.6167893, 4efab321-f2aa-456c-a1ae-b32f399f694d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72773) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6e562687-c8a3-45db-9269-5aa3889b8f26 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4efab321-f2aa-456c-a1ae-b32f399f694d {{(pid=72773) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 22:30:40 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-6e562687-c8a3-45db-9269-5aa3889b8f26 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Successfully detached device vdb from instance 4efab321-f2aa-456c-a1ae-b32f399f694d from the live domain config.
Aug 16 22:30:40 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e562687-c8a3-45db-9269-5aa3889b8f26 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e562687-c8a3-45db-9269-5aa3889b8f26 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YvhaHcTr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:30:40 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-6e562687-c8a3-45db-9269-5aa3889b8f26 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:30:40 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-6e562687-c8a3-45db-9269-5aa3889b8f26 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-6e562687-c8a3-45db-9269-5aa3889b8f26 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e562687-c8a3-45db-9269-5aa3889b8f26 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9672ed7c-2e29-4829-be29-b2c43a437173]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bda40b-acc2-4189-85c0-1c42b6fa5ece]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e562687-c8a3-45db-9269-5aa3889b8f26 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:30:40 user nova-compute[72773]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:30:40 user nova-compute[72773]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 (non-flash)
Aug 16 22:30:40 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:30:40 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e562687-c8a3-45db-9269-5aa3889b8f26 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:30:40 user nova-compute[72773]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:30:40 user nova-compute[72773]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 (non-flash)
Aug 16 22:30:40 user nova-compute[72773]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 (non-flash)
Aug 16 22:30:40 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e562687-c8a3-45db-9269-5aa3889b8f26 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef803d2440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11'): ({'sdc'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-6e562687-c8a3-45db-9269-5aa3889b8f26 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Removing single pathed devices sdc {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c358f16-e86b-4a66-91c2-b2330c56f2cb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf25f0c-da5c-4f55-a9ea-0a1d28f76489]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-6e562687-c8a3-45db-9269-5aa3889b8f26 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Flushing IO for device /dev/sdc {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca210b5-d415-403c-b4ff-9911eae22772]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-6e562687-c8a3-45db-9269-5aa3889b8f26 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0072c08f-5c7a-4ec0-afc9-fb56a0c06e6b]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-6e562687-c8a3-45db-9269-5aa3889b8f26 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-6e562687-c8a3-45db-9269-5aa3889b8f26 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e562687-c8a3-45db-9269-5aa3889b8f26 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b121176b-400e-4980-afc8-040492e1791f]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e562687-c8a3-45db-9269-5aa3889b8f26 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a612af-31c6-4e73-a712-4dd4e1938d11]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e562687-c8a3-45db-9269-5aa3889b8f26 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11, portal: 172.16.0.220,3260]
Aug 16 22:30:40 user nova-compute[72773]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11, portal: 172.16.0.220,3260] successful.
Aug 16 22:30:40 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6852443-e1d9-4227-bfa5-a9179c28be11 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ef5e25-58f7-480f-a71b-cf630e46b0f9]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e562687-c8a3-45db-9269-5aa3889b8f26 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-6e562687-c8a3-45db-9269-5aa3889b8f26 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e562687-c8a3-45db-9269-5aa3889b8f26 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] <== disconnect_volume: return (311ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:30:40 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e562687-c8a3-45db-9269-5aa3889b8f26 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:30:41 user nova-compute[72773]: DEBUG nova.objects.instance [None req-6e562687-c8a3-45db-9269-5aa3889b8f26 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lazy-loading 'flavor' on Instance uuid 4efab321-f2aa-456c-a1ae-b32f399f694d {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:30:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6e562687-c8a3-45db-9269-5aa3889b8f26 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "4efab321-f2aa-456c-a1ae-b32f399f694d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.803s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG nova.compute.manager [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:30:42 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Creating image(s)
Aug 16 22:30:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Did not create local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Ensure instance console log exists: /opt/stack/data/nova/instances/5aa5adad-599d-424f-bbfc-7d87ead31b57/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Start _get_guest_xml network_info=[{"id": "b47506d5-cd81-498a-8f7b-d735d0601f49", "address": "fa:16:3e:14:c3:e5", "network": {"id": "8b3d0165-9b35-42e8-bb94-f9cb7d76409d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1320393408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47506d5-cd", "ovs_interfaceid": "b47506d5-cd81-498a-8f7b-d735d0601f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4188d812-137b-448e-acb1-42dea2d8eb91", "address": "fa:16:3e:0f:fc:e8", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4188d812-13", "ovs_interfaceid": "4188d812-137b-448e-acb1-42dea2d8eb91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2dc74ea7-4f01-465f-8e7a-f5b4299ace47", "address": "fa:16:3e:cc:b0:44", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc74ea7-4f", "ovs_interfaceid": "2dc74ea7-4f01-465f-8e7a-f5b4299ace47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2581ab2b-5a7c-4c9a-8f59-f3c5a7228044", "address": "fa:16:3e:cc:9c:eb", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2581ab2b-5a", "ovs_interfaceid": "2581ab2b-5a7c-4c9a-8f59-f3c5a7228044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "464fb40c-7053-464f-b788-d285f283fb56", "address": "fa:16:3e:ce:aa:1f", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464fb40c-70", "ovs_interfaceid": "464fb40c-7053-464f-b788-d285f283fb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44f58154-ceae-45ef-a169-0681e0e9a3fb", "address": "fa:16:3e:95:7a:63", "network": {"id": "a2682c6d-c949-41e3-8efe-546921aea554", "bridge": "br-int", "label": "tempest-device-tagging-net2-870198650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44f58154-ce", "ovs_interfaceid": "44f58154-ceae-45ef-a169-0681e0e9a3fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0230e8bd-c876-4793-96f6-9ccc72deaa73", "address": "fa:16:3e:9d:92:42", "network": {"id": "a2682c6d-c949-41e3-8efe-546921aea554", "bridge": "br-int", "label": "tempest-device-tagging-net2-870198650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0230e8bd-c8", "ovs_interfaceid": "0230e8bd-c876-4793-96f6-9ccc72deaa73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'eb1715a7-c085-4a17-b7d8-7a726acda3d3', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OaMlzoJg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5aa5adad-599d-424f-bbfc-7d87ead31b57', 'attached_at': '', 'detached_at': '', 'volume_id': '5c7ee644-475f-4522-adf6-704098fbda77', 'serial': '5c7ee644-475f-4522-adf6-704098fbda77'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': 'fbcec4dc-c88c-4851-a812-9c80c8c90772', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rVmzaLuT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5aa5adad-599d-424f-bbfc-7d87ead31b57', 'attached_at': '', 'detached_at': '', 'volume_id': 'a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9', 'serial': 'a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9'}, 'mount_device': '/dev/vdb', 'boot_index': 1, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': '195abcc7-6f6b-49bb-ab61-dc311b8b86ea', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egwoqQcJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5aa5adad-599d-424f-bbfc-7d87ead31b57', 'attached_at': '', 'detached_at': '', 'volume_id': 'e8c0936b-a479-498d-bd29-84f5509e841d', 'serial': 'e8c0936b-a479-498d-bd29-84f5509e841d'}, 'mount_device': '/dev/vdc', 'boot_index': 2, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:30:42 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:30:42 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:30:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OaMlzoJg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:30:42 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:30:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:30:42 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:30:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:30:42 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecc2356-67fd-4b58-9dd1-54f509b5ac4a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:30:42 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fcb9de-7b15-4058-9a0f-28dfcd2b5499]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77] added
Aug 16 22:30:42 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e70ce72-f4ee-4188-a303-14a73eaf135c]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[786c41da-3b56-4c01-ae21-ab248e8fb857]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OaMlzoJg {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OaMlzoJg" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ef6ded-9528-4d23-a80e-906de557514e]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OaMlzoJg'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[54af25dc-2a29-40c5-b706-0b85a546ad6f]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[80dc65ab-c81c-405b-a8f3-869046a180e2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:30:42 user nova-compute[72773]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:30:42 user nova-compute[72773]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 (non-flash)
Aug 16 22:30:42 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:30:42 user nova-compute[72773]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:30:42 user nova-compute[72773]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 (non-flash)
Aug 16 22:30:42 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-54eaaf30-fcf7-436f-8ee4-a50dfd8e28f0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-54eaaf30-fcf7-436f-8ee4-a50dfd8e28f0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:42 user nova-compute[72773]: INFO nova.compute.manager [None req-54eaaf30-fcf7-436f-8ee4-a50dfd8e28f0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Detaching volume 33b7060b-4d09-4bef-b22e-75ca0372f0b2
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[563a2c8c-b784-4d13-aba7-b589bed61f12]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77, portal: 172.16.0.220,3260]
Aug 16 22:30:42 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77, portal: 172.16.0.220,3260] successful.
Aug 16 22:30:42 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[28473473-b5cf-4891-9562-672254f4885f]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:42 user nova-compute[72773]: INFO nova.virt.block_device [None req-54eaaf30-fcf7-436f-8ee4-a50dfd8e28f0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Attempting to driver detach volume 33b7060b-4d09-4bef-b22e-75ca0372f0b2 from mountpoint /dev/vdc
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94441a5-3631-40f0-8796-bffcf6096caf]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:30:42 user nova-compute[72773]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:30:42 user nova-compute[72773]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 (non-flash)
Aug 16 22:30:42 user nova-compute[72773]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 (non-flash)
Aug 16 22:30:42 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:30:42 user nova-compute[72773]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:30:42 user nova-compute[72773]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 (non-flash)
Aug 16 22:30:42 user nova-compute[72773]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 (non-flash)
Aug 16 22:30:42 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-54eaaf30-fcf7-436f-8ee4-a50dfd8e28f0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Attempting to detach device vdc from instance 02227d9f-5ddf-42fe-91a8-ce56d76aa274 from the persistent domain config. {{(pid=72773) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-54eaaf30-fcf7-436f-8ee4-a50dfd8e28f0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:30:42 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:30:42 user nova-compute[72773]:   <source dev="/dev/sdh"/>
Aug 16 22:30:42 user nova-compute[72773]:   <target dev="vdc" bus="virtio"/>
Aug 16 22:30:42 user nova-compute[72773]:   <serial>33b7060b-4d09-4bef-b22e-75ca0372f0b2</serial>
Aug 16 22:30:42 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 22:30:42 user nova-compute[72773]: </disk>
Aug 16 22:30:42 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:30:42 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-54eaaf30-fcf7-436f-8ee4-a50dfd8e28f0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Successfully detached device vdc from instance 02227d9f-5ddf-42fe-91a8-ce56d76aa274 from the persistent domain config.
Aug 16 22:30:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-54eaaf30-fcf7-436f-8ee4-a50dfd8e28f0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 02227d9f-5ddf-42fe-91a8-ce56d76aa274 from the live domain config. {{(pid=72773) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-54eaaf30-fcf7-436f-8ee4-a50dfd8e28f0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:30:42 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:30:42 user nova-compute[72773]:   <source dev="/dev/sdh"/>
Aug 16 22:30:42 user nova-compute[72773]:   <target dev="vdc" bus="virtio"/>
Aug 16 22:30:42 user nova-compute[72773]:   <serial>33b7060b-4d09-4bef-b22e-75ca0372f0b2</serial>
Aug 16 22:30:42 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 22:30:42 user nova-compute[72773]: </disk>
Aug 16 22:30:42 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb3e453-8d8c-44a4-b9b9-ee9803438613]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:42 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: None {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Received event <DeviceRemovedEvent: 1692225043.2683733, 02227d9f-5ddf-42fe-91a8-ce56d76aa274 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72773) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-54eaaf30-fcf7-436f-8ee4-a50dfd8e28f0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 02227d9f-5ddf-42fe-91a8-ce56d76aa274 {{(pid=72773) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 22:30:43 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-54eaaf30-fcf7-436f-8ee4-a50dfd8e28f0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Successfully detached device vdc from instance 02227d9f-5ddf-42fe-91a8-ce56d76aa274 from the live domain config.
Aug 16 22:30:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54eaaf30-fcf7-436f-8ee4-a50dfd8e28f0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-54eaaf30-fcf7-436f-8ee4-a50dfd8e28f0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IKVAGoxq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:30:43 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-54eaaf30-fcf7-436f-8ee4-a50dfd8e28f0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:30:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-54eaaf30-fcf7-436f-8ee4-a50dfd8e28f0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OaMlzoJg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '26233346338393064', 'path': '/dev/sdc'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233346338393064', 'path': '/dev/sdc'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-54eaaf30-fcf7-436f-8ee4-a50dfd8e28f0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.507s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-54eaaf30-fcf7-436f-8ee4-a50dfd8e28f0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc1789a-51eb-4dbc-95c5-8769aff591ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rVmzaLuT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:30:43 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:30:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e756b8f8-4cef-4988-83f5-bd33b75e877d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-54eaaf30-fcf7-436f-8ee4-a50dfd8e28f0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:30:43 user nova-compute[72773]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:30:43 user nova-compute[72773]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 (non-flash)
Aug 16 22:30:43 user nova-compute[72773]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 (non-flash)
Aug 16 22:30:43 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-54eaaf30-fcf7-436f-8ee4-a50dfd8e28f0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:30:43 user nova-compute[72773]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:30:43 user nova-compute[72773]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 (non-flash)
Aug 16 22:30:43 user nova-compute[72773]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 (non-flash)
Aug 16 22:30:43 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-54eaaf30-fcf7-436f-8ee4-a50dfd8e28f0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef5c443eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2'): ({'sdh'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-54eaaf30-fcf7-436f-8ee4-a50dfd8e28f0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Removing single pathed devices sdh {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffdbf25-ed31-47c3-ac86-a673667a0918]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e342093e-e333-45bd-ba5e-192e6bb141c6]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-54eaaf30-fcf7-436f-8ee4-a50dfd8e28f0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Flushing IO for device /dev/sdh {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d98ee8d-bfbe-4b7c-b212-b8ea081a3c13]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-54eaaf30-fcf7-436f-8ee4-a50dfd8e28f0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.040s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5aca7a-0ada-4631-9058-b9fd0b8f1ea6]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-54eaaf30-fcf7-436f-8ee4-a50dfd8e28f0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-54eaaf30-fcf7-436f-8ee4-a50dfd8e28f0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] SCSI volumes sdh have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-54eaaf30-fcf7-436f-8ee4-a50dfd8e28f0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34a1fca-6c5a-412d-8c17-eaea44115e7e]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-54eaaf30-fcf7-436f-8ee4-a50dfd8e28f0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:30:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[51745fe3-b7fa-4492-bce7-2dd2c7a25251]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-54eaaf30-fcf7-436f-8ee4-a50dfd8e28f0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2, portal: 172.16.0.220,3260]
Aug 16 22:30:44 user nova-compute[72773]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2, portal: 172.16.0.220,3260] successful.
Aug 16 22:30:44 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b7060b-4d09-4bef-b22e-75ca0372f0b2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9c7a0b-b758-4811-bcee-871219fc5309]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-54eaaf30-fcf7-436f-8ee4-a50dfd8e28f0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-54eaaf30-fcf7-436f-8ee4-a50dfd8e28f0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-54eaaf30-fcf7-436f-8ee4-a50dfd8e28f0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] <== disconnect_volume: return (799ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54eaaf30-fcf7-436f-8ee4-a50dfd8e28f0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.272s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:30:44 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:30:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:30:44 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[29736a27-438a-48dc-a681-8e2e520e097b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:30:44 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01d51c1-187b-479d-999c-9d7cd8a06954]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9] added
Aug 16 22:30:44 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[750262f6-0d41-4edb-985d-3cb3af6c74cb]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9070a17-fb7e-41c6-b273-28083496ca0c]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rVmzaLuT {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rVmzaLuT" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd668309-0e16-4711-a847-6fbf3c5b9ff9]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rVmzaLuT'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc3853e-27c1-4f3a-8db7-39e9d784f396]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c0c711-47d9-4aa9-b7bb-c2fc8bd951d6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:30:44 user nova-compute[72773]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:30:44 user nova-compute[72773]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 (non-flash)
Aug 16 22:30:44 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:30:44 user nova-compute[72773]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:30:44 user nova-compute[72773]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 (non-flash)
Aug 16 22:30:44 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb5fa21-2a3d-454f-a693-5811f15f46f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9, portal: 172.16.0.220,3260]
Aug 16 22:30:44 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9, portal: 172.16.0.220,3260] successful.
Aug 16 22:30:44 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9678c61b-e891-43b7-8b2a-b8673e704900]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a7db87-7adf-4c3d-b932-0ee9af009ce0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:30:44 user nova-compute[72773]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:30:44 user nova-compute[72773]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 (non-flash)
Aug 16 22:30:44 user nova-compute[72773]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 (non-flash)
Aug 16 22:30:44 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:30:44 user nova-compute[72773]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:30:44 user nova-compute[72773]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 (non-flash)
Aug 16 22:30:44 user nova-compute[72773]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 (non-flash)
Aug 16 22:30:44 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[83dd0688-3504-4396-9a1b-46c2c3cce214]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rVmzaLuT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG nova.objects.instance [None req-54eaaf30-fcf7-436f-8ee4-a50dfd8e28f0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lazy-loading 'flavor' on Instance uuid 02227d9f-5ddf-42fe-91a8-ce56d76aa274 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:30:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-54eaaf30-fcf7-436f-8ee4-a50dfd8e28f0 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.305s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] <== connect_volume: return (1624ms) {'type': 'block', 'scsi_wwn': '23632333462643665', 'path': '/dev/sdd'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632333462643665', 'path': '/dev/sdd'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egwoqQcJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:30:45 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:30:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:30:45 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:30:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:30:45 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:30:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc29de8-5800-4680-b61a-851474d74485]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:30:45 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31bc4a0-4a33-4b23-9383-50e9c0843138]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d] added
Aug 16 22:30:45 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72ad57b-3372-4da9-85c3-bd259917dcc5]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb04fa1-1f80-4be0-af25-631472cf6579]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v egwoqQcJ {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v egwoqQcJ" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90fb194-21fa-48a3-a7dd-22536b31f05c]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'egwoqQcJ'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4592a0a0-cc8c-42f2-961e-b30e2d5211c2]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f593bb-23db-42cf-acf5-41b0df25ec2a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:30:45 user nova-compute[72773]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:30:45 user nova-compute[72773]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 (non-flash)
Aug 16 22:30:45 user nova-compute[72773]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 (non-flash)
Aug 16 22:30:45 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:30:45 user nova-compute[72773]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:30:45 user nova-compute[72773]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 (non-flash)
Aug 16 22:30:45 user nova-compute[72773]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 (non-flash)
Aug 16 22:30:45 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[feafde77-0d50-46d6-85dc-132b67e156d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d, portal: 172.16.0.220,3260]
Aug 16 22:30:45 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d, portal: 172.16.0.220,3260] successful.
Aug 16 22:30:45 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c457a8-63fd-4a5e-a19a-a12f48f8183c]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[35faaaad-ba15-4299-9b1b-7112ff2eb275]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:30:45 user nova-compute[72773]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:30:45 user nova-compute[72773]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 (non-flash)
Aug 16 22:30:45 user nova-compute[72773]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 (non-flash)
Aug 16 22:30:45 user nova-compute[72773]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d (non-flash)
Aug 16 22:30:45 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:30:45 user nova-compute[72773]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:30:45 user nova-compute[72773]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 (non-flash)
Aug 16 22:30:45 user nova-compute[72773]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 (non-flash)
Aug 16 22:30:45 user nova-compute[72773]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d (non-flash)
Aug 16 22:30:45 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] HCTL ('36', '-', '-', 0) found on session 20 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afb3af4-bb7e-4530-b245-fff33da789f9]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:30:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egwoqQcJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Cleaning up deleted instances with incomplete migration  {{(pid=72773) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23266623435353931', 'path': '/dev/sde'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266623435353931', 'path': '/dev/sde'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:29:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765625997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765625997',id=16,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMScjTcOHYjO3eWRs/Yuo7fSh7MpfYYQLIrHFfw9fG9QqwSK31lTCad/jiuVUnjerxxkGXkhhw4WPLykaRhxGmubPPDDZ3Tm+anQtKHRudc+w9uSIuAED6NyB/kjjLGhNQ==',key_name='tempest-keypair-941332691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3a13289351c4eb58e8a2b56e83763fd',ramdisk_id='',reservation_id='r-5o83v8o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-712587175',owner_user_name='tempest-TaggedBootDevicesTest_v242-712587175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:29:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4682d0544d4646099b16e3af92d6cc39',uuid=5aa5adad-599d-424f-bbfc-7d87ead31b57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b47506d5-cd81-498a-8f7b-d735d0601f49", "address": "fa:16:3e:14:c3:e5", "network": {"id": "8b3d0165-9b35-42e8-bb94-f9cb7d76409d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1320393408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47506d5-cd", "ovs_interfaceid": "b47506d5-cd81-498a-8f7b-d735d0601f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converting VIF {"id": "b47506d5-cd81-498a-8f7b-d735d0601f49", "address": "fa:16:3e:14:c3:e5", "network": {"id": "8b3d0165-9b35-42e8-bb94-f9cb7d76409d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1320393408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47506d5-cd", "ovs_interfaceid": "b47506d5-cd81-498a-8f7b-d735d0601f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:c3:e5,bridge_name='br-int',has_traffic_filtering=True,id=b47506d5-cd81-498a-8f7b-d735d0601f49,network=Network(8b3d0165-9b35-42e8-bb94-f9cb7d76409d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb47506d5-cd') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:29:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765625997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765625997',id=16,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMScjTcOHYjO3eWRs/Yuo7fSh7MpfYYQLIrHFfw9fG9QqwSK31lTCad/jiuVUnjerxxkGXkhhw4WPLykaRhxGmubPPDDZ3Tm+anQtKHRudc+w9uSIuAED6NyB/kjjLGhNQ==',key_name='tempest-keypair-941332691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3a13289351c4eb58e8a2b56e83763fd',ramdisk_id='',reservation_id='r-5o83v8o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-712587175',owner_user_name='tempest-TaggedBootDevicesTest_v242-712587175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:29:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4682d0544d4646099b16e3af92d6cc39',uuid=5aa5adad-599d-424f-bbfc-7d87ead31b57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4188d812-137b-448e-acb1-42dea2d8eb91", "address": "fa:16:3e:0f:fc:e8", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4188d812-13", "ovs_interfaceid": "4188d812-137b-448e-acb1-42dea2d8eb91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converting VIF {"id": "4188d812-137b-448e-acb1-42dea2d8eb91", "address": "fa:16:3e:0f:fc:e8", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4188d812-13", "ovs_interfaceid": "4188d812-137b-448e-acb1-42dea2d8eb91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:fc:e8,bridge_name='br-int',has_traffic_filtering=True,id=4188d812-137b-448e-acb1-42dea2d8eb91,network=Network(2b2b1125-d184-44d3-9cfd-0b0808ce15f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4188d812-13') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:29:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765625997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765625997',id=16,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMScjTcOHYjO3eWRs/Yuo7fSh7MpfYYQLIrHFfw9fG9QqwSK31lTCad/jiuVUnjerxxkGXkhhw4WPLykaRhxGmubPPDDZ3Tm+anQtKHRudc+w9uSIuAED6NyB/kjjLGhNQ==',key_name='tempest-keypair-941332691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3a13289351c4eb58e8a2b56e83763fd',ramdisk_id='',reservation_id='r-5o83v8o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-712587175',owner_user_name='tempest-TaggedBootDevicesTest_v242-712587175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:29:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4682d0544d4646099b16e3af92d6cc39',uuid=5aa5adad-599d-424f-bbfc-7d87ead31b57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dc74ea7-4f01-465f-8e7a-f5b4299ace47", "address": "fa:16:3e:cc:b0:44", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc74ea7-4f", "ovs_interfaceid": "2dc74ea7-4f01-465f-8e7a-f5b4299ace47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converting VIF {"id": "2dc74ea7-4f01-465f-8e7a-f5b4299ace47", "address": "fa:16:3e:cc:b0:44", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc74ea7-4f", "ovs_interfaceid": "2dc74ea7-4f01-465f-8e7a-f5b4299ace47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:b0:44,bridge_name='br-int',has_traffic_filtering=True,id=2dc74ea7-4f01-465f-8e7a-f5b4299ace47,network=Network(2b2b1125-d184-44d3-9cfd-0b0808ce15f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2dc74ea7-4f') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:29:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765625997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765625997',id=16,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMScjTcOHYjO3eWRs/Yuo7fSh7MpfYYQLIrHFfw9fG9QqwSK31lTCad/jiuVUnjerxxkGXkhhw4WPLykaRhxGmubPPDDZ3Tm+anQtKHRudc+w9uSIuAED6NyB/kjjLGhNQ==',key_name='tempest-keypair-941332691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3a13289351c4eb58e8a2b56e83763fd',ramdisk_id='',reservation_id='r-5o83v8o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-712587175',owner_user_name='tempest-TaggedBootDevicesTest_v242-712587175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:29:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4682d0544d4646099b16e3af92d6cc39',uuid=5aa5adad-599d-424f-bbfc-7d87ead31b57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2581ab2b-5a7c-4c9a-8f59-f3c5a7228044", "address": "fa:16:3e:cc:9c:eb", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2581ab2b-5a", "ovs_interfaceid": "2581ab2b-5a7c-4c9a-8f59-f3c5a7228044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converting VIF {"id": "2581ab2b-5a7c-4c9a-8f59-f3c5a7228044", "address": "fa:16:3e:cc:9c:eb", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2581ab2b-5a", "ovs_interfaceid": "2581ab2b-5a7c-4c9a-8f59-f3c5a7228044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:9c:eb,bridge_name='br-int',has_traffic_filtering=True,id=2581ab2b-5a7c-4c9a-8f59-f3c5a7228044,network=Network(2b2b1125-d184-44d3-9cfd-0b0808ce15f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2581ab2b-5a') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:29:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765625997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765625997',id=16,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMScjTcOHYjO3eWRs/Yuo7fSh7MpfYYQLIrHFfw9fG9QqwSK31lTCad/jiuVUnjerxxkGXkhhw4WPLykaRhxGmubPPDDZ3Tm+anQtKHRudc+w9uSIuAED6NyB/kjjLGhNQ==',key_name='tempest-keypair-941332691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3a13289351c4eb58e8a2b56e83763fd',ramdisk_id='',reservation_id='r-5o83v8o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-712587175',owner_user_name='tempest-TaggedBootDevicesTest_v242-712587175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:29:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4682d0544d4646099b16e3af92d6cc39',uuid=5aa5adad-599d-424f-bbfc-7d87ead31b57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "464fb40c-7053-464f-b788-d285f283fb56", "address": "fa:16:3e:ce:aa:1f", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464fb40c-70", "ovs_interfaceid": "464fb40c-7053-464f-b788-d285f283fb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converting VIF {"id": "464fb40c-7053-464f-b788-d285f283fb56", "address": "fa:16:3e:ce:aa:1f", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464fb40c-70", "ovs_interfaceid": "464fb40c-7053-464f-b788-d285f283fb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:aa:1f,bridge_name='br-int',has_traffic_filtering=True,id=464fb40c-7053-464f-b788-d285f283fb56,network=Network(2b2b1125-d184-44d3-9cfd-0b0808ce15f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap464fb40c-70') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:29:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765625997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765625997',id=16,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMScjTcOHYjO3eWRs/Yuo7fSh7MpfYYQLIrHFfw9fG9QqwSK31lTCad/jiuVUnjerxxkGXkhhw4WPLykaRhxGmubPPDDZ3Tm+anQtKHRudc+w9uSIuAED6NyB/kjjLGhNQ==',key_name='tempest-keypair-941332691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3a13289351c4eb58e8a2b56e83763fd',ramdisk_id='',reservation_id='r-5o83v8o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-712587175',owner_user_name='tempest-TaggedBootDevicesTest_v242-712587175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:29:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4682d0544d4646099b16e3af92d6cc39',uuid=5aa5adad-599d-424f-bbfc-7d87ead31b57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44f58154-ceae-45ef-a169-0681e0e9a3fb", "address": "fa:16:3e:95:7a:63", "network": {"id": "a2682c6d-c949-41e3-8efe-546921aea554", "bridge": "br-int", "label": "tempest-device-tagging-net2-870198650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44f58154-ce", "ovs_interfaceid": "44f58154-ceae-45ef-a169-0681e0e9a3fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converting VIF {"id": "44f58154-ceae-45ef-a169-0681e0e9a3fb", "address": "fa:16:3e:95:7a:63", "network": {"id": "a2682c6d-c949-41e3-8efe-546921aea554", "bridge": "br-int", "label": "tempest-device-tagging-net2-870198650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44f58154-ce", "ovs_interfaceid": "44f58154-ceae-45ef-a169-0681e0e9a3fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:7a:63,bridge_name='br-int',has_traffic_filtering=True,id=44f58154-ceae-45ef-a169-0681e0e9a3fb,network=Network(a2682c6d-c949-41e3-8efe-546921aea554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44f58154-ce') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:29:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765625997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765625997',id=16,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMScjTcOHYjO3eWRs/Yuo7fSh7MpfYYQLIrHFfw9fG9QqwSK31lTCad/jiuVUnjerxxkGXkhhw4WPLykaRhxGmubPPDDZ3Tm+anQtKHRudc+w9uSIuAED6NyB/kjjLGhNQ==',key_name='tempest-keypair-941332691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3a13289351c4eb58e8a2b56e83763fd',ramdisk_id='',reservation_id='r-5o83v8o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-712587175',owner_user_name='tempest-TaggedBootDevicesTest_v242-712587175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:29:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4682d0544d4646099b16e3af92d6cc39',uuid=5aa5adad-599d-424f-bbfc-7d87ead31b57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0230e8bd-c876-4793-96f6-9ccc72deaa73", "address": "fa:16:3e:9d:92:42", "network": {"id": "a2682c6d-c949-41e3-8efe-546921aea554", "bridge": "br-int", "label": "tempest-device-tagging-net2-870198650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0230e8bd-c8", "ovs_interfaceid": "0230e8bd-c876-4793-96f6-9ccc72deaa73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converting VIF {"id": "0230e8bd-c876-4793-96f6-9ccc72deaa73", "address": "fa:16:3e:9d:92:42", "network": {"id": "a2682c6d-c949-41e3-8efe-546921aea554", "bridge": "br-int", "label": "tempest-device-tagging-net2-870198650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0230e8bd-c8", "ovs_interfaceid": "0230e8bd-c876-4793-96f6-9ccc72deaa73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:92:42,bridge_name='br-int',has_traffic_filtering=True,id=0230e8bd-c876-4793-96f6-9ccc72deaa73,network=Network(a2682c6d-c949-41e3-8efe-546921aea554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0230e8bd-c8') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.objects.instance [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Lazy-loading 'pci_devices' on Instance uuid 5aa5adad-599d-424f-bbfc-7d87ead31b57 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:30:46 user nova-compute[72773]:   <uuid>5aa5adad-599d-424f-bbfc-7d87ead31b57</uuid>
Aug 16 22:30:46 user nova-compute[72773]:   <name>instance-00000010</name>
Aug 16 22:30:46 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:30:46 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:30:46 user nova-compute[72773]:   <metadata>
Aug 16 22:30:46 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:30:46 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:30:46 user nova-compute[72773]:       <nova:name>tempest-device-tagging-server-1765625997</nova:name>
Aug 16 22:30:46 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:30:42</nova:creationTime>
Aug 16 22:30:46 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:30:46 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:30:46 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:30:46 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:30:46 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:30:46 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:30:46 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:30:46 user nova-compute[72773]:       <nova:owner>
Aug 16 22:30:46 user nova-compute[72773]:         <nova:user uuid="4682d0544d4646099b16e3af92d6cc39">tempest-TaggedBootDevicesTest_v242-712587175-project-member</nova:user>
Aug 16 22:30:46 user nova-compute[72773]:         <nova:project uuid="b3a13289351c4eb58e8a2b56e83763fd">tempest-TaggedBootDevicesTest_v242-712587175</nova:project>
Aug 16 22:30:46 user nova-compute[72773]:       </nova:owner>
Aug 16 22:30:46 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:30:46 user nova-compute[72773]:       <nova:ports>
Aug 16 22:30:46 user nova-compute[72773]:         <nova:port uuid="b47506d5-cd81-498a-8f7b-d735d0601f49">
Aug 16 22:30:46 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 22:30:46 user nova-compute[72773]:         </nova:port>
Aug 16 22:30:46 user nova-compute[72773]:         <nova:port uuid="4188d812-137b-448e-acb1-42dea2d8eb91">
Aug 16 22:30:46 user nova-compute[72773]:           <nova:ip type="fixed" address="10.1.1.249" ipVersion="4"/>
Aug 16 22:30:46 user nova-compute[72773]:         </nova:port>
Aug 16 22:30:46 user nova-compute[72773]:         <nova:port uuid="2dc74ea7-4f01-465f-8e7a-f5b4299ace47">
Aug 16 22:30:46 user nova-compute[72773]:           <nova:ip type="fixed" address="10.1.1.53" ipVersion="4"/>
Aug 16 22:30:46 user nova-compute[72773]:         </nova:port>
Aug 16 22:30:46 user nova-compute[72773]:         <nova:port uuid="2581ab2b-5a7c-4c9a-8f59-f3c5a7228044">
Aug 16 22:30:46 user nova-compute[72773]:           <nova:ip type="fixed" address="10.1.1.124" ipVersion="4"/>
Aug 16 22:30:46 user nova-compute[72773]:         </nova:port>
Aug 16 22:30:46 user nova-compute[72773]:         <nova:port uuid="464fb40c-7053-464f-b788-d285f283fb56">
Aug 16 22:30:46 user nova-compute[72773]:           <nova:ip type="fixed" address="10.1.1.62" ipVersion="4"/>
Aug 16 22:30:46 user nova-compute[72773]:         </nova:port>
Aug 16 22:30:46 user nova-compute[72773]:         <nova:port uuid="44f58154-ceae-45ef-a169-0681e0e9a3fb">
Aug 16 22:30:46 user nova-compute[72773]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 16 22:30:46 user nova-compute[72773]:         </nova:port>
Aug 16 22:30:46 user nova-compute[72773]:         <nova:port uuid="0230e8bd-c876-4793-96f6-9ccc72deaa73">
Aug 16 22:30:46 user nova-compute[72773]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 16 22:30:46 user nova-compute[72773]:         </nova:port>
Aug 16 22:30:46 user nova-compute[72773]:       </nova:ports>
Aug 16 22:30:46 user nova-compute[72773]:     </nova:instance>
Aug 16 22:30:46 user nova-compute[72773]:   </metadata>
Aug 16 22:30:46 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:30:46 user nova-compute[72773]:     <system>
Aug 16 22:30:46 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:30:46 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:30:46 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:30:46 user nova-compute[72773]:       <entry name="serial">5aa5adad-599d-424f-bbfc-7d87ead31b57</entry>
Aug 16 22:30:46 user nova-compute[72773]:       <entry name="uuid">5aa5adad-599d-424f-bbfc-7d87ead31b57</entry>
Aug 16 22:30:46 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:30:46 user nova-compute[72773]:     </system>
Aug 16 22:30:46 user nova-compute[72773]:   </sysinfo>
Aug 16 22:30:46 user nova-compute[72773]:   <os>
Aug 16 22:30:46 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:30:46 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:30:46 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:30:46 user nova-compute[72773]:   </os>
Aug 16 22:30:46 user nova-compute[72773]:   <features>
Aug 16 22:30:46 user nova-compute[72773]:     <acpi/>
Aug 16 22:30:46 user nova-compute[72773]:     <apic/>
Aug 16 22:30:46 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:30:46 user nova-compute[72773]:   </features>
Aug 16 22:30:46 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:30:46 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:30:46 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:30:46 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:30:46 user nova-compute[72773]:   </clock>
Aug 16 22:30:46 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:30:46 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:30:46 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:30:46 user nova-compute[72773]:   </cpu>
Aug 16 22:30:46 user nova-compute[72773]:   <devices>
Aug 16 22:30:46 user nova-compute[72773]:     <disk type="file" device="cdrom">
Aug 16 22:30:46 user nova-compute[72773]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 22:30:46 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/5aa5adad-599d-424f-bbfc-7d87ead31b57/disk.config"/>
Aug 16 22:30:46 user nova-compute[72773]:       <target dev="hda" bus="ide"/>
Aug 16 22:30:46 user nova-compute[72773]:     </disk>
Aug 16 22:30:46 user nova-compute[72773]:     <disk type="block" device="disk">
Aug 16 22:30:46 user nova-compute[72773]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:30:46 user nova-compute[72773]:       <source dev="/dev/sdc"/>
Aug 16 22:30:46 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:30:46 user nova-compute[72773]:       <serial>5c7ee644-475f-4522-adf6-704098fbda77</serial>
Aug 16 22:30:46 user nova-compute[72773]:     </disk>
Aug 16 22:30:46 user nova-compute[72773]:     <disk type="block" device="disk">
Aug 16 22:30:46 user nova-compute[72773]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:30:46 user nova-compute[72773]:       <source dev="/dev/sdd"/>
Aug 16 22:30:46 user nova-compute[72773]:       <target dev="vdb" bus="virtio"/>
Aug 16 22:30:46 user nova-compute[72773]:       <serial>a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9</serial>
Aug 16 22:30:46 user nova-compute[72773]:     </disk>
Aug 16 22:30:46 user nova-compute[72773]:     <disk type="block" device="disk">
Aug 16 22:30:46 user nova-compute[72773]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:30:46 user nova-compute[72773]:       <source dev="/dev/sde"/>
Aug 16 22:30:46 user nova-compute[72773]:       <target dev="vdc" bus="virtio"/>
Aug 16 22:30:46 user nova-compute[72773]:       <serial>e8c0936b-a479-498d-bd29-84f5509e841d</serial>
Aug 16 22:30:46 user nova-compute[72773]:     </disk>
Aug 16 22:30:46 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:30:46 user nova-compute[72773]:       <mac address="fa:16:3e:14:c3:e5"/>
Aug 16 22:30:46 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:30:46 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:30:46 user nova-compute[72773]:       <target dev="tapb47506d5-cd"/>
Aug 16 22:30:46 user nova-compute[72773]:     </interface>
Aug 16 22:30:46 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:30:46 user nova-compute[72773]:       <mac address="fa:16:3e:0f:fc:e8"/>
Aug 16 22:30:46 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:30:46 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:30:46 user nova-compute[72773]:       <target dev="tap4188d812-13"/>
Aug 16 22:30:46 user nova-compute[72773]:     </interface>
Aug 16 22:30:46 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:30:46 user nova-compute[72773]:       <mac address="fa:16:3e:cc:b0:44"/>
Aug 16 22:30:46 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:30:46 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:30:46 user nova-compute[72773]:       <target dev="tap2dc74ea7-4f"/>
Aug 16 22:30:46 user nova-compute[72773]:     </interface>
Aug 16 22:30:46 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:30:46 user nova-compute[72773]:       <mac address="fa:16:3e:cc:9c:eb"/>
Aug 16 22:30:46 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:30:46 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:30:46 user nova-compute[72773]:       <target dev="tap2581ab2b-5a"/>
Aug 16 22:30:46 user nova-compute[72773]:     </interface>
Aug 16 22:30:46 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:30:46 user nova-compute[72773]:       <mac address="fa:16:3e:ce:aa:1f"/>
Aug 16 22:30:46 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:30:46 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:30:46 user nova-compute[72773]:       <target dev="tap464fb40c-70"/>
Aug 16 22:30:46 user nova-compute[72773]:     </interface>
Aug 16 22:30:46 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:30:46 user nova-compute[72773]:       <mac address="fa:16:3e:95:7a:63"/>
Aug 16 22:30:46 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:30:46 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:30:46 user nova-compute[72773]:       <target dev="tap44f58154-ce"/>
Aug 16 22:30:46 user nova-compute[72773]:     </interface>
Aug 16 22:30:46 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:30:46 user nova-compute[72773]:       <mac address="fa:16:3e:9d:92:42"/>
Aug 16 22:30:46 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:30:46 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:30:46 user nova-compute[72773]:       <target dev="tap0230e8bd-c8"/>
Aug 16 22:30:46 user nova-compute[72773]:     </interface>
Aug 16 22:30:46 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:30:46 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/5aa5adad-599d-424f-bbfc-7d87ead31b57/console.log" append="off"/>
Aug 16 22:30:46 user nova-compute[72773]:     </serial>
Aug 16 22:30:46 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:30:46 user nova-compute[72773]:     <video>
Aug 16 22:30:46 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:30:46 user nova-compute[72773]:     </video>
Aug 16 22:30:46 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:30:46 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:30:46 user nova-compute[72773]:     </rng>
Aug 16 22:30:46 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:30:46 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:30:46 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:30:46 user nova-compute[72773]:     </memballoon>
Aug 16 22:30:46 user nova-compute[72773]:   </devices>
Aug 16 22:30:46 user nova-compute[72773]: </domain>
Aug 16 22:30:46 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:29:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765625997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765625997',id=16,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMScjTcOHYjO3eWRs/Yuo7fSh7MpfYYQLIrHFfw9fG9QqwSK31lTCad/jiuVUnjerxxkGXkhhw4WPLykaRhxGmubPPDDZ3Tm+anQtKHRudc+w9uSIuAED6NyB/kjjLGhNQ==',key_name='tempest-keypair-941332691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3a13289351c4eb58e8a2b56e83763fd',ramdisk_id='',reservation_id='r-5o83v8o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-712587175',owner_user_name='tempest-TaggedBootDevicesTest_v242-712587175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:29:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4682d0544d4646099b16e3af92d6cc39',uuid=5aa5adad-599d-424f-bbfc-7d87ead31b57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b47506d5-cd81-498a-8f7b-d735d0601f49", "address": "fa:16:3e:14:c3:e5", "network": {"id": "8b3d0165-9b35-42e8-bb94-f9cb7d76409d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1320393408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47506d5-cd", "ovs_interfaceid": "b47506d5-cd81-498a-8f7b-d735d0601f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converting VIF {"id": "b47506d5-cd81-498a-8f7b-d735d0601f49", "address": "fa:16:3e:14:c3:e5", "network": {"id": "8b3d0165-9b35-42e8-bb94-f9cb7d76409d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1320393408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47506d5-cd", "ovs_interfaceid": "b47506d5-cd81-498a-8f7b-d735d0601f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:c3:e5,bridge_name='br-int',has_traffic_filtering=True,id=b47506d5-cd81-498a-8f7b-d735d0601f49,network=Network(8b3d0165-9b35-42e8-bb94-f9cb7d76409d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb47506d5-cd') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG os_vif [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:c3:e5,bridge_name='br-int',has_traffic_filtering=True,id=b47506d5-cd81-498a-8f7b-d735d0601f49,network=Network(8b3d0165-9b35-42e8-bb94-f9cb7d76409d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb47506d5-cd') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb47506d5-cd, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb47506d5-cd, col_values=(('external_ids', {'iface-id': 'b47506d5-cd81-498a-8f7b-d735d0601f49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:c3:e5', 'vm-uuid': '5aa5adad-599d-424f-bbfc-7d87ead31b57'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:46 user nova-compute[72773]: INFO os_vif [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:c3:e5,bridge_name='br-int',has_traffic_filtering=True,id=b47506d5-cd81-498a-8f7b-d735d0601f49,network=Network(8b3d0165-9b35-42e8-bb94-f9cb7d76409d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb47506d5-cd')
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:29:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765625997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765625997',id=16,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMScjTcOHYjO3eWRs/Yuo7fSh7MpfYYQLIrHFfw9fG9QqwSK31lTCad/jiuVUnjerxxkGXkhhw4WPLykaRhxGmubPPDDZ3Tm+anQtKHRudc+w9uSIuAED6NyB/kjjLGhNQ==',key_name='tempest-keypair-941332691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3a13289351c4eb58e8a2b56e83763fd',ramdisk_id='',reservation_id='r-5o83v8o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-712587175',owner_user_name='tempest-TaggedBootDevicesTest_v242-712587175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:29:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4682d0544d4646099b16e3af92d6cc39',uuid=5aa5adad-599d-424f-bbfc-7d87ead31b57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4188d812-137b-448e-acb1-42dea2d8eb91", "address": "fa:16:3e:0f:fc:e8", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4188d812-13", "ovs_interfaceid": "4188d812-137b-448e-acb1-42dea2d8eb91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converting VIF {"id": "4188d812-137b-448e-acb1-42dea2d8eb91", "address": "fa:16:3e:0f:fc:e8", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4188d812-13", "ovs_interfaceid": "4188d812-137b-448e-acb1-42dea2d8eb91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:fc:e8,bridge_name='br-int',has_traffic_filtering=True,id=4188d812-137b-448e-acb1-42dea2d8eb91,network=Network(2b2b1125-d184-44d3-9cfd-0b0808ce15f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4188d812-13') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG os_vif [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:fc:e8,bridge_name='br-int',has_traffic_filtering=True,id=4188d812-137b-448e-acb1-42dea2d8eb91,network=Network(2b2b1125-d184-44d3-9cfd-0b0808ce15f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4188d812-13') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4188d812-13, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4188d812-13, col_values=(('external_ids', {'iface-id': '4188d812-137b-448e-acb1-42dea2d8eb91', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:fc:e8', 'vm-uuid': '5aa5adad-599d-424f-bbfc-7d87ead31b57'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:46 user nova-compute[72773]: INFO os_vif [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:fc:e8,bridge_name='br-int',has_traffic_filtering=True,id=4188d812-137b-448e-acb1-42dea2d8eb91,network=Network(2b2b1125-d184-44d3-9cfd-0b0808ce15f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4188d812-13')
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:29:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765625997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765625997',id=16,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMScjTcOHYjO3eWRs/Yuo7fSh7MpfYYQLIrHFfw9fG9QqwSK31lTCad/jiuVUnjerxxkGXkhhw4WPLykaRhxGmubPPDDZ3Tm+anQtKHRudc+w9uSIuAED6NyB/kjjLGhNQ==',key_name='tempest-keypair-941332691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3a13289351c4eb58e8a2b56e83763fd',ramdisk_id='',reservation_id='r-5o83v8o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-712587175',owner_user_name='tempest-TaggedBootDevicesTest_v242-712587175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:29:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4682d0544d4646099b16e3af92d6cc39',uuid=5aa5adad-599d-424f-bbfc-7d87ead31b57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dc74ea7-4f01-465f-8e7a-f5b4299ace47", "address": "fa:16:3e:cc:b0:44", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc74ea7-4f", "ovs_interfaceid": "2dc74ea7-4f01-465f-8e7a-f5b4299ace47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converting VIF {"id": "2dc74ea7-4f01-465f-8e7a-f5b4299ace47", "address": "fa:16:3e:cc:b0:44", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc74ea7-4f", "ovs_interfaceid": "2dc74ea7-4f01-465f-8e7a-f5b4299ace47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:b0:44,bridge_name='br-int',has_traffic_filtering=True,id=2dc74ea7-4f01-465f-8e7a-f5b4299ace47,network=Network(2b2b1125-d184-44d3-9cfd-0b0808ce15f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2dc74ea7-4f') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG os_vif [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:b0:44,bridge_name='br-int',has_traffic_filtering=True,id=2dc74ea7-4f01-465f-8e7a-f5b4299ace47,network=Network(2b2b1125-d184-44d3-9cfd-0b0808ce15f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2dc74ea7-4f') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2dc74ea7-4f, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2dc74ea7-4f, col_values=(('external_ids', {'iface-id': '2dc74ea7-4f01-465f-8e7a-f5b4299ace47', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:b0:44', 'vm-uuid': '5aa5adad-599d-424f-bbfc-7d87ead31b57'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:46 user nova-compute[72773]: INFO os_vif [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:b0:44,bridge_name='br-int',has_traffic_filtering=True,id=2dc74ea7-4f01-465f-8e7a-f5b4299ace47,network=Network(2b2b1125-d184-44d3-9cfd-0b0808ce15f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2dc74ea7-4f')
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:29:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765625997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765625997',id=16,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMScjTcOHYjO3eWRs/Yuo7fSh7MpfYYQLIrHFfw9fG9QqwSK31lTCad/jiuVUnjerxxkGXkhhw4WPLykaRhxGmubPPDDZ3Tm+anQtKHRudc+w9uSIuAED6NyB/kjjLGhNQ==',key_name='tempest-keypair-941332691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3a13289351c4eb58e8a2b56e83763fd',ramdisk_id='',reservation_id='r-5o83v8o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-712587175',owner_user_name='tempest-TaggedBootDevicesTest_v242-712587175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:29:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4682d0544d4646099b16e3af92d6cc39',uuid=5aa5adad-599d-424f-bbfc-7d87ead31b57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2581ab2b-5a7c-4c9a-8f59-f3c5a7228044", "address": "fa:16:3e:cc:9c:eb", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2581ab2b-5a", "ovs_interfaceid": "2581ab2b-5a7c-4c9a-8f59-f3c5a7228044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converting VIF {"id": "2581ab2b-5a7c-4c9a-8f59-f3c5a7228044", "address": "fa:16:3e:cc:9c:eb", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2581ab2b-5a", "ovs_interfaceid": "2581ab2b-5a7c-4c9a-8f59-f3c5a7228044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:9c:eb,bridge_name='br-int',has_traffic_filtering=True,id=2581ab2b-5a7c-4c9a-8f59-f3c5a7228044,network=Network(2b2b1125-d184-44d3-9cfd-0b0808ce15f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2581ab2b-5a') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG os_vif [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:9c:eb,bridge_name='br-int',has_traffic_filtering=True,id=2581ab2b-5a7c-4c9a-8f59-f3c5a7228044,network=Network(2b2b1125-d184-44d3-9cfd-0b0808ce15f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2581ab2b-5a') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2581ab2b-5a, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2581ab2b-5a, col_values=(('external_ids', {'iface-id': '2581ab2b-5a7c-4c9a-8f59-f3c5a7228044', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:9c:eb', 'vm-uuid': '5aa5adad-599d-424f-bbfc-7d87ead31b57'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:30:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:47 user nova-compute[72773]: INFO os_vif [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:9c:eb,bridge_name='br-int',has_traffic_filtering=True,id=2581ab2b-5a7c-4c9a-8f59-f3c5a7228044,network=Network(2b2b1125-d184-44d3-9cfd-0b0808ce15f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2581ab2b-5a')
Aug 16 22:30:47 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:29:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765625997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765625997',id=16,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMScjTcOHYjO3eWRs/Yuo7fSh7MpfYYQLIrHFfw9fG9QqwSK31lTCad/jiuVUnjerxxkGXkhhw4WPLykaRhxGmubPPDDZ3Tm+anQtKHRudc+w9uSIuAED6NyB/kjjLGhNQ==',key_name='tempest-keypair-941332691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3a13289351c4eb58e8a2b56e83763fd',ramdisk_id='',reservation_id='r-5o83v8o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-712587175',owner_user_name='tempest-TaggedBootDevicesTest_v242-712587175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:29:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4682d0544d4646099b16e3af92d6cc39',uuid=5aa5adad-599d-424f-bbfc-7d87ead31b57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "464fb40c-7053-464f-b788-d285f283fb56", "address": "fa:16:3e:ce:aa:1f", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464fb40c-70", "ovs_interfaceid": "464fb40c-7053-464f-b788-d285f283fb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converting VIF {"id": "464fb40c-7053-464f-b788-d285f283fb56", "address": "fa:16:3e:ce:aa:1f", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464fb40c-70", "ovs_interfaceid": "464fb40c-7053-464f-b788-d285f283fb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:aa:1f,bridge_name='br-int',has_traffic_filtering=True,id=464fb40c-7053-464f-b788-d285f283fb56,network=Network(2b2b1125-d184-44d3-9cfd-0b0808ce15f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap464fb40c-70') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG os_vif [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:aa:1f,bridge_name='br-int',has_traffic_filtering=True,id=464fb40c-7053-464f-b788-d285f283fb56,network=Network(2b2b1125-d184-44d3-9cfd-0b0808ce15f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap464fb40c-70') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap464fb40c-70, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap464fb40c-70, col_values=(('external_ids', {'iface-id': '464fb40c-7053-464f-b788-d285f283fb56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:aa:1f', 'vm-uuid': '5aa5adad-599d-424f-bbfc-7d87ead31b57'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:47 user nova-compute[72773]: INFO os_vif [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:aa:1f,bridge_name='br-int',has_traffic_filtering=True,id=464fb40c-7053-464f-b788-d285f283fb56,network=Network(2b2b1125-d184-44d3-9cfd-0b0808ce15f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap464fb40c-70')
Aug 16 22:30:47 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:29:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765625997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765625997',id=16,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMScjTcOHYjO3eWRs/Yuo7fSh7MpfYYQLIrHFfw9fG9QqwSK31lTCad/jiuVUnjerxxkGXkhhw4WPLykaRhxGmubPPDDZ3Tm+anQtKHRudc+w9uSIuAED6NyB/kjjLGhNQ==',key_name='tempest-keypair-941332691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3a13289351c4eb58e8a2b56e83763fd',ramdisk_id='',reservation_id='r-5o83v8o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-712587175',owner_user_name='tempest-TaggedBootDevicesTest_v242-712587175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:29:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4682d0544d4646099b16e3af92d6cc39',uuid=5aa5adad-599d-424f-bbfc-7d87ead31b57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44f58154-ceae-45ef-a169-0681e0e9a3fb", "address": "fa:16:3e:95:7a:63", "network": {"id": "a2682c6d-c949-41e3-8efe-546921aea554", "bridge": "br-int", "label": "tempest-device-tagging-net2-870198650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44f58154-ce", "ovs_interfaceid": "44f58154-ceae-45ef-a169-0681e0e9a3fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converting VIF {"id": "44f58154-ceae-45ef-a169-0681e0e9a3fb", "address": "fa:16:3e:95:7a:63", "network": {"id": "a2682c6d-c949-41e3-8efe-546921aea554", "bridge": "br-int", "label": "tempest-device-tagging-net2-870198650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44f58154-ce", "ovs_interfaceid": "44f58154-ceae-45ef-a169-0681e0e9a3fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:7a:63,bridge_name='br-int',has_traffic_filtering=True,id=44f58154-ceae-45ef-a169-0681e0e9a3fb,network=Network(a2682c6d-c949-41e3-8efe-546921aea554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44f58154-ce') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG os_vif [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:7a:63,bridge_name='br-int',has_traffic_filtering=True,id=44f58154-ceae-45ef-a169-0681e0e9a3fb,network=Network(a2682c6d-c949-41e3-8efe-546921aea554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44f58154-ce') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44f58154-ce, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap44f58154-ce, col_values=(('external_ids', {'iface-id': '44f58154-ceae-45ef-a169-0681e0e9a3fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:7a:63', 'vm-uuid': '5aa5adad-599d-424f-bbfc-7d87ead31b57'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:47 user nova-compute[72773]: INFO os_vif [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:7a:63,bridge_name='br-int',has_traffic_filtering=True,id=44f58154-ceae-45ef-a169-0681e0e9a3fb,network=Network(a2682c6d-c949-41e3-8efe-546921aea554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44f58154-ce')
Aug 16 22:30:47 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:29:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765625997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765625997',id=16,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMScjTcOHYjO3eWRs/Yuo7fSh7MpfYYQLIrHFfw9fG9QqwSK31lTCad/jiuVUnjerxxkGXkhhw4WPLykaRhxGmubPPDDZ3Tm+anQtKHRudc+w9uSIuAED6NyB/kjjLGhNQ==',key_name='tempest-keypair-941332691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3a13289351c4eb58e8a2b56e83763fd',ramdisk_id='',reservation_id='r-5o83v8o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-712587175',owner_user_name='tempest-TaggedBootDevicesTest_v242-712587175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:29:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4682d0544d4646099b16e3af92d6cc39',uuid=5aa5adad-599d-424f-bbfc-7d87ead31b57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0230e8bd-c876-4793-96f6-9ccc72deaa73", "address": "fa:16:3e:9d:92:42", "network": {"id": "a2682c6d-c949-41e3-8efe-546921aea554", "bridge": "br-int", "label": "tempest-device-tagging-net2-870198650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0230e8bd-c8", "ovs_interfaceid": "0230e8bd-c876-4793-96f6-9ccc72deaa73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converting VIF {"id": "0230e8bd-c876-4793-96f6-9ccc72deaa73", "address": "fa:16:3e:9d:92:42", "network": {"id": "a2682c6d-c949-41e3-8efe-546921aea554", "bridge": "br-int", "label": "tempest-device-tagging-net2-870198650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0230e8bd-c8", "ovs_interfaceid": "0230e8bd-c876-4793-96f6-9ccc72deaa73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:92:42,bridge_name='br-int',has_traffic_filtering=True,id=0230e8bd-c876-4793-96f6-9ccc72deaa73,network=Network(a2682c6d-c949-41e3-8efe-546921aea554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0230e8bd-c8') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG os_vif [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:92:42,bridge_name='br-int',has_traffic_filtering=True,id=0230e8bd-c876-4793-96f6-9ccc72deaa73,network=Network(a2682c6d-c949-41e3-8efe-546921aea554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0230e8bd-c8') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0230e8bd-c8, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0230e8bd-c8, col_values=(('external_ids', {'iface-id': '0230e8bd-c876-4793-96f6-9ccc72deaa73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:92:42', 'vm-uuid': '5aa5adad-599d-424f-bbfc-7d87ead31b57'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:47 user nova-compute[72773]: INFO os_vif [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:92:42,bridge_name='br-int',has_traffic_filtering=True,id=0230e8bd-c876-4793-96f6-9ccc72deaa73,network=Network(a2682c6d-c949-41e3-8efe-546921aea554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0230e8bd-c8')
Aug 16 22:30:47 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] No BDM found with device name hda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] No VIF found with MAC fa:16:3e:14:c3:e5, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] No VIF found with MAC fa:16:3e:ce:aa:1f, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:30:47 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Using config drive
Aug 16 22:30:47 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Creating config drive at /opt/stack/data/nova/instances/5aa5adad-599d-424f-bbfc-7d87ead31b57/disk.config
Aug 16 22:30:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5aa5adad-599d-424f-bbfc-7d87ead31b57/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxbe8cseb {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5aa5adad-599d-424f-bbfc-7d87ead31b57/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxbe8cseb" returned: 0 in 0.073s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:48 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:30:48 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:30:48 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:30:48 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Cleaning up deleted instances {{(pid=72773) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 22:30:48 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] There are 0 instances to clean {{(pid=72773) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 22:30:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:49 user nova-compute[72773]: DEBUG nova.compute.manager [req-8139805f-5810-4e13-9182-365ac796f944 req-4652129f-e350-4638-8e14-06804851ae11 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-plugged-b47506d5-cd81-498a-8f7b-d735d0601f49 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:30:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-8139805f-5810-4e13-9182-365ac796f944 req-4652129f-e350-4638-8e14-06804851ae11 service nova] Acquiring lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-8139805f-5810-4e13-9182-365ac796f944 req-4652129f-e350-4638-8e14-06804851ae11 service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-8139805f-5810-4e13-9182-365ac796f944 req-4652129f-e350-4638-8e14-06804851ae11 service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:49 user nova-compute[72773]: DEBUG nova.compute.manager [req-8139805f-5810-4e13-9182-365ac796f944 req-4652129f-e350-4638-8e14-06804851ae11 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] No waiting events found dispatching network-vif-plugged-b47506d5-cd81-498a-8f7b-d735d0601f49 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:30:49 user nova-compute[72773]: WARNING nova.compute.manager [req-8139805f-5810-4e13-9182-365ac796f944 req-4652129f-e350-4638-8e14-06804851ae11 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received unexpected event network-vif-plugged-b47506d5-cd81-498a-8f7b-d735d0601f49 for instance with vm_state building and task_state spawning.
Aug 16 22:30:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Acquiring lock "848668c7-4a90-4bb4-8617-3784cd33ed22" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "848668c7-4a90-4bb4-8617-3784cd33ed22" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:49 user nova-compute[72773]: DEBUG nova.compute.manager [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:30:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:50 user nova-compute[72773]: DEBUG nova.compute.manager [req-49b7897b-75d0-4446-95e6-1e268c88455e req-1f111e6c-2c6c-4034-9f79-b97e06351cf1 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-plugged-4188d812-137b-448e-acb1-42dea2d8eb91 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:30:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-49b7897b-75d0-4446-95e6-1e268c88455e req-1f111e6c-2c6c-4034-9f79-b97e06351cf1 service nova] Acquiring lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-49b7897b-75d0-4446-95e6-1e268c88455e req-1f111e6c-2c6c-4034-9f79-b97e06351cf1 service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-49b7897b-75d0-4446-95e6-1e268c88455e req-1f111e6c-2c6c-4034-9f79-b97e06351cf1 service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:50 user nova-compute[72773]: DEBUG nova.compute.manager [req-49b7897b-75d0-4446-95e6-1e268c88455e req-1f111e6c-2c6c-4034-9f79-b97e06351cf1 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] No waiting events found dispatching network-vif-plugged-4188d812-137b-448e-acb1-42dea2d8eb91 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:30:50 user nova-compute[72773]: WARNING nova.compute.manager [req-49b7897b-75d0-4446-95e6-1e268c88455e req-1f111e6c-2c6c-4034-9f79-b97e06351cf1 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received unexpected event network-vif-plugged-4188d812-137b-448e-acb1-42dea2d8eb91 for instance with vm_state building and task_state spawning.
Aug 16 22:30:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:50 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:30:50 user nova-compute[72773]: INFO nova.compute.claims [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Claim successful on node user
Aug 16 22:30:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:50 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Refreshing inventories for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 22:30:50 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Updating ProviderTree inventory for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 22:30:50 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Updating inventory in ProviderTree for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 22:30:50 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Refreshing aggregate associations for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e, aggregates: None {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 22:30:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:50 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:30:50 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:30:50 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:30:50 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Refreshing trait associations for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 22:30:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:50 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Didn't find any instances for network info cache update. {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 22:30:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:50 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:30:50 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:30:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.754s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:50 user nova-compute[72773]: DEBUG nova.compute.manager [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG nova.compute.manager [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG nova.network.neutron [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:30:51 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:30:51 user nova-compute[72773]: DEBUG nova.compute.manager [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG nova.compute.manager [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:30:51 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Creating image(s)
Aug 16 22:30:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Acquiring lock "/opt/stack/data/nova/instances/848668c7-4a90-4bb4-8617-3784cd33ed22/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "/opt/stack/data/nova/instances/848668c7-4a90-4bb4-8617-3784cd33ed22/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "/opt/stack/data/nova/instances/848668c7-4a90-4bb4-8617-3784cd33ed22/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG nova.policy [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '432dc5daebf442fba54be7f62f6bb09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b8417e50ee41e89fedf55e7134fecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.226s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG nova.compute.manager [req-5572e0cc-219c-40e7-93e8-98e385337387 req-c46f1001-36b3-4dd2-a99a-6ff9a70f002d service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-plugged-b47506d5-cd81-498a-8f7b-d735d0601f49 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5572e0cc-219c-40e7-93e8-98e385337387 req-c46f1001-36b3-4dd2-a99a-6ff9a70f002d service nova] Acquiring lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5572e0cc-219c-40e7-93e8-98e385337387 req-c46f1001-36b3-4dd2-a99a-6ff9a70f002d service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5572e0cc-219c-40e7-93e8-98e385337387 req-c46f1001-36b3-4dd2-a99a-6ff9a70f002d service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG nova.compute.manager [req-5572e0cc-219c-40e7-93e8-98e385337387 req-c46f1001-36b3-4dd2-a99a-6ff9a70f002d service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] No waiting events found dispatching network-vif-plugged-b47506d5-cd81-498a-8f7b-d735d0601f49 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:30:51 user nova-compute[72773]: WARNING nova.compute.manager [req-5572e0cc-219c-40e7-93e8-98e385337387 req-c46f1001-36b3-4dd2-a99a-6ff9a70f002d service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received unexpected event network-vif-plugged-b47506d5-cd81-498a-8f7b-d735d0601f49 for instance with vm_state building and task_state spawning.
Aug 16 22:30:51 user nova-compute[72773]: DEBUG nova.compute.manager [req-5572e0cc-219c-40e7-93e8-98e385337387 req-c46f1001-36b3-4dd2-a99a-6ff9a70f002d service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-plugged-464fb40c-7053-464f-b788-d285f283fb56 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5572e0cc-219c-40e7-93e8-98e385337387 req-c46f1001-36b3-4dd2-a99a-6ff9a70f002d service nova] Acquiring lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5572e0cc-219c-40e7-93e8-98e385337387 req-c46f1001-36b3-4dd2-a99a-6ff9a70f002d service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5572e0cc-219c-40e7-93e8-98e385337387 req-c46f1001-36b3-4dd2-a99a-6ff9a70f002d service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG nova.compute.manager [req-5572e0cc-219c-40e7-93e8-98e385337387 req-c46f1001-36b3-4dd2-a99a-6ff9a70f002d service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] No waiting events found dispatching network-vif-plugged-464fb40c-7053-464f-b788-d285f283fb56 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:30:51 user nova-compute[72773]: WARNING nova.compute.manager [req-5572e0cc-219c-40e7-93e8-98e385337387 req-c46f1001-36b3-4dd2-a99a-6ff9a70f002d service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received unexpected event network-vif-plugged-464fb40c-7053-464f-b788-d285f283fb56 for instance with vm_state building and task_state spawning.
Aug 16 22:30:51 user nova-compute[72773]: DEBUG nova.compute.manager [req-5572e0cc-219c-40e7-93e8-98e385337387 req-c46f1001-36b3-4dd2-a99a-6ff9a70f002d service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-plugged-464fb40c-7053-464f-b788-d285f283fb56 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5572e0cc-219c-40e7-93e8-98e385337387 req-c46f1001-36b3-4dd2-a99a-6ff9a70f002d service nova] Acquiring lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5572e0cc-219c-40e7-93e8-98e385337387 req-c46f1001-36b3-4dd2-a99a-6ff9a70f002d service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5572e0cc-219c-40e7-93e8-98e385337387 req-c46f1001-36b3-4dd2-a99a-6ff9a70f002d service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG nova.compute.manager [req-5572e0cc-219c-40e7-93e8-98e385337387 req-c46f1001-36b3-4dd2-a99a-6ff9a70f002d service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] No waiting events found dispatching network-vif-plugged-464fb40c-7053-464f-b788-d285f283fb56 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:30:51 user nova-compute[72773]: WARNING nova.compute.manager [req-5572e0cc-219c-40e7-93e8-98e385337387 req-c46f1001-36b3-4dd2-a99a-6ff9a70f002d service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received unexpected event network-vif-plugged-464fb40c-7053-464f-b788-d285f283fb56 for instance with vm_state building and task_state spawning.
Aug 16 22:30:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.223s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/848668c7-4a90-4bb4-8617-3784cd33ed22/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/848668c7-4a90-4bb4-8617-3784cd33ed22/disk 1073741824" returned: 0 in 0.058s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG nova.compute.manager [req-16291fb8-178a-45ef-95b6-87a3fd4d29ad req-4e4d19fa-f3bf-4227-aa42-745448f4ff17 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-plugged-0230e8bd-c876-4793-96f6-9ccc72deaa73 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-16291fb8-178a-45ef-95b6-87a3fd4d29ad req-4e4d19fa-f3bf-4227-aa42-745448f4ff17 service nova] Acquiring lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-16291fb8-178a-45ef-95b6-87a3fd4d29ad req-4e4d19fa-f3bf-4227-aa42-745448f4ff17 service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-16291fb8-178a-45ef-95b6-87a3fd4d29ad req-4e4d19fa-f3bf-4227-aa42-745448f4ff17 service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG nova.compute.manager [req-16291fb8-178a-45ef-95b6-87a3fd4d29ad req-4e4d19fa-f3bf-4227-aa42-745448f4ff17 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] No waiting events found dispatching network-vif-plugged-0230e8bd-c876-4793-96f6-9ccc72deaa73 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:30:51 user nova-compute[72773]: WARNING nova.compute.manager [req-16291fb8-178a-45ef-95b6-87a3fd4d29ad req-4e4d19fa-f3bf-4227-aa42-745448f4ff17 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received unexpected event network-vif-plugged-0230e8bd-c876-4793-96f6-9ccc72deaa73 for instance with vm_state building and task_state spawning.
Aug 16 22:30:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.211s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Checking if we can resize image /opt/stack/data/nova/instances/848668c7-4a90-4bb4-8617-3784cd33ed22/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:30:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848668c7-4a90-4bb4-8617-3784cd33ed22/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG nova.compute.manager [req-a014d671-6ee3-4dfc-a43e-92033de31737 req-a963e606-7516-406c-9ca5-56684cbdd98e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-plugged-4188d812-137b-448e-acb1-42dea2d8eb91 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a014d671-6ee3-4dfc-a43e-92033de31737 req-a963e606-7516-406c-9ca5-56684cbdd98e service nova] Acquiring lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a014d671-6ee3-4dfc-a43e-92033de31737 req-a963e606-7516-406c-9ca5-56684cbdd98e service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a014d671-6ee3-4dfc-a43e-92033de31737 req-a963e606-7516-406c-9ca5-56684cbdd98e service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG nova.compute.manager [req-a014d671-6ee3-4dfc-a43e-92033de31737 req-a963e606-7516-406c-9ca5-56684cbdd98e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] No waiting events found dispatching network-vif-plugged-4188d812-137b-448e-acb1-42dea2d8eb91 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:30:52 user nova-compute[72773]: WARNING nova.compute.manager [req-a014d671-6ee3-4dfc-a43e-92033de31737 req-a963e606-7516-406c-9ca5-56684cbdd98e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received unexpected event network-vif-plugged-4188d812-137b-448e-acb1-42dea2d8eb91 for instance with vm_state building and task_state spawning.
Aug 16 22:30:52 user nova-compute[72773]: DEBUG nova.compute.manager [req-a014d671-6ee3-4dfc-a43e-92033de31737 req-a963e606-7516-406c-9ca5-56684cbdd98e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-plugged-2dc74ea7-4f01-465f-8e7a-f5b4299ace47 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a014d671-6ee3-4dfc-a43e-92033de31737 req-a963e606-7516-406c-9ca5-56684cbdd98e service nova] Acquiring lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a014d671-6ee3-4dfc-a43e-92033de31737 req-a963e606-7516-406c-9ca5-56684cbdd98e service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a014d671-6ee3-4dfc-a43e-92033de31737 req-a963e606-7516-406c-9ca5-56684cbdd98e service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG nova.compute.manager [req-a014d671-6ee3-4dfc-a43e-92033de31737 req-a963e606-7516-406c-9ca5-56684cbdd98e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] No waiting events found dispatching network-vif-plugged-2dc74ea7-4f01-465f-8e7a-f5b4299ace47 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:30:52 user nova-compute[72773]: WARNING nova.compute.manager [req-a014d671-6ee3-4dfc-a43e-92033de31737 req-a963e606-7516-406c-9ca5-56684cbdd98e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received unexpected event network-vif-plugged-2dc74ea7-4f01-465f-8e7a-f5b4299ace47 for instance with vm_state building and task_state spawning.
Aug 16 22:30:52 user nova-compute[72773]: DEBUG nova.compute.manager [req-a014d671-6ee3-4dfc-a43e-92033de31737 req-a963e606-7516-406c-9ca5-56684cbdd98e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-plugged-2dc74ea7-4f01-465f-8e7a-f5b4299ace47 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a014d671-6ee3-4dfc-a43e-92033de31737 req-a963e606-7516-406c-9ca5-56684cbdd98e service nova] Acquiring lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a014d671-6ee3-4dfc-a43e-92033de31737 req-a963e606-7516-406c-9ca5-56684cbdd98e service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a014d671-6ee3-4dfc-a43e-92033de31737 req-a963e606-7516-406c-9ca5-56684cbdd98e service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG nova.compute.manager [req-a014d671-6ee3-4dfc-a43e-92033de31737 req-a963e606-7516-406c-9ca5-56684cbdd98e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] No waiting events found dispatching network-vif-plugged-2dc74ea7-4f01-465f-8e7a-f5b4299ace47 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:30:52 user nova-compute[72773]: WARNING nova.compute.manager [req-a014d671-6ee3-4dfc-a43e-92033de31737 req-a963e606-7516-406c-9ca5-56684cbdd98e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received unexpected event network-vif-plugged-2dc74ea7-4f01-465f-8e7a-f5b4299ace47 for instance with vm_state building and task_state spawning.
Aug 16 22:30:52 user nova-compute[72773]: DEBUG nova.compute.manager [req-a014d671-6ee3-4dfc-a43e-92033de31737 req-a963e606-7516-406c-9ca5-56684cbdd98e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-plugged-2581ab2b-5a7c-4c9a-8f59-f3c5a7228044 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a014d671-6ee3-4dfc-a43e-92033de31737 req-a963e606-7516-406c-9ca5-56684cbdd98e service nova] Acquiring lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a014d671-6ee3-4dfc-a43e-92033de31737 req-a963e606-7516-406c-9ca5-56684cbdd98e service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a014d671-6ee3-4dfc-a43e-92033de31737 req-a963e606-7516-406c-9ca5-56684cbdd98e service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG nova.compute.manager [req-a014d671-6ee3-4dfc-a43e-92033de31737 req-a963e606-7516-406c-9ca5-56684cbdd98e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] No waiting events found dispatching network-vif-plugged-2581ab2b-5a7c-4c9a-8f59-f3c5a7228044 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:30:52 user nova-compute[72773]: WARNING nova.compute.manager [req-a014d671-6ee3-4dfc-a43e-92033de31737 req-a963e606-7516-406c-9ca5-56684cbdd98e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received unexpected event network-vif-plugged-2581ab2b-5a7c-4c9a-8f59-f3c5a7228044 for instance with vm_state building and task_state spawning.
Aug 16 22:30:52 user nova-compute[72773]: DEBUG nova.compute.manager [req-a014d671-6ee3-4dfc-a43e-92033de31737 req-a963e606-7516-406c-9ca5-56684cbdd98e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-plugged-2581ab2b-5a7c-4c9a-8f59-f3c5a7228044 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a014d671-6ee3-4dfc-a43e-92033de31737 req-a963e606-7516-406c-9ca5-56684cbdd98e service nova] Acquiring lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a014d671-6ee3-4dfc-a43e-92033de31737 req-a963e606-7516-406c-9ca5-56684cbdd98e service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a014d671-6ee3-4dfc-a43e-92033de31737 req-a963e606-7516-406c-9ca5-56684cbdd98e service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG nova.compute.manager [req-a014d671-6ee3-4dfc-a43e-92033de31737 req-a963e606-7516-406c-9ca5-56684cbdd98e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] No waiting events found dispatching network-vif-plugged-2581ab2b-5a7c-4c9a-8f59-f3c5a7228044 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:30:52 user nova-compute[72773]: WARNING nova.compute.manager [req-a014d671-6ee3-4dfc-a43e-92033de31737 req-a963e606-7516-406c-9ca5-56684cbdd98e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received unexpected event network-vif-plugged-2581ab2b-5a7c-4c9a-8f59-f3c5a7228044 for instance with vm_state building and task_state spawning.
Aug 16 22:30:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848668c7-4a90-4bb4-8617-3784cd33ed22/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Cannot resize image /opt/stack/data/nova/instances/848668c7-4a90-4bb4-8617-3784cd33ed22/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG nova.objects.instance [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lazy-loading 'migration_context' on Instance uuid 848668c7-4a90-4bb4-8617-3784cd33ed22 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Ensure instance console log exists: /opt/stack/data/nova/instances/848668c7-4a90-4bb4-8617-3784cd33ed22/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94ae5694-f56f-4560-a3cc-edc4a59def18/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG nova.network.neutron [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Successfully created port: 02825371-2104-4f86-9e25-d56da652ddc5 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94ae5694-f56f-4560-a3cc-edc4a59def18/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94ae5694-f56f-4560-a3cc-edc4a59def18/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94ae5694-f56f-4560-a3cc-edc4a59def18/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:30:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/030d076d-5099-4236-ae31-6025017eb51e/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:53 user nova-compute[72773]: DEBUG nova.network.neutron [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Successfully updated port: 02825371-2104-4f86-9e25-d56da652ddc5 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:30:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/030d076d-5099-4236-ae31-6025017eb51e/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Acquiring lock "refresh_cache-848668c7-4a90-4bb4-8617-3784cd33ed22" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:30:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Acquired lock "refresh_cache-848668c7-4a90-4bb4-8617-3784cd33ed22" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:30:53 user nova-compute[72773]: DEBUG nova.network.neutron [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:30:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/030d076d-5099-4236-ae31-6025017eb51e/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:53 user nova-compute[72773]: DEBUG nova.network.neutron [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:30:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/030d076d-5099-4236-ae31-6025017eb51e/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:53 user nova-compute[72773]: DEBUG nova.compute.manager [req-12f52804-9fe6-4657-a279-1b4e1a149460 req-5c95bb99-27b5-4df7-b6a2-cb4c062e995c service nova] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Received event network-changed-02825371-2104-4f86-9e25-d56da652ddc5 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:30:53 user nova-compute[72773]: DEBUG nova.compute.manager [req-12f52804-9fe6-4657-a279-1b4e1a149460 req-5c95bb99-27b5-4df7-b6a2-cb4c062e995c service nova] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Refreshing instance network info cache due to event network-changed-02825371-2104-4f86-9e25-d56da652ddc5. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:30:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-12f52804-9fe6-4657-a279-1b4e1a149460 req-5c95bb99-27b5-4df7-b6a2-cb4c062e995c service nova] Acquiring lock "refresh_cache-848668c7-4a90-4bb4-8617-3784cd33ed22" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:30:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:53 user nova-compute[72773]: DEBUG nova.network.neutron [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Updating instance_info_cache with network_info: [{"id": "02825371-2104-4f86-9e25-d56da652ddc5", "address": "fa:16:3e:fd:62:8e", "network": {"id": "6194759c-ac83-4c8f-8604-c30c22e3ce5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-161254247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b8417e50ee41e89fedf55e7134fecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02825371-21", "ovs_interfaceid": "02825371-2104-4f86-9e25-d56da652ddc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:30:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Releasing lock "refresh_cache-848668c7-4a90-4bb4-8617-3784cd33ed22" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:30:53 user nova-compute[72773]: DEBUG nova.compute.manager [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Instance network_info: |[{"id": "02825371-2104-4f86-9e25-d56da652ddc5", "address": "fa:16:3e:fd:62:8e", "network": {"id": "6194759c-ac83-4c8f-8604-c30c22e3ce5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-161254247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b8417e50ee41e89fedf55e7134fecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02825371-21", "ovs_interfaceid": "02825371-2104-4f86-9e25-d56da652ddc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:30:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-12f52804-9fe6-4657-a279-1b4e1a149460 req-5c95bb99-27b5-4df7-b6a2-cb4c062e995c service nova] Acquired lock "refresh_cache-848668c7-4a90-4bb4-8617-3784cd33ed22" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:30:53 user nova-compute[72773]: DEBUG nova.network.neutron [req-12f52804-9fe6-4657-a279-1b4e1a149460 req-5c95bb99-27b5-4df7-b6a2-cb4c062e995c service nova] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Refreshing network info cache for port 02825371-2104-4f86-9e25-d56da652ddc5 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:30:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Start _get_guest_xml network_info=[{"id": "02825371-2104-4f86-9e25-d56da652ddc5", "address": "fa:16:3e:fd:62:8e", "network": {"id": "6194759c-ac83-4c8f-8604-c30c22e3ce5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-161254247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b8417e50ee41e89fedf55e7134fecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02825371-21", "ovs_interfaceid": "02825371-2104-4f86-9e25-d56da652ddc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:30:53 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:30:53 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:30:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:30:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:30:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:30:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:30:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-108106437',display_name='tempest-VolumesSnapshotTestJSON-instance-108106437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-108106437',id=18,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCb0J5GkPFnTNXNmtF6HjdInmUPZUlJYxYXE4Bav74MXLOmNGaQo9s0y5EPv6v4jVnGTlYL2IE2J+ZyBLhrtzTDyhA5gx+rRV5wUxh5ffyvO4lQQ2TUMPI2ExaZYTAqwBw==',key_name='tempest-keypair-514968804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59b8417e50ee41e89fedf55e7134fecd',ramdisk_id='',reservation_id='r-hxtcr3k7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-671770143',owner_user_name='tempest-VolumesSnapshotTestJSON-671770143-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:30:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='432dc5daebf442fba54be7f62f6bb09c',uuid=848668c7-4a90-4bb4-8617-3784cd33ed22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02825371-2104-4f86-9e25-d56da652ddc5", "address": "fa:16:3e:fd:62:8e", "network": {"id": "6194759c-ac83-4c8f-8604-c30c22e3ce5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-161254247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b8417e50ee41e89fedf55e7134fecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02825371-21", "ovs_interfaceid": "02825371-2104-4f86-9e25-d56da652ddc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Converting VIF {"id": "02825371-2104-4f86-9e25-d56da652ddc5", "address": "fa:16:3e:fd:62:8e", "network": {"id": "6194759c-ac83-4c8f-8604-c30c22e3ce5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-161254247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b8417e50ee41e89fedf55e7134fecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02825371-21", "ovs_interfaceid": "02825371-2104-4f86-9e25-d56da652ddc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:62:8e,bridge_name='br-int',has_traffic_filtering=True,id=02825371-2104-4f86-9e25-d56da652ddc5,network=Network(6194759c-ac83-4c8f-8604-c30c22e3ce5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02825371-21') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.objects.instance [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lazy-loading 'pci_devices' on Instance uuid 848668c7-4a90-4bb4-8617-3784cd33ed22 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.compute.manager [req-6ce32580-bd48-4db1-a0d3-e51729dec855 req-f1615589-4a44-4876-bc70-a922c6d615ec service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-plugged-0230e8bd-c876-4793-96f6-9ccc72deaa73 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6ce32580-bd48-4db1-a0d3-e51729dec855 req-f1615589-4a44-4876-bc70-a922c6d615ec service nova] Acquiring lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6ce32580-bd48-4db1-a0d3-e51729dec855 req-f1615589-4a44-4876-bc70-a922c6d615ec service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6ce32580-bd48-4db1-a0d3-e51729dec855 req-f1615589-4a44-4876-bc70-a922c6d615ec service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.compute.manager [req-6ce32580-bd48-4db1-a0d3-e51729dec855 req-f1615589-4a44-4876-bc70-a922c6d615ec service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] No waiting events found dispatching network-vif-plugged-0230e8bd-c876-4793-96f6-9ccc72deaa73 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:30:54 user nova-compute[72773]: WARNING nova.compute.manager [req-6ce32580-bd48-4db1-a0d3-e51729dec855 req-f1615589-4a44-4876-bc70-a922c6d615ec service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received unexpected event network-vif-plugged-0230e8bd-c876-4793-96f6-9ccc72deaa73 for instance with vm_state building and task_state spawning.
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:30:54 user nova-compute[72773]:   <uuid>848668c7-4a90-4bb4-8617-3784cd33ed22</uuid>
Aug 16 22:30:54 user nova-compute[72773]:   <name>instance-00000012</name>
Aug 16 22:30:54 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:30:54 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:30:54 user nova-compute[72773]:   <metadata>
Aug 16 22:30:54 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:30:54 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:30:54 user nova-compute[72773]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-108106437</nova:name>
Aug 16 22:30:54 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:30:53</nova:creationTime>
Aug 16 22:30:54 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:30:54 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:30:54 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:30:54 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:30:54 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:30:54 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:30:54 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:30:54 user nova-compute[72773]:       <nova:owner>
Aug 16 22:30:54 user nova-compute[72773]:         <nova:user uuid="432dc5daebf442fba54be7f62f6bb09c">tempest-VolumesSnapshotTestJSON-671770143-project-member</nova:user>
Aug 16 22:30:54 user nova-compute[72773]:         <nova:project uuid="59b8417e50ee41e89fedf55e7134fecd">tempest-VolumesSnapshotTestJSON-671770143</nova:project>
Aug 16 22:30:54 user nova-compute[72773]:       </nova:owner>
Aug 16 22:30:54 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:30:54 user nova-compute[72773]:       <nova:ports>
Aug 16 22:30:54 user nova-compute[72773]:         <nova:port uuid="02825371-2104-4f86-9e25-d56da652ddc5">
Aug 16 22:30:54 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 22:30:54 user nova-compute[72773]:         </nova:port>
Aug 16 22:30:54 user nova-compute[72773]:       </nova:ports>
Aug 16 22:30:54 user nova-compute[72773]:     </nova:instance>
Aug 16 22:30:54 user nova-compute[72773]:   </metadata>
Aug 16 22:30:54 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:30:54 user nova-compute[72773]:     <system>
Aug 16 22:30:54 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:30:54 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:30:54 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:30:54 user nova-compute[72773]:       <entry name="serial">848668c7-4a90-4bb4-8617-3784cd33ed22</entry>
Aug 16 22:30:54 user nova-compute[72773]:       <entry name="uuid">848668c7-4a90-4bb4-8617-3784cd33ed22</entry>
Aug 16 22:30:54 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:30:54 user nova-compute[72773]:     </system>
Aug 16 22:30:54 user nova-compute[72773]:   </sysinfo>
Aug 16 22:30:54 user nova-compute[72773]:   <os>
Aug 16 22:30:54 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:30:54 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:30:54 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:30:54 user nova-compute[72773]:   </os>
Aug 16 22:30:54 user nova-compute[72773]:   <features>
Aug 16 22:30:54 user nova-compute[72773]:     <acpi/>
Aug 16 22:30:54 user nova-compute[72773]:     <apic/>
Aug 16 22:30:54 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:30:54 user nova-compute[72773]:   </features>
Aug 16 22:30:54 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:30:54 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:30:54 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:30:54 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:30:54 user nova-compute[72773]:   </clock>
Aug 16 22:30:54 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:30:54 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:30:54 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:30:54 user nova-compute[72773]:   </cpu>
Aug 16 22:30:54 user nova-compute[72773]:   <devices>
Aug 16 22:30:54 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:30:54 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:30:54 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/848668c7-4a90-4bb4-8617-3784cd33ed22/disk"/>
Aug 16 22:30:54 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:30:54 user nova-compute[72773]:     </disk>
Aug 16 22:30:54 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:30:54 user nova-compute[72773]:       <mac address="fa:16:3e:fd:62:8e"/>
Aug 16 22:30:54 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:30:54 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:30:54 user nova-compute[72773]:       <target dev="tap02825371-21"/>
Aug 16 22:30:54 user nova-compute[72773]:     </interface>
Aug 16 22:30:54 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:30:54 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/848668c7-4a90-4bb4-8617-3784cd33ed22/console.log" append="off"/>
Aug 16 22:30:54 user nova-compute[72773]:     </serial>
Aug 16 22:30:54 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:30:54 user nova-compute[72773]:     <video>
Aug 16 22:30:54 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:30:54 user nova-compute[72773]:     </video>
Aug 16 22:30:54 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:30:54 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:30:54 user nova-compute[72773]:     </rng>
Aug 16 22:30:54 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:30:54 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:30:54 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:30:54 user nova-compute[72773]:     </memballoon>
Aug 16 22:30:54 user nova-compute[72773]:   </devices>
Aug 16 22:30:54 user nova-compute[72773]: </domain>
Aug 16 22:30:54 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:30:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-108106437',display_name='tempest-VolumesSnapshotTestJSON-instance-108106437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-108106437',id=18,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCb0J5GkPFnTNXNmtF6HjdInmUPZUlJYxYXE4Bav74MXLOmNGaQo9s0y5EPv6v4jVnGTlYL2IE2J+ZyBLhrtzTDyhA5gx+rRV5wUxh5ffyvO4lQQ2TUMPI2ExaZYTAqwBw==',key_name='tempest-keypair-514968804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59b8417e50ee41e89fedf55e7134fecd',ramdisk_id='',reservation_id='r-hxtcr3k7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-671770143',owner_user_name='tempest-VolumesSnapshotTestJSON-671770143-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:30:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='432dc5daebf442fba54be7f62f6bb09c',uuid=848668c7-4a90-4bb4-8617-3784cd33ed22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02825371-2104-4f86-9e25-d56da652ddc5", "address": "fa:16:3e:fd:62:8e", "network": {"id": "6194759c-ac83-4c8f-8604-c30c22e3ce5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-161254247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b8417e50ee41e89fedf55e7134fecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02825371-21", "ovs_interfaceid": "02825371-2104-4f86-9e25-d56da652ddc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Converting VIF {"id": "02825371-2104-4f86-9e25-d56da652ddc5", "address": "fa:16:3e:fd:62:8e", "network": {"id": "6194759c-ac83-4c8f-8604-c30c22e3ce5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-161254247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b8417e50ee41e89fedf55e7134fecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02825371-21", "ovs_interfaceid": "02825371-2104-4f86-9e25-d56da652ddc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:62:8e,bridge_name='br-int',has_traffic_filtering=True,id=02825371-2104-4f86-9e25-d56da652ddc5,network=Network(6194759c-ac83-4c8f-8604-c30c22e3ce5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02825371-21') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG os_vif [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:62:8e,bridge_name='br-int',has_traffic_filtering=True,id=02825371-2104-4f86-9e25-d56da652ddc5,network=Network(6194759c-ac83-4c8f-8604-c30c22e3ce5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02825371-21') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02825371-21, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap02825371-21, col_values=(('external_ids', {'iface-id': '02825371-2104-4f86-9e25-d56da652ddc5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:62:8e', 'vm-uuid': '848668c7-4a90-4bb4-8617-3784cd33ed22'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:54 user nova-compute[72773]: INFO os_vif [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:62:8e,bridge_name='br-int',has_traffic_filtering=True,id=02825371-2104-4f86-9e25-d56da652ddc5,network=Network(6194759c-ac83-4c8f-8604-c30c22e3ce5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02825371-21')
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225054.1393616, 5aa5adad-599d-424f-bbfc-7d87ead31b57 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:30:54 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] VM Resumed (Lifecycle Event)
Aug 16 22:30:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.compute.manager [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:54 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Instance spawned successfully.
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] No VIF found with MAC fa:16:3e:fd:62:8e, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.compute.manager [req-90ce3cd7-7cf3-4972-bf48-f354f374d971 req-0ed11c24-fd7b-416c-91ed-60502c1369fb service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-plugged-44f58154-ceae-45ef-a169-0681e0e9a3fb {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-90ce3cd7-7cf3-4972-bf48-f354f374d971 req-0ed11c24-fd7b-416c-91ed-60502c1369fb service nova] Acquiring lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-90ce3cd7-7cf3-4972-bf48-f354f374d971 req-0ed11c24-fd7b-416c-91ed-60502c1369fb service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-90ce3cd7-7cf3-4972-bf48-f354f374d971 req-0ed11c24-fd7b-416c-91ed-60502c1369fb service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.compute.manager [req-90ce3cd7-7cf3-4972-bf48-f354f374d971 req-0ed11c24-fd7b-416c-91ed-60502c1369fb service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] No waiting events found dispatching network-vif-plugged-44f58154-ceae-45ef-a169-0681e0e9a3fb {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:30:54 user nova-compute[72773]: WARNING nova.compute.manager [req-90ce3cd7-7cf3-4972-bf48-f354f374d971 req-0ed11c24-fd7b-416c-91ed-60502c1369fb service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received unexpected event network-vif-plugged-44f58154-ceae-45ef-a169-0681e0e9a3fb for instance with vm_state building and task_state spawning.
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.compute.manager [req-90ce3cd7-7cf3-4972-bf48-f354f374d971 req-0ed11c24-fd7b-416c-91ed-60502c1369fb service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-plugged-44f58154-ceae-45ef-a169-0681e0e9a3fb {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-90ce3cd7-7cf3-4972-bf48-f354f374d971 req-0ed11c24-fd7b-416c-91ed-60502c1369fb service nova] Acquiring lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-90ce3cd7-7cf3-4972-bf48-f354f374d971 req-0ed11c24-fd7b-416c-91ed-60502c1369fb service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-90ce3cd7-7cf3-4972-bf48-f354f374d971 req-0ed11c24-fd7b-416c-91ed-60502c1369fb service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.compute.manager [req-90ce3cd7-7cf3-4972-bf48-f354f374d971 req-0ed11c24-fd7b-416c-91ed-60502c1369fb service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] No waiting events found dispatching network-vif-plugged-44f58154-ceae-45ef-a169-0681e0e9a3fb {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:30:54 user nova-compute[72773]: WARNING nova.compute.manager [req-90ce3cd7-7cf3-4972-bf48-f354f374d971 req-0ed11c24-fd7b-416c-91ed-60502c1369fb service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received unexpected event network-vif-plugged-44f58154-ceae-45ef-a169-0681e0e9a3fb for instance with vm_state building and task_state spawning.
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:30:54 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225054.14457, 5aa5adad-599d-424f-bbfc-7d87ead31b57 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:30:54 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] VM Started (Lifecycle Event)
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:54 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:30:54 user nova-compute[72773]: INFO nova.compute.manager [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Took 12.12 seconds to spawn the instance on the hypervisor.
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.compute.manager [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:30:54 user nova-compute[72773]: INFO nova.compute.manager [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Took 85.27 seconds to build instance.
Aug 16 22:30:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-22abd401-c909-436b-bcd9-173e49d7f829 tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 85.440s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.network.neutron [req-12f52804-9fe6-4657-a279-1b4e1a149460 req-5c95bb99-27b5-4df7-b6a2-cb4c062e995c service nova] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Updated VIF entry in instance network info cache for port 02825371-2104-4f86-9e25-d56da652ddc5. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG nova.network.neutron [req-12f52804-9fe6-4657-a279-1b4e1a149460 req-5c95bb99-27b5-4df7-b6a2-cb4c062e995c service nova] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Updating instance_info_cache with network_info: [{"id": "02825371-2104-4f86-9e25-d56da652ddc5", "address": "fa:16:3e:fd:62:8e", "network": {"id": "6194759c-ac83-4c8f-8604-c30c22e3ce5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-161254247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b8417e50ee41e89fedf55e7134fecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02825371-21", "ovs_interfaceid": "02825371-2104-4f86-9e25-d56da652ddc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-12f52804-9fe6-4657-a279-1b4e1a149460 req-5c95bb99-27b5-4df7-b6a2-cb4c062e995c service nova] Releasing lock "refresh_cache-848668c7-4a90-4bb4-8617-3784cd33ed22" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b4514f-16f8-466d-9e58-b95c0bfb3f32/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b4514f-16f8-466d-9e58-b95c0bfb3f32/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b4514f-16f8-466d-9e58-b95c0bfb3f32/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b4514f-16f8-466d-9e58-b95c0bfb3f32/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:55 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:30:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:30:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225058.1928296, 848668c7-4a90-4bb4-8617-3784cd33ed22 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:30:58 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] VM Resumed (Lifecycle Event)
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-66260722-a7e7-4cc5-9f78-0098e13d19c5 req-4a5d71a5-7eeb-4b10-9d21-1ca912e44f34 service nova] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Received event network-vif-plugged-02825371-2104-4f86-9e25-d56da652ddc5 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-66260722-a7e7-4cc5-9f78-0098e13d19c5 req-4a5d71a5-7eeb-4b10-9d21-1ca912e44f34 service nova] Acquiring lock "848668c7-4a90-4bb4-8617-3784cd33ed22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-66260722-a7e7-4cc5-9f78-0098e13d19c5 req-4a5d71a5-7eeb-4b10-9d21-1ca912e44f34 service nova] Lock "848668c7-4a90-4bb4-8617-3784cd33ed22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-66260722-a7e7-4cc5-9f78-0098e13d19c5 req-4a5d71a5-7eeb-4b10-9d21-1ca912e44f34 service nova] Lock "848668c7-4a90-4bb4-8617-3784cd33ed22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-66260722-a7e7-4cc5-9f78-0098e13d19c5 req-4a5d71a5-7eeb-4b10-9d21-1ca912e44f34 service nova] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] No waiting events found dispatching network-vif-plugged-02825371-2104-4f86-9e25-d56da652ddc5 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:30:58 user nova-compute[72773]: WARNING nova.compute.manager [req-66260722-a7e7-4cc5-9f78-0098e13d19c5 req-4a5d71a5-7eeb-4b10-9d21-1ca912e44f34 service nova] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Received unexpected event network-vif-plugged-02825371-2104-4f86-9e25-d56da652ddc5 for instance with vm_state building and task_state spawning.
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-b6cf1d58-673a-438c-a3f5-98febce8fc4a req-4e110c6b-cae3-487d-8607-a034f58867de service nova] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Received event network-vif-plugged-02825371-2104-4f86-9e25-d56da652ddc5 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b6cf1d58-673a-438c-a3f5-98febce8fc4a req-4e110c6b-cae3-487d-8607-a034f58867de service nova] Acquiring lock "848668c7-4a90-4bb4-8617-3784cd33ed22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b6cf1d58-673a-438c-a3f5-98febce8fc4a req-4e110c6b-cae3-487d-8607-a034f58867de service nova] Lock "848668c7-4a90-4bb4-8617-3784cd33ed22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b6cf1d58-673a-438c-a3f5-98febce8fc4a req-4e110c6b-cae3-487d-8607-a034f58867de service nova] Lock "848668c7-4a90-4bb4-8617-3784cd33ed22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-b6cf1d58-673a-438c-a3f5-98febce8fc4a req-4e110c6b-cae3-487d-8607-a034f58867de service nova] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] No waiting events found dispatching network-vif-plugged-02825371-2104-4f86-9e25-d56da652ddc5 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:30:58 user nova-compute[72773]: WARNING nova.compute.manager [req-b6cf1d58-673a-438c-a3f5-98febce8fc4a req-4e110c6b-cae3-487d-8607-a034f58867de service nova] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Received unexpected event network-vif-plugged-02825371-2104-4f86-9e25-d56da652ddc5 for instance with vm_state building and task_state spawning.
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.compute.manager [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:30:58 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:30:58 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=7284MB free_disk=25.70654296875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d071f0e3-709b-4b45-9252-6603025cd039 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Acquiring lock "94ae5694-f56f-4560-a3cc-edc4a59def18" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d071f0e3-709b-4b45-9252-6603025cd039 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "94ae5694-f56f-4560-a3cc-edc4a59def18" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d071f0e3-709b-4b45-9252-6603025cd039 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Acquiring lock "94ae5694-f56f-4560-a3cc-edc4a59def18-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d071f0e3-709b-4b45-9252-6603025cd039 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "94ae5694-f56f-4560-a3cc-edc4a59def18-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d071f0e3-709b-4b45-9252-6603025cd039 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "94ae5694-f56f-4560-a3cc-edc4a59def18-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:30:58 user nova-compute[72773]: INFO nova.compute.manager [None req-d071f0e3-709b-4b45-9252-6603025cd039 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Terminating instance
Aug 16 22:30:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Acquiring lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Acquiring lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.compute.manager [None req-d071f0e3-709b-4b45-9252-6603025cd039 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:30:58 user nova-compute[72773]: INFO nova.compute.manager [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Terminating instance
Aug 16 22:30:58 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Instance spawned successfully.
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.compute.manager [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:30:58 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225058.1935074, 848668c7-4a90-4bb4-8617-3784cd33ed22 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:30:58 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] VM Started (Lifecycle Event)
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:30:58 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:30:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:58 user nova-compute[72773]: INFO nova.compute.manager [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Took 7.60 seconds to spawn the instance on the hypervisor.
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.compute.manager [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 956d334e-f190-4625-b144-ab44d2f3321a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 4efab321-f2aa-456c-a1ae-b32f399f694d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance c6adfa95-47ac-40d3-abc1-0c6027507f07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 2c1c948f-c541-41ea-ba51-23ff78d1c0db actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 030d076d-5099-4236-ae31-6025017eb51e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 94ae5694-f56f-4560-a3cc-edc4a59def18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 02227d9f-5ddf-42fe-91a8-ce56d76aa274 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 60b4514f-16f8-466d-9e58-b95c0bfb3f32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 5aa5adad-599d-424f-bbfc-7d87ead31b57 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 384d4037-bac4-423f-bc7a-e64fe14d7f77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 848668c7-4a90-4bb4-8617-3784cd33ed22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:30:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:58 user nova-compute[72773]: INFO nova.compute.manager [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Took 9.00 seconds to build instance.
Aug 16 22:30:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1fc5f246-e1d2-4116-a0fb-c5735cb66659 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "848668c7-4a90-4bb4-8617-3784cd33ed22" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.205s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:59 user nova-compute[72773]: DEBUG nova.compute.manager [req-c559ee26-b5b8-4ecc-a9f3-465452b60053 req-8504ac3b-27ff-402a-b1e4-bf6358bd08a5 service nova] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Received event network-vif-unplugged-40af08fd-63ff-47fc-8a4a-d01047a902bd {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:30:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c559ee26-b5b8-4ecc-a9f3-465452b60053 req-8504ac3b-27ff-402a-b1e4-bf6358bd08a5 service nova] Acquiring lock "94ae5694-f56f-4560-a3cc-edc4a59def18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:30:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c559ee26-b5b8-4ecc-a9f3-465452b60053 req-8504ac3b-27ff-402a-b1e4-bf6358bd08a5 service nova] Lock "94ae5694-f56f-4560-a3cc-edc4a59def18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:30:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c559ee26-b5b8-4ecc-a9f3-465452b60053 req-8504ac3b-27ff-402a-b1e4-bf6358bd08a5 service nova] Lock "94ae5694-f56f-4560-a3cc-edc4a59def18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:59 user nova-compute[72773]: DEBUG nova.compute.manager [req-c559ee26-b5b8-4ecc-a9f3-465452b60053 req-8504ac3b-27ff-402a-b1e4-bf6358bd08a5 service nova] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] No waiting events found dispatching network-vif-unplugged-40af08fd-63ff-47fc-8a4a-d01047a902bd {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:30:59 user nova-compute[72773]: DEBUG nova.compute.manager [req-c559ee26-b5b8-4ecc-a9f3-465452b60053 req-8504ac3b-27ff-402a-b1e4-bf6358bd08a5 service nova] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Received event network-vif-unplugged-40af08fd-63ff-47fc-8a4a-d01047a902bd for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:30:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:59 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:30:59 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:30:59 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:30:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.822s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:30:59 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:30:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:59 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Instance destroyed successfully.
Aug 16 22:30:59 user nova-compute[72773]: DEBUG nova.objects.instance [None req-d071f0e3-709b-4b45-9252-6603025cd039 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lazy-loading 'resources' on Instance uuid 94ae5694-f56f-4560-a3cc-edc4a59def18 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:30:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-d071f0e3-709b-4b45-9252-6603025cd039 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:28:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-546080394',display_name='tempest-VolumesAdminNegativeTest-server-546080394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-546080394',id=14,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:28:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9086072338454300bb7a455bff6d0757',ramdisk_id='',reservation_id='r-w9j096m0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2096874148',owner_user_name='tempest-VolumesAdminNegativeTest-2096874148-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:28:58Z,user_data=None,user_id='cdc2f4b4e44b46689635994d2d3ab066',uuid=94ae5694-f56f-4560-a3cc-edc4a59def18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40af08fd-63ff-47fc-8a4a-d01047a902bd", "address": "fa:16:3e:b7:4b:4e", "network": {"id": "db5b9d7a-8d3c-409c-961b-9bd7d882664c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1507737858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9086072338454300bb7a455bff6d0757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40af08fd-63", "ovs_interfaceid": "40af08fd-63ff-47fc-8a4a-d01047a902bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:30:59 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-d071f0e3-709b-4b45-9252-6603025cd039 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Converting VIF {"id": "40af08fd-63ff-47fc-8a4a-d01047a902bd", "address": "fa:16:3e:b7:4b:4e", "network": {"id": "db5b9d7a-8d3c-409c-961b-9bd7d882664c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1507737858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9086072338454300bb7a455bff6d0757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40af08fd-63", "ovs_interfaceid": "40af08fd-63ff-47fc-8a4a-d01047a902bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:30:59 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-d071f0e3-709b-4b45-9252-6603025cd039 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:4b:4e,bridge_name='br-int',has_traffic_filtering=True,id=40af08fd-63ff-47fc-8a4a-d01047a902bd,network=Network(db5b9d7a-8d3c-409c-961b-9bd7d882664c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40af08fd-63') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:30:59 user nova-compute[72773]: DEBUG os_vif [None req-d071f0e3-709b-4b45-9252-6603025cd039 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:4b:4e,bridge_name='br-int',has_traffic_filtering=True,id=40af08fd-63ff-47fc-8a4a-d01047a902bd,network=Network(db5b9d7a-8d3c-409c-961b-9bd7d882664c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40af08fd-63') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:30:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40af08fd-63, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:30:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:30:59 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Instance destroyed successfully.
Aug 16 22:30:59 user nova-compute[72773]: DEBUG nova.objects.instance [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lazy-loading 'resources' on Instance uuid 2c1c948f-c541-41ea-ba51-23ff78d1c0db {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T22:26:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-959076328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1140763264',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBA6wXj+pYizM4fJfGUIvhwgan4ub6F4+mEVSZeYo3UraSfwK8dHO9ZRWzHCA/0MsTcW4Way+QQ3ZkahEVK/6hRQ7Z4hPQl0XcQMQn6OttJ3+biiwE/FDTRdP2/DP4bJ/g==',key_name='tempest-keypair-1083426637',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:29:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a863da00c62473b9f3726f45900be0c',ramdisk_id='',reservation_id='r-kdsmsxtr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1773237892',owner_user_name='tempest-ServerActionsV293TestJSON-1773237892-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:29:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='317d00f05a4649c2888f6d30e0a140b8',uuid=2c1c948f-c541-41ea-ba51-23ff78d1c0db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "address": "fa:16:3e:48:cc:48", "network": {"id": "a399052b-0f9b-4c24-a176-7b59221e92a1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-679236513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a863da00c62473b9f3726f45900be0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e021e1c-b5", "ovs_interfaceid": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Converting VIF {"id": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "address": "fa:16:3e:48:cc:48", "network": {"id": "a399052b-0f9b-4c24-a176-7b59221e92a1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-679236513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a863da00c62473b9f3726f45900be0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e021e1c-b5", "ovs_interfaceid": "6e021e1c-b583-4ddf-ad9a-f215484ff208", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:cc:48,bridge_name='br-int',has_traffic_filtering=True,id=6e021e1c-b583-4ddf-ad9a-f215484ff208,network=Network(a399052b-0f9b-4c24-a176-7b59221e92a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e021e1c-b5') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG os_vif [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:cc:48,bridge_name='br-int',has_traffic_filtering=True,id=6e021e1c-b583-4ddf-ad9a-f215484ff208,network=Network(a399052b-0f9b-4c24-a176-7b59221e92a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e021e1c-b5') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:31:00 user nova-compute[72773]: INFO os_vif [None req-d071f0e3-709b-4b45-9252-6603025cd039 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:4b:4e,bridge_name='br-int',has_traffic_filtering=True,id=40af08fd-63ff-47fc-8a4a-d01047a902bd,network=Network(db5b9d7a-8d3c-409c-961b-9bd7d882664c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40af08fd-63')
Aug 16 22:31:00 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-d071f0e3-709b-4b45-9252-6603025cd039 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Deleting instance files /opt/stack/data/nova/instances/94ae5694-f56f-4560-a3cc-edc4a59def18_del
Aug 16 22:31:00 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-d071f0e3-709b-4b45-9252-6603025cd039 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Deletion of /opt/stack/data/nova/instances/94ae5694-f56f-4560-a3cc-edc4a59def18_del complete
Aug 16 22:31:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e021e1c-b5, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:00 user nova-compute[72773]: INFO os_vif [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:cc:48,bridge_name='br-int',has_traffic_filtering=True,id=6e021e1c-b583-4ddf-ad9a-f215484ff208,network=Network(a399052b-0f9b-4c24-a176-7b59221e92a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e021e1c-b5')
Aug 16 22:31:00 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abPpkSTl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:31:00 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:31:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ca96e0-b944-49f0-bafb-5716efd8ebb8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:31:00 user nova-compute[72773]: INFO nova.compute.manager [None req-d071f0e3-709b-4b45-9252-6603025cd039 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Took 1.49 seconds to destroy the instance on the hypervisor.
Aug 16 22:31:00 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-d071f0e3-709b-4b45-9252-6603025cd039 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b462572c-412e-4318-a1ee-7454f3d1c13f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:31:00 user nova-compute[72773]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:31:00 user nova-compute[72773]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 (non-flash)
Aug 16 22:31:00 user nova-compute[72773]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 (non-flash)
Aug 16 22:31:00 user nova-compute[72773]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d (non-flash)
Aug 16 22:31:00 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:31:00 user nova-compute[72773]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 (non-flash)
Aug 16 22:31:00 user nova-compute[72773]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 (non-flash)
Aug 16 22:31:00 user nova-compute[72773]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 (non-flash)
Aug 16 22:31:00 user nova-compute[72773]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d (non-flash)
Aug 16 22:31:00 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef802b96c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18'): ({'sdf'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Removing single pathed devices sdf {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.041s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[272f9e99-dbd9-47ec-90a5-df9b3440cad0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d11871-e418-415e-9dd3-fdc5f360f386]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Flushing IO for device /dev/sdf {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[db04a107-614c-464d-b081-6859f85ee1dd]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.068s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[91da3150-a8c6-4668-926b-9908630e0965]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] SCSI volumes sdf have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad697bab-f1c5-4983-a985-d37576c065d5]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bedfbe-cb6d-4146-a157-cb1b11d0e6f6]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18, portal: 172.16.0.220,3260]
Aug 16 22:31:00 user nova-compute[72773]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18, portal: 172.16.0.220,3260] successful.
Aug 16 22:31:00 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb687b38-4616-4b0b-bee3-4ff1da040b18 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a2c960-8b23-4a19-9cff-1f475903f03e]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.432s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] <== disconnect_volume: return (433ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:31:00 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Deleting instance files /opt/stack/data/nova/instances/2c1c948f-c541-41ea-ba51-23ff78d1c0db_del
Aug 16 22:31:00 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Deletion of /opt/stack/data/nova/instances/2c1c948f-c541-41ea-ba51-23ff78d1c0db_del complete
Aug 16 22:31:00 user nova-compute[72773]: INFO nova.compute.manager [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Took 1.94 seconds to destroy the instance on the hypervisor.
Aug 16 22:31:00 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:01 user nova-compute[72773]: DEBUG nova.compute.manager [req-366cf4ac-a504-4150-a98e-3a0ebc4449f4 req-214184ca-4351-423f-83aa-b5d0d8d8278d service nova] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Received event network-vif-plugged-40af08fd-63ff-47fc-8a4a-d01047a902bd {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:31:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-366cf4ac-a504-4150-a98e-3a0ebc4449f4 req-214184ca-4351-423f-83aa-b5d0d8d8278d service nova] Acquiring lock "94ae5694-f56f-4560-a3cc-edc4a59def18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-366cf4ac-a504-4150-a98e-3a0ebc4449f4 req-214184ca-4351-423f-83aa-b5d0d8d8278d service nova] Lock "94ae5694-f56f-4560-a3cc-edc4a59def18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-366cf4ac-a504-4150-a98e-3a0ebc4449f4 req-214184ca-4351-423f-83aa-b5d0d8d8278d service nova] Lock "94ae5694-f56f-4560-a3cc-edc4a59def18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:01 user nova-compute[72773]: DEBUG nova.compute.manager [req-366cf4ac-a504-4150-a98e-3a0ebc4449f4 req-214184ca-4351-423f-83aa-b5d0d8d8278d service nova] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] No waiting events found dispatching network-vif-plugged-40af08fd-63ff-47fc-8a4a-d01047a902bd {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:31:01 user nova-compute[72773]: WARNING nova.compute.manager [req-366cf4ac-a504-4150-a98e-3a0ebc4449f4 req-214184ca-4351-423f-83aa-b5d0d8d8278d service nova] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Received unexpected event network-vif-plugged-40af08fd-63ff-47fc-8a4a-d01047a902bd for instance with vm_state active and task_state deleting.
Aug 16 22:31:01 user nova-compute[72773]: DEBUG nova.compute.manager [req-366cf4ac-a504-4150-a98e-3a0ebc4449f4 req-214184ca-4351-423f-83aa-b5d0d8d8278d service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Received event network-vif-unplugged-6e021e1c-b583-4ddf-ad9a-f215484ff208 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:31:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-366cf4ac-a504-4150-a98e-3a0ebc4449f4 req-214184ca-4351-423f-83aa-b5d0d8d8278d service nova] Acquiring lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-366cf4ac-a504-4150-a98e-3a0ebc4449f4 req-214184ca-4351-423f-83aa-b5d0d8d8278d service nova] Lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-366cf4ac-a504-4150-a98e-3a0ebc4449f4 req-214184ca-4351-423f-83aa-b5d0d8d8278d service nova] Lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:01 user nova-compute[72773]: DEBUG nova.compute.manager [req-366cf4ac-a504-4150-a98e-3a0ebc4449f4 req-214184ca-4351-423f-83aa-b5d0d8d8278d service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] No waiting events found dispatching network-vif-unplugged-6e021e1c-b583-4ddf-ad9a-f215484ff208 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:31:01 user nova-compute[72773]: DEBUG nova.compute.manager [req-366cf4ac-a504-4150-a98e-3a0ebc4449f4 req-214184ca-4351-423f-83aa-b5d0d8d8278d service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Received event network-vif-unplugged-6e021e1c-b583-4ddf-ad9a-f215484ff208 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:31:01 user nova-compute[72773]: DEBUG nova.compute.manager [req-366cf4ac-a504-4150-a98e-3a0ebc4449f4 req-214184ca-4351-423f-83aa-b5d0d8d8278d service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Received event network-vif-plugged-6e021e1c-b583-4ddf-ad9a-f215484ff208 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:31:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-366cf4ac-a504-4150-a98e-3a0ebc4449f4 req-214184ca-4351-423f-83aa-b5d0d8d8278d service nova] Acquiring lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-366cf4ac-a504-4150-a98e-3a0ebc4449f4 req-214184ca-4351-423f-83aa-b5d0d8d8278d service nova] Lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-366cf4ac-a504-4150-a98e-3a0ebc4449f4 req-214184ca-4351-423f-83aa-b5d0d8d8278d service nova] Lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:01 user nova-compute[72773]: DEBUG nova.compute.manager [req-366cf4ac-a504-4150-a98e-3a0ebc4449f4 req-214184ca-4351-423f-83aa-b5d0d8d8278d service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] No waiting events found dispatching network-vif-plugged-6e021e1c-b583-4ddf-ad9a-f215484ff208 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:31:01 user nova-compute[72773]: WARNING nova.compute.manager [req-366cf4ac-a504-4150-a98e-3a0ebc4449f4 req-214184ca-4351-423f-83aa-b5d0d8d8278d service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Received unexpected event network-vif-plugged-6e021e1c-b583-4ddf-ad9a-f215484ff208 for instance with vm_state active and task_state deleting.
Aug 16 22:31:01 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:31:01 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Took 1.14 seconds to deallocate network for instance.
Aug 16 22:31:01 user nova-compute[72773]: DEBUG nova.compute.manager [req-1b46c0bb-e163-4715-9095-0dc50edf759d req-750f6dee-8f46-46c1-a674-0fcba0a8ae29 service nova] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Received event network-vif-deleted-40af08fd-63ff-47fc-8a4a-d01047a902bd {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:31:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d071f0e3-709b-4b45-9252-6603025cd039 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d071f0e3-709b-4b45-9252-6603025cd039 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:01 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-d071f0e3-709b-4b45-9252-6603025cd039 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:31:01 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-d071f0e3-709b-4b45-9252-6603025cd039 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:31:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d071f0e3-709b-4b45-9252-6603025cd039 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.475s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:01 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-d071f0e3-709b-4b45-9252-6603025cd039 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Deleted allocations for instance 94ae5694-f56f-4560-a3cc-edc4a59def18
Aug 16 22:31:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d071f0e3-709b-4b45-9252-6603025cd039 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "94ae5694-f56f-4560-a3cc-edc4a59def18" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.476s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:02 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:31:02 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Took 1.56 seconds to deallocate network for instance.
Aug 16 22:31:02 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:31:03 user nova-compute[72773]: INFO nova.compute.manager [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Took 0.93 seconds to detach 1 volumes for instance.
Aug 16 22:31:03 user nova-compute[72773]: DEBUG nova.compute.manager [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Deleting volume: fb687b38-4616-4b0b-bee3-4ff1da040b18 {{(pid=72773) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 22:31:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:03 user nova-compute[72773]: DEBUG nova.compute.manager [req-9a88556b-c61c-4636-b33f-5ad4175dbaec req-3bd1850c-06c5-4394-8777-9cf0bea1e27a service nova] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Received event network-vif-deleted-6e021e1c-b583-4ddf-ad9a-f215484ff208 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:31:03 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:31:03 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:31:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.468s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:03 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Deleted allocations for instance 2c1c948f-c541-41ea-ba51-23ff78d1c0db
Aug 16 22:31:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5fa9a0ca-3065-4860-b6c5-8d70dbb259ff tempest-ServerActionsV293TestJSON-1773237892 tempest-ServerActionsV293TestJSON-1773237892-project-member] Lock "2c1c948f-c541-41ea-ba51-23ff78d1c0db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.221s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:04 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:14 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692225059.864966, 94ae5694-f56f-4560-a3cc-edc4a59def18 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:31:14 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] VM Stopped (Lifecycle Event)
Aug 16 22:31:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-3589f29b-2de5-4f2a-b152-b91e70a568d4 None None] [instance: 94ae5694-f56f-4560-a3cc-edc4a59def18] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:31:14 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692225059.940117, 2c1c948f-c541-41ea-ba51-23ff78d1c0db => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:31:14 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] VM Stopped (Lifecycle Event)
Aug 16 22:31:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-9500507f-d6d9-457c-8d44-7f2cb01ce215 None None] [instance: 2c1c948f-c541-41ea-ba51-23ff78d1c0db] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:31:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-83d75841-2cf8-4417-802a-b1f84e02f232 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Acquiring lock "60b4514f-16f8-466d-9e58-b95c0bfb3f32" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-83d75841-2cf8-4417-802a-b1f84e02f232 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lock "60b4514f-16f8-466d-9e58-b95c0bfb3f32" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.005s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-83d75841-2cf8-4417-802a-b1f84e02f232 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Acquiring lock "60b4514f-16f8-466d-9e58-b95c0bfb3f32-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-83d75841-2cf8-4417-802a-b1f84e02f232 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lock "60b4514f-16f8-466d-9e58-b95c0bfb3f32-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.012s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-83d75841-2cf8-4417-802a-b1f84e02f232 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lock "60b4514f-16f8-466d-9e58-b95c0bfb3f32-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:17 user nova-compute[72773]: INFO nova.compute.manager [None req-83d75841-2cf8-4417-802a-b1f84e02f232 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Terminating instance
Aug 16 22:31:17 user nova-compute[72773]: DEBUG nova.compute.manager [None req-83d75841-2cf8-4417-802a-b1f84e02f232 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:31:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:17 user nova-compute[72773]: DEBUG nova.compute.manager [req-69cb6ff3-7a27-4fab-b9b1-849f03565533 req-eaa3e698-e817-4f14-9892-1cda0778ae58 service nova] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Received event network-vif-unplugged-3c311267-1174-4333-8de6-e0872bb91c07 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:31:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-69cb6ff3-7a27-4fab-b9b1-849f03565533 req-eaa3e698-e817-4f14-9892-1cda0778ae58 service nova] Acquiring lock "60b4514f-16f8-466d-9e58-b95c0bfb3f32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-69cb6ff3-7a27-4fab-b9b1-849f03565533 req-eaa3e698-e817-4f14-9892-1cda0778ae58 service nova] Lock "60b4514f-16f8-466d-9e58-b95c0bfb3f32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-69cb6ff3-7a27-4fab-b9b1-849f03565533 req-eaa3e698-e817-4f14-9892-1cda0778ae58 service nova] Lock "60b4514f-16f8-466d-9e58-b95c0bfb3f32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:17 user nova-compute[72773]: DEBUG nova.compute.manager [req-69cb6ff3-7a27-4fab-b9b1-849f03565533 req-eaa3e698-e817-4f14-9892-1cda0778ae58 service nova] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] No waiting events found dispatching network-vif-unplugged-3c311267-1174-4333-8de6-e0872bb91c07 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:31:17 user nova-compute[72773]: DEBUG nova.compute.manager [req-69cb6ff3-7a27-4fab-b9b1-849f03565533 req-eaa3e698-e817-4f14-9892-1cda0778ae58 service nova] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Received event network-vif-unplugged-3c311267-1174-4333-8de6-e0872bb91c07 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:18 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Instance destroyed successfully.
Aug 16 22:31:18 user nova-compute[72773]: DEBUG nova.objects.instance [None req-83d75841-2cf8-4417-802a-b1f84e02f232 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lazy-loading 'resources' on Instance uuid 60b4514f-16f8-466d-9e58-b95c0bfb3f32 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-83d75841-2cf8-4417-802a-b1f84e02f232 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:29:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1353856131',display_name='tempest-VolumesActionsTest-instance-1353856131',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1353856131',id=15,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:29:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9fc5a319bbe5472b84c6fa3373d5c6e8',ramdisk_id='',reservation_id='r-057fgi21',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1300049092',owner_user_name='tempest-VolumesActionsTest-1300049092-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:29:36Z,user_data=None,user_id='72a395fc29094394bbbe0411cbd4ccfc',uuid=60b4514f-16f8-466d-9e58-b95c0bfb3f32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c311267-1174-4333-8de6-e0872bb91c07", "address": "fa:16:3e:80:b6:33", "network": {"id": "5cde2c8a-cc09-442d-b474-eb3cd32efbf1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1685780614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc5a319bbe5472b84c6fa3373d5c6e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c311267-11", "ovs_interfaceid": "3c311267-1174-4333-8de6-e0872bb91c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-83d75841-2cf8-4417-802a-b1f84e02f232 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Converting VIF {"id": "3c311267-1174-4333-8de6-e0872bb91c07", "address": "fa:16:3e:80:b6:33", "network": {"id": "5cde2c8a-cc09-442d-b474-eb3cd32efbf1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1685780614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc5a319bbe5472b84c6fa3373d5c6e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c311267-11", "ovs_interfaceid": "3c311267-1174-4333-8de6-e0872bb91c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-83d75841-2cf8-4417-802a-b1f84e02f232 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:b6:33,bridge_name='br-int',has_traffic_filtering=True,id=3c311267-1174-4333-8de6-e0872bb91c07,network=Network(5cde2c8a-cc09-442d-b474-eb3cd32efbf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c311267-11') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG os_vif [None req-83d75841-2cf8-4417-802a-b1f84e02f232 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:b6:33,bridge_name='br-int',has_traffic_filtering=True,id=3c311267-1174-4333-8de6-e0872bb91c07,network=Network(5cde2c8a-cc09-442d-b474-eb3cd32efbf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c311267-11') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c311267-11, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:31:18 user nova-compute[72773]: INFO os_vif [None req-83d75841-2cf8-4417-802a-b1f84e02f232 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:b6:33,bridge_name='br-int',has_traffic_filtering=True,id=3c311267-1174-4333-8de6-e0872bb91c07,network=Network(5cde2c8a-cc09-442d-b474-eb3cd32efbf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c311267-11')
Aug 16 22:31:18 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-83d75841-2cf8-4417-802a-b1f84e02f232 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Deleting instance files /opt/stack/data/nova/instances/60b4514f-16f8-466d-9e58-b95c0bfb3f32_del
Aug 16 22:31:18 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-83d75841-2cf8-4417-802a-b1f84e02f232 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Deletion of /opt/stack/data/nova/instances/60b4514f-16f8-466d-9e58-b95c0bfb3f32_del complete
Aug 16 22:31:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_power_states {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:31:18 user nova-compute[72773]: INFO nova.compute.manager [None req-83d75841-2cf8-4417-802a-b1f84e02f232 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 16 22:31:18 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-83d75841-2cf8-4417-802a-b1f84e02f232 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:31:18 user nova-compute[72773]: WARNING nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] While synchronizing instance power states, found 9 instances in the database and 8 instances on the hypervisor.
Aug 16 22:31:18 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Triggering sync for uuid 956d334e-f190-4625-b144-ab44d2f3321a {{(pid=72773) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Triggering sync for uuid 4efab321-f2aa-456c-a1ae-b32f399f694d {{(pid=72773) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Triggering sync for uuid 02227d9f-5ddf-42fe-91a8-ce56d76aa274 {{(pid=72773) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Triggering sync for uuid c6adfa95-47ac-40d3-abc1-0c6027507f07 {{(pid=72773) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Triggering sync for uuid 030d076d-5099-4236-ae31-6025017eb51e {{(pid=72773) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Triggering sync for uuid 60b4514f-16f8-466d-9e58-b95c0bfb3f32 {{(pid=72773) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Triggering sync for uuid 5aa5adad-599d-424f-bbfc-7d87ead31b57 {{(pid=72773) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Triggering sync for uuid 384d4037-bac4-423f-bc7a-e64fe14d7f77 {{(pid=72773) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Triggering sync for uuid 848668c7-4a90-4bb4-8617-3784cd33ed22 {{(pid=72773) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "956d334e-f190-4625-b144-ab44d2f3321a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "956d334e-f190-4625-b144-ab44d2f3321a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "4efab321-f2aa-456c-a1ae-b32f399f694d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "4efab321-f2aa-456c-a1ae-b32f399f694d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "c6adfa95-47ac-40d3-abc1-0c6027507f07" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "c6adfa95-47ac-40d3-abc1-0c6027507f07" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "030d076d-5099-4236-ae31-6025017eb51e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "030d076d-5099-4236-ae31-6025017eb51e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "60b4514f-16f8-466d-9e58-b95c0bfb3f32" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "5aa5adad-599d-424f-bbfc-7d87ead31b57" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "384d4037-bac4-423f-bc7a-e64fe14d7f77" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "384d4037-bac4-423f-bc7a-e64fe14d7f77" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "848668c7-4a90-4bb4-8617-3784cd33ed22" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "848668c7-4a90-4bb4-8617-3784cd33ed22" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "956d334e-f190-4625-b144-ab44d2f3321a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "c6adfa95-47ac-40d3-abc1-0c6027507f07" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "384d4037-bac4-423f-bc7a-e64fe14d7f77" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "4efab321-f2aa-456c-a1ae-b32f399f694d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.133s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "030d076d-5099-4236-ae31-6025017eb51e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.147s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "848668c7-4a90-4bb4-8617-3784cd33ed22" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.163s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:19 user nova-compute[72773]: DEBUG nova.compute.manager [req-b3efb383-c487-43b4-bff9-d7737102ae07 req-336a046f-a0fb-4bba-861d-6845876b0d67 service nova] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Received event network-vif-deleted-3c311267-1174-4333-8de6-e0872bb91c07 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:31:19 user nova-compute[72773]: INFO nova.compute.manager [req-b3efb383-c487-43b4-bff9-d7737102ae07 req-336a046f-a0fb-4bba-861d-6845876b0d67 service nova] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Neutron deleted interface 3c311267-1174-4333-8de6-e0872bb91c07; detaching it from the instance and deleting it from the info cache
Aug 16 22:31:19 user nova-compute[72773]: DEBUG nova.network.neutron [req-b3efb383-c487-43b4-bff9-d7737102ae07 req-336a046f-a0fb-4bba-861d-6845876b0d67 service nova] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:31:19 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:31:19 user nova-compute[72773]: DEBUG nova.compute.manager [req-b3efb383-c487-43b4-bff9-d7737102ae07 req-336a046f-a0fb-4bba-861d-6845876b0d67 service nova] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Detach interface failed, port_id=3c311267-1174-4333-8de6-e0872bb91c07, reason: Instance 60b4514f-16f8-466d-9e58-b95c0bfb3f32 could not be found. {{(pid=72773) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 22:31:19 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Took 0.98 seconds to deallocate network for instance.
Aug 16 22:31:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-83d75841-2cf8-4417-802a-b1f84e02f232 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-83d75841-2cf8-4417-802a-b1f84e02f232 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:19 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-83d75841-2cf8-4417-802a-b1f84e02f232 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:31:19 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-83d75841-2cf8-4417-802a-b1f84e02f232 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:31:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-83d75841-2cf8-4417-802a-b1f84e02f232 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:19 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-83d75841-2cf8-4417-802a-b1f84e02f232 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Deleted allocations for instance 60b4514f-16f8-466d-9e58-b95c0bfb3f32
Aug 16 22:31:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-83d75841-2cf8-4417-802a-b1f84e02f232 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lock "60b4514f-16f8-466d-9e58-b95c0bfb3f32" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.555s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "60b4514f-16f8-466d-9e58-b95c0bfb3f32" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.560s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:19 user nova-compute[72773]: INFO nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] During sync_power_state the instance has a pending task (deleting). Skip.
Aug 16 22:31:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "60b4514f-16f8-466d-9e58-b95c0bfb3f32" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-cdf0efb2-44a6-4189-9737-f7256c844262 req-9e571330-6580-45b3-b7f0-1f1ffe84a462 service nova] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Received event network-vif-plugged-3c311267-1174-4333-8de6-e0872bb91c07 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:31:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-cdf0efb2-44a6-4189-9737-f7256c844262 req-9e571330-6580-45b3-b7f0-1f1ffe84a462 service nova] Acquiring lock "60b4514f-16f8-466d-9e58-b95c0bfb3f32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-cdf0efb2-44a6-4189-9737-f7256c844262 req-9e571330-6580-45b3-b7f0-1f1ffe84a462 service nova] Lock "60b4514f-16f8-466d-9e58-b95c0bfb3f32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-cdf0efb2-44a6-4189-9737-f7256c844262 req-9e571330-6580-45b3-b7f0-1f1ffe84a462 service nova] Lock "60b4514f-16f8-466d-9e58-b95c0bfb3f32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-cdf0efb2-44a6-4189-9737-f7256c844262 req-9e571330-6580-45b3-b7f0-1f1ffe84a462 service nova] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] No waiting events found dispatching network-vif-plugged-3c311267-1174-4333-8de6-e0872bb91c07 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:31:20 user nova-compute[72773]: WARNING nova.compute.manager [req-cdf0efb2-44a6-4189-9737-f7256c844262 req-9e571330-6580-45b3-b7f0-1f1ffe84a462 service nova] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Received unexpected event network-vif-plugged-3c311267-1174-4333-8de6-e0872bb91c07 for instance with vm_state deleted and task_state None.
Aug 16 22:31:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Acquiring lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:31:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:31:29 user nova-compute[72773]: INFO nova.compute.claims [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Claim successful on node user
Aug 16 22:31:29 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:31:29 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:31:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.378s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:31:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:31:29 user nova-compute[72773]: DEBUG nova.network.neutron [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:31:29 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:31:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:31:29 user nova-compute[72773]: DEBUG nova.policy [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '38a5ab8690e4428e8f047081cdbd4a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d68c72b1454d78934269042633293f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:31:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:31:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:31:29 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Creating image(s)
Aug 16 22:31:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "/opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "/opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.173s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.222s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk 1073741824" returned: 0 in 0.055s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f14080f6-77e1-42ac-8910-07365b910186 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "4efab321-f2aa-456c-a1ae-b32f399f694d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f14080f6-77e1-42ac-8910-07365b910186 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "4efab321-f2aa-456c-a1ae-b32f399f694d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f14080f6-77e1-42ac-8910-07365b910186 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "4efab321-f2aa-456c-a1ae-b32f399f694d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f14080f6-77e1-42ac-8910-07365b910186 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "4efab321-f2aa-456c-a1ae-b32f399f694d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f14080f6-77e1-42ac-8910-07365b910186 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "4efab321-f2aa-456c-a1ae-b32f399f694d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:30 user nova-compute[72773]: INFO nova.compute.manager [None req-f14080f6-77e1-42ac-8910-07365b910186 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Terminating instance
Aug 16 22:31:30 user nova-compute[72773]: DEBUG nova.compute.manager [None req-f14080f6-77e1-42ac-8910-07365b910186 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.174s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Cannot resize image /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG nova.objects.instance [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lazy-loading 'migration_context' on Instance uuid 9ea2a759-7a26-4ad6-9902-b8b75931b5f0 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Ensure instance console log exists: /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG nova.compute.manager [req-3112b2fd-4d4a-4e90-ac20-79442e8a6ac3 req-e1055263-1a3d-4ae5-8e78-cc4663332f55 service nova] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Received event network-vif-unplugged-94d9c8c3-7857-42d7-8e92-2b983bdd3dc6 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3112b2fd-4d4a-4e90-ac20-79442e8a6ac3 req-e1055263-1a3d-4ae5-8e78-cc4663332f55 service nova] Acquiring lock "4efab321-f2aa-456c-a1ae-b32f399f694d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3112b2fd-4d4a-4e90-ac20-79442e8a6ac3 req-e1055263-1a3d-4ae5-8e78-cc4663332f55 service nova] Lock "4efab321-f2aa-456c-a1ae-b32f399f694d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3112b2fd-4d4a-4e90-ac20-79442e8a6ac3 req-e1055263-1a3d-4ae5-8e78-cc4663332f55 service nova] Lock "4efab321-f2aa-456c-a1ae-b32f399f694d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG nova.compute.manager [req-3112b2fd-4d4a-4e90-ac20-79442e8a6ac3 req-e1055263-1a3d-4ae5-8e78-cc4663332f55 service nova] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] No waiting events found dispatching network-vif-unplugged-94d9c8c3-7857-42d7-8e92-2b983bdd3dc6 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:31:30 user nova-compute[72773]: DEBUG nova.compute.manager [req-3112b2fd-4d4a-4e90-ac20-79442e8a6ac3 req-e1055263-1a3d-4ae5-8e78-cc4663332f55 service nova] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Received event network-vif-unplugged-94d9c8c3-7857-42d7-8e92-2b983bdd3dc6 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:31:31 user nova-compute[72773]: DEBUG nova.network.neutron [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Successfully created port: 83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:31:31 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Instance destroyed successfully.
Aug 16 22:31:31 user nova-compute[72773]: DEBUG nova.objects.instance [None req-f14080f6-77e1-42ac-8910-07365b910186 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lazy-loading 'resources' on Instance uuid 4efab321-f2aa-456c-a1ae-b32f399f694d {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:31:31 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-f14080f6-77e1-42ac-8910-07365b910186 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:24:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1348965646',display_name='tempest-AttachVolumeNegativeTest-server-1348965646',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1348965646',id=3,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgiWRewC2Qj7MCFuZm5XsSG5+qBpMj50m8UMlDPVMWPOYCjMw+98JOSdiCZj15yI+19kpSknqHpTPxlZFX9opRD1CSGfc2Ian5BiAAwK7I8p43qM6iObvFJTZpEk8tdDw==',key_name='tempest-keypair-1236772400',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:25:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc49739a140d40508ea307eedceb9aaa',ramdisk_id='',reservation_id='r-vgwa91ah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-801754299',owner_user_name='tempest-AttachVolumeNegativeTest-801754299-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:25:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3b873f599fc4a2686c154d856bd5f06',uuid=4efab321-f2aa-456c-a1ae-b32f399f694d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94d9c8c3-7857-42d7-8e92-2b983bdd3dc6", "address": "fa:16:3e:05:f5:f1", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d9c8c3-78", "ovs_interfaceid": "94d9c8c3-7857-42d7-8e92-2b983bdd3dc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:31:31 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-f14080f6-77e1-42ac-8910-07365b910186 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Converting VIF {"id": "94d9c8c3-7857-42d7-8e92-2b983bdd3dc6", "address": "fa:16:3e:05:f5:f1", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94d9c8c3-78", "ovs_interfaceid": "94d9c8c3-7857-42d7-8e92-2b983bdd3dc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:31:31 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-f14080f6-77e1-42ac-8910-07365b910186 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:f5:f1,bridge_name='br-int',has_traffic_filtering=True,id=94d9c8c3-7857-42d7-8e92-2b983bdd3dc6,network=Network(e0974c13-ec74-4a35-95b4-afae254c04a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94d9c8c3-78') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:31:31 user nova-compute[72773]: DEBUG os_vif [None req-f14080f6-77e1-42ac-8910-07365b910186 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:f5:f1,bridge_name='br-int',has_traffic_filtering=True,id=94d9c8c3-7857-42d7-8e92-2b983bdd3dc6,network=Network(e0974c13-ec74-4a35-95b4-afae254c04a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94d9c8c3-78') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:31:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94d9c8c3-78, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:31:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:31:31 user nova-compute[72773]: INFO os_vif [None req-f14080f6-77e1-42ac-8910-07365b910186 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:f5:f1,bridge_name='br-int',has_traffic_filtering=True,id=94d9c8c3-7857-42d7-8e92-2b983bdd3dc6,network=Network(e0974c13-ec74-4a35-95b4-afae254c04a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94d9c8c3-78')
Aug 16 22:31:31 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-f14080f6-77e1-42ac-8910-07365b910186 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Deleting instance files /opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d_del
Aug 16 22:31:31 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-f14080f6-77e1-42ac-8910-07365b910186 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Deletion of /opt/stack/data/nova/instances/4efab321-f2aa-456c-a1ae-b32f399f694d_del complete
Aug 16 22:31:31 user nova-compute[72773]: INFO nova.compute.manager [None req-f14080f6-77e1-42ac-8910-07365b910186 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 16 22:31:31 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-f14080f6-77e1-42ac-8910-07365b910186 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:31:31 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:31:31 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:31:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Acquiring lock "ac2b49e4-59bc-46cd-b7d9-67aa68296e4e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lock "ac2b49e4-59bc-46cd-b7d9-67aa68296e4e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:32 user nova-compute[72773]: DEBUG nova.compute.manager [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:31:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:32 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:31:32 user nova-compute[72773]: INFO nova.compute.claims [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Claim successful on node user
Aug 16 22:31:32 user nova-compute[72773]: DEBUG nova.network.neutron [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Successfully updated port: 83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:31:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Acquiring lock "refresh_cache-9ea2a759-7a26-4ad6-9902-b8b75931b5f0" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:31:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Acquired lock "refresh_cache-9ea2a759-7a26-4ad6-9902-b8b75931b5f0" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:31:32 user nova-compute[72773]: DEBUG nova.network.neutron [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:31:32 user nova-compute[72773]: DEBUG nova.compute.manager [req-636bef6d-3a38-4d1f-bf6d-032fb801fa81 req-ab5a69b9-af54-415e-949e-6534618af213 service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received event network-changed-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:31:32 user nova-compute[72773]: DEBUG nova.compute.manager [req-636bef6d-3a38-4d1f-bf6d-032fb801fa81 req-ab5a69b9-af54-415e-949e-6534618af213 service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Refreshing instance network info cache due to event network-changed-83003593-cfc0-44d3-94c6-4e3fb90573bd. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:31:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-636bef6d-3a38-4d1f-bf6d-032fb801fa81 req-ab5a69b9-af54-415e-949e-6534618af213 service nova] Acquiring lock "refresh_cache-9ea2a759-7a26-4ad6-9902-b8b75931b5f0" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:31:32 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:31:32 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:31:32 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Took 1.57 seconds to deallocate network for instance.
Aug 16 22:31:33 user nova-compute[72773]: DEBUG nova.network.neutron [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:31:33 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:31:33 user nova-compute[72773]: INFO nova.compute.manager [None req-a2cc3d50-6aa9-40fd-9f88-86280a60a683 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Unrescuing
Aug 16 22:31:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a2cc3d50-6aa9-40fd-9f88-86280a60a683 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "refresh_cache-030d076d-5099-4236-ae31-6025017eb51e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:31:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a2cc3d50-6aa9-40fd-9f88-86280a60a683 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquired lock "refresh_cache-030d076d-5099-4236-ae31-6025017eb51e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:31:33 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a2cc3d50-6aa9-40fd-9f88-86280a60a683 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:31:33 user nova-compute[72773]: DEBUG nova.compute.manager [req-6a479723-d5a1-46fa-9347-780f5720002d req-4aeeb736-e198-4047-b597-0eb70d402352 service nova] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Received event network-vif-plugged-94d9c8c3-7857-42d7-8e92-2b983bdd3dc6 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:31:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6a479723-d5a1-46fa-9347-780f5720002d req-4aeeb736-e198-4047-b597-0eb70d402352 service nova] Acquiring lock "4efab321-f2aa-456c-a1ae-b32f399f694d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6a479723-d5a1-46fa-9347-780f5720002d req-4aeeb736-e198-4047-b597-0eb70d402352 service nova] Lock "4efab321-f2aa-456c-a1ae-b32f399f694d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6a479723-d5a1-46fa-9347-780f5720002d req-4aeeb736-e198-4047-b597-0eb70d402352 service nova] Lock "4efab321-f2aa-456c-a1ae-b32f399f694d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:33 user nova-compute[72773]: DEBUG nova.compute.manager [req-6a479723-d5a1-46fa-9347-780f5720002d req-4aeeb736-e198-4047-b597-0eb70d402352 service nova] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] No waiting events found dispatching network-vif-plugged-94d9c8c3-7857-42d7-8e92-2b983bdd3dc6 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:31:33 user nova-compute[72773]: WARNING nova.compute.manager [req-6a479723-d5a1-46fa-9347-780f5720002d req-4aeeb736-e198-4047-b597-0eb70d402352 service nova] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Received unexpected event network-vif-plugged-94d9c8c3-7857-42d7-8e92-2b983bdd3dc6 for instance with vm_state active and task_state deleting.
Aug 16 22:31:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-26ca93c3-7e39-4187-aa9e-6029e9f00ff7 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-26ca93c3-7e39-4187-aa9e-6029e9f00ff7 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-26ca93c3-7e39-4187-aa9e-6029e9f00ff7 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-26ca93c3-7e39-4187-aa9e-6029e9f00ff7 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-26ca93c3-7e39-4187-aa9e-6029e9f00ff7 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:33 user nova-compute[72773]: INFO nova.compute.manager [None req-26ca93c3-7e39-4187-aa9e-6029e9f00ff7 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Terminating instance
Aug 16 22:31:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-26ca93c3-7e39-4187-aa9e-6029e9f00ff7 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:31:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.762s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:31:33 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692225078.2603679, 60b4514f-16f8-466d-9e58-b95c0bfb3f32 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:31:33 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] VM Stopped (Lifecycle Event)
Aug 16 22:31:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-8221faaa-85be-437d-bb63-01cd6e4b6c07 None None] [instance: 60b4514f-16f8-466d-9e58-b95c0bfb3f32] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:31:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f14080f6-77e1-42ac-8910-07365b910186 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f14080f6-77e1-42ac-8910-07365b910186 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:31:33 user nova-compute[72773]: DEBUG nova.network.neutron [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:31:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:33 user nova-compute[72773]: DEBUG nova.policy [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0d14c71e4a9d42d886602349c6d568e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a20f7a479ca4dbebe1ef08f466d2e55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:31:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:33 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:31:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:33 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-f14080f6-77e1-42ac-8910-07365b910186 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:31:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:31:33 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-f14080f6-77e1-42ac-8910-07365b910186 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:31:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f14080f6-77e1-42ac-8910-07365b910186 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.577s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:33 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-f14080f6-77e1-42ac-8910-07365b910186 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Deleted allocations for instance 4efab321-f2aa-456c-a1ae-b32f399f694d
Aug 16 22:31:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:31:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:31:33 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Creating image(s)
Aug 16 22:31:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Acquiring lock "/opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lock "/opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lock "/opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f14080f6-77e1-42ac-8910-07365b910186 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "4efab321-f2aa-456c-a1ae-b32f399f694d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.648s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.212s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:31:34 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Instance destroyed successfully.
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.objects.instance [None req-26ca93c3-7e39-4187-aa9e-6029e9f00ff7 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lazy-loading 'resources' on Instance uuid 02227d9f-5ddf-42fe-91a8-ce56d76aa274 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-26ca93c3-7e39-4187-aa9e-6029e9f00ff7 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T22:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-414068688',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-414068688',id=4,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGC6hdBcq53EaZ+ztnWCq9EEEmf6tlOudhff/uPCsPcoSF0txRuIbNZTZkFR19PxQuLSW0BQsR2r9cbeTZygr/GW6SXxJlq+Wnq0T9ugwZXHOdCCn9YF0qaQknT5h2D+7w==',key_name='tempest-keypair-1733371512',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:29:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2ef6a37d79341d7a94e5b314efddab4',ramdisk_id='',reservation_id='r-fl923se9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-488184195',owner_user_name='tempest-AttachVolumeShelveTestJSON-488184195-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:29:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71cd9d1142ec45e792219e8b789cf2a0',uuid=02227d9f-5ddf-42fe-91a8-ce56d76aa274,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "address": "fa:16:3e:4a:54:e0", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ca6ee6-83", "ovs_interfaceid": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-26ca93c3-7e39-4187-aa9e-6029e9f00ff7 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Converting VIF {"id": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "address": "fa:16:3e:4a:54:e0", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ca6ee6-83", "ovs_interfaceid": "26ca6ee6-83b5-4553-b31c-d1b135b219e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-26ca93c3-7e39-4187-aa9e-6029e9f00ff7 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:54:e0,bridge_name='br-int',has_traffic_filtering=True,id=26ca6ee6-83b5-4553-b31c-d1b135b219e9,network=Network(9aa7e6bf-5a47-422d-b638-cff5a8429391),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26ca6ee6-83') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG os_vif [None req-26ca93c3-7e39-4187-aa9e-6029e9f00ff7 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:54:e0,bridge_name='br-int',has_traffic_filtering=True,id=26ca6ee6-83b5-4553-b31c-d1b135b219e9,network=Network(9aa7e6bf-5a47-422d-b638-cff5a8429391),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26ca6ee6-83') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26ca6ee6-83, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:31:34 user nova-compute[72773]: INFO os_vif [None req-26ca93c3-7e39-4187-aa9e-6029e9f00ff7 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:54:e0,bridge_name='br-int',has_traffic_filtering=True,id=26ca6ee6-83b5-4553-b31c-d1b135b219e9,network=Network(9aa7e6bf-5a47-422d-b638-cff5a8429391),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26ca6ee6-83')
Aug 16 22:31:34 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-26ca93c3-7e39-4187-aa9e-6029e9f00ff7 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Deleting instance files /opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274_del
Aug 16 22:31:34 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-26ca93c3-7e39-4187-aa9e-6029e9f00ff7 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Deletion of /opt/stack/data/nova/instances/02227d9f-5ddf-42fe-91a8-ce56d76aa274_del complete
Aug 16 22:31:34 user nova-compute[72773]: INFO nova.compute.manager [None req-26ca93c3-7e39-4187-aa9e-6029e9f00ff7 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 16 22:31:34 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-26ca93c3-7e39-4187-aa9e-6029e9f00ff7 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.205s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.network.neutron [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Updating instance_info_cache with network_info: [{"id": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "address": "fa:16:3e:e4:b7:3c", "network": {"id": "a18f2224-ffb0-4406-9c92-5dad954c3a2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1329143363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d68c72b1454d78934269042633293f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83003593-cf", "ovs_interfaceid": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk 1073741824" returned: 0 in 0.059s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Releasing lock "refresh_cache-9ea2a759-7a26-4ad6-9902-b8b75931b5f0" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.compute.manager [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Instance network_info: |[{"id": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "address": "fa:16:3e:e4:b7:3c", "network": {"id": "a18f2224-ffb0-4406-9c92-5dad954c3a2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1329143363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d68c72b1454d78934269042633293f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83003593-cf", "ovs_interfaceid": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-636bef6d-3a38-4d1f-bf6d-032fb801fa81 req-ab5a69b9-af54-415e-949e-6534618af213 service nova] Acquired lock "refresh_cache-9ea2a759-7a26-4ad6-9902-b8b75931b5f0" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.network.neutron [req-636bef6d-3a38-4d1f-bf6d-032fb801fa81 req-ab5a69b9-af54-415e-949e-6534618af213 service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Refreshing network info cache for port 83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Start _get_guest_xml network_info=[{"id": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "address": "fa:16:3e:e4:b7:3c", "network": {"id": "a18f2224-ffb0-4406-9c92-5dad954c3a2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1329143363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d68c72b1454d78934269042633293f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83003593-cf", "ovs_interfaceid": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:31:34 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:31:34 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:31:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-738184949',display_name='tempest-ServerStableDeviceRescueTest-server-738184949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-738184949',id=19,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdDs0qSvSZ6qEmvaVSSkiC4v5VB61+2JkRBiyKREBlAfJAmOwhbAu0s7p7884ybaAUHg4xbKZuXPFC0FkwnafltxzeE+Ad+yovVfqAeD9IMpKRqI2/X3YGc2Onpir2t3A==',key_name='tempest-keypair-261024075',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2d68c72b1454d78934269042633293f',ramdisk_id='',reservation_id='r-1sapniu7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1505608702',owner_user_name='tempest-ServerStableDeviceRescueTest-1505608702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:31:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38a5ab8690e4428e8f047081cdbd4a1e',uuid=9ea2a759-7a26-4ad6-9902-b8b75931b5f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "address": "fa:16:3e:e4:b7:3c", "network": {"id": "a18f2224-ffb0-4406-9c92-5dad954c3a2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1329143363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d68c72b1454d78934269042633293f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83003593-cf", "ovs_interfaceid": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Converting VIF {"id": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "address": "fa:16:3e:e4:b7:3c", "network": {"id": "a18f2224-ffb0-4406-9c92-5dad954c3a2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1329143363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d68c72b1454d78934269042633293f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83003593-cf", "ovs_interfaceid": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:b7:3c,bridge_name='br-int',has_traffic_filtering=True,id=83003593-cfc0-44d3-94c6-4e3fb90573bd,network=Network(a18f2224-ffb0-4406-9c92-5dad954c3a2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83003593-cf') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.objects.instance [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ea2a759-7a26-4ad6-9902-b8b75931b5f0 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a2cc3d50-6aa9-40fd-9f88-86280a60a683 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Updating instance_info_cache with network_info: [{"id": "bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c", "address": "fa:16:3e:27:b6:2b", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc3b07d-2b", "ovs_interfaceid": "bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:31:34 user nova-compute[72773]:   <uuid>9ea2a759-7a26-4ad6-9902-b8b75931b5f0</uuid>
Aug 16 22:31:34 user nova-compute[72773]:   <name>instance-00000013</name>
Aug 16 22:31:34 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:31:34 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:31:34 user nova-compute[72773]:   <metadata>
Aug 16 22:31:34 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:31:34 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:31:34 user nova-compute[72773]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-738184949</nova:name>
Aug 16 22:31:34 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:31:34</nova:creationTime>
Aug 16 22:31:34 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:31:34 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:31:34 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:31:34 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:31:34 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:31:34 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:31:34 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:31:34 user nova-compute[72773]:       <nova:owner>
Aug 16 22:31:34 user nova-compute[72773]:         <nova:user uuid="38a5ab8690e4428e8f047081cdbd4a1e">tempest-ServerStableDeviceRescueTest-1505608702-project-member</nova:user>
Aug 16 22:31:34 user nova-compute[72773]:         <nova:project uuid="d2d68c72b1454d78934269042633293f">tempest-ServerStableDeviceRescueTest-1505608702</nova:project>
Aug 16 22:31:34 user nova-compute[72773]:       </nova:owner>
Aug 16 22:31:34 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:31:34 user nova-compute[72773]:       <nova:ports>
Aug 16 22:31:34 user nova-compute[72773]:         <nova:port uuid="83003593-cfc0-44d3-94c6-4e3fb90573bd">
Aug 16 22:31:34 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 22:31:34 user nova-compute[72773]:         </nova:port>
Aug 16 22:31:34 user nova-compute[72773]:       </nova:ports>
Aug 16 22:31:34 user nova-compute[72773]:     </nova:instance>
Aug 16 22:31:34 user nova-compute[72773]:   </metadata>
Aug 16 22:31:34 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:31:34 user nova-compute[72773]:     <system>
Aug 16 22:31:34 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:31:34 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:31:34 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:31:34 user nova-compute[72773]:       <entry name="serial">9ea2a759-7a26-4ad6-9902-b8b75931b5f0</entry>
Aug 16 22:31:34 user nova-compute[72773]:       <entry name="uuid">9ea2a759-7a26-4ad6-9902-b8b75931b5f0</entry>
Aug 16 22:31:34 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:31:34 user nova-compute[72773]:     </system>
Aug 16 22:31:34 user nova-compute[72773]:   </sysinfo>
Aug 16 22:31:34 user nova-compute[72773]:   <os>
Aug 16 22:31:34 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:31:34 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:31:34 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:31:34 user nova-compute[72773]:   </os>
Aug 16 22:31:34 user nova-compute[72773]:   <features>
Aug 16 22:31:34 user nova-compute[72773]:     <acpi/>
Aug 16 22:31:34 user nova-compute[72773]:     <apic/>
Aug 16 22:31:34 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:31:34 user nova-compute[72773]:   </features>
Aug 16 22:31:34 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:31:34 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:31:34 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:31:34 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:31:34 user nova-compute[72773]:   </clock>
Aug 16 22:31:34 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:31:34 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:31:34 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:31:34 user nova-compute[72773]:   </cpu>
Aug 16 22:31:34 user nova-compute[72773]:   <devices>
Aug 16 22:31:34 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:31:34 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:31:34 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk"/>
Aug 16 22:31:34 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:31:34 user nova-compute[72773]:     </disk>
Aug 16 22:31:34 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:31:34 user nova-compute[72773]:       <mac address="fa:16:3e:e4:b7:3c"/>
Aug 16 22:31:34 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:31:34 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:31:34 user nova-compute[72773]:       <target dev="tap83003593-cf"/>
Aug 16 22:31:34 user nova-compute[72773]:     </interface>
Aug 16 22:31:34 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:31:34 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/console.log" append="off"/>
Aug 16 22:31:34 user nova-compute[72773]:     </serial>
Aug 16 22:31:34 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:31:34 user nova-compute[72773]:     <video>
Aug 16 22:31:34 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:31:34 user nova-compute[72773]:     </video>
Aug 16 22:31:34 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:31:34 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:31:34 user nova-compute[72773]:     </rng>
Aug 16 22:31:34 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:31:34 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:31:34 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:31:34 user nova-compute[72773]:     </memballoon>
Aug 16 22:31:34 user nova-compute[72773]:   </devices>
Aug 16 22:31:34 user nova-compute[72773]: </domain>
Aug 16 22:31:34 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:31:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-738184949',display_name='tempest-ServerStableDeviceRescueTest-server-738184949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-738184949',id=19,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdDs0qSvSZ6qEmvaVSSkiC4v5VB61+2JkRBiyKREBlAfJAmOwhbAu0s7p7884ybaAUHg4xbKZuXPFC0FkwnafltxzeE+Ad+yovVfqAeD9IMpKRqI2/X3YGc2Onpir2t3A==',key_name='tempest-keypair-261024075',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2d68c72b1454d78934269042633293f',ramdisk_id='',reservation_id='r-1sapniu7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1505608702',owner_user_name='tempest-ServerStableDeviceRescueTest-1505608702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:31:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38a5ab8690e4428e8f047081cdbd4a1e',uuid=9ea2a759-7a26-4ad6-9902-b8b75931b5f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "address": "fa:16:3e:e4:b7:3c", "network": {"id": "a18f2224-ffb0-4406-9c92-5dad954c3a2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1329143363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d68c72b1454d78934269042633293f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83003593-cf", "ovs_interfaceid": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Converting VIF {"id": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "address": "fa:16:3e:e4:b7:3c", "network": {"id": "a18f2224-ffb0-4406-9c92-5dad954c3a2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1329143363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d68c72b1454d78934269042633293f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83003593-cf", "ovs_interfaceid": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:b7:3c,bridge_name='br-int',has_traffic_filtering=True,id=83003593-cfc0-44d3-94c6-4e3fb90573bd,network=Network(a18f2224-ffb0-4406-9c92-5dad954c3a2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83003593-cf') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG os_vif [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:b7:3c,bridge_name='br-int',has_traffic_filtering=True,id=83003593-cfc0-44d3-94c6-4e3fb90573bd,network=Network(a18f2224-ffb0-4406-9c92-5dad954c3a2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83003593-cf') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.196s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a2cc3d50-6aa9-40fd-9f88-86280a60a683 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Releasing lock "refresh_cache-030d076d-5099-4236-ae31-6025017eb51e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.objects.instance [None req-a2cc3d50-6aa9-40fd-9f88-86280a60a683 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lazy-loading 'flavor' on Instance uuid 030d076d-5099-4236-ae31-6025017eb51e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83003593-cf, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap83003593-cf, col_values=(('external_ids', {'iface-id': '83003593-cfc0-44d3-94c6-4e3fb90573bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:b7:3c', 'vm-uuid': '9ea2a759-7a26-4ad6-9902-b8b75931b5f0'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:34 user nova-compute[72773]: INFO os_vif [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:b7:3c,bridge_name='br-int',has_traffic_filtering=True,id=83003593-cfc0-44d3-94c6-4e3fb90573bd,network=Network(a18f2224-ffb0-4406-9c92-5dad954c3a2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83003593-cf')
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] No VIF found with MAC fa:16:3e:e4:b7:3c, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Cannot resize image /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.objects.instance [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lazy-loading 'migration_context' on Instance uuid ac2b49e4-59bc-46cd-b7d9-67aa68296e4e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Ensure instance console log exists: /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.network.neutron [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Successfully created port: aa173151-ed37-4416-97d6-4bb197ad7396 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:31:34 user nova-compute[72773]: DEBUG nova.compute.manager [req-ca76d062-e71b-4669-bf17-689ac0155795 req-558dc4ee-2deb-495a-beb5-479771388abe service nova] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Received event network-vif-deleted-94d9c8c3-7857-42d7-8e92-2b983bdd3dc6 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:31:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:35 user nova-compute[72773]: DEBUG nova.network.neutron [req-636bef6d-3a38-4d1f-bf6d-032fb801fa81 req-ab5a69b9-af54-415e-949e-6534618af213 service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Updated VIF entry in instance network info cache for port 83003593-cfc0-44d3-94c6-4e3fb90573bd. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:31:35 user nova-compute[72773]: DEBUG nova.network.neutron [req-636bef6d-3a38-4d1f-bf6d-032fb801fa81 req-ab5a69b9-af54-415e-949e-6534618af213 service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Updating instance_info_cache with network_info: [{"id": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "address": "fa:16:3e:e4:b7:3c", "network": {"id": "a18f2224-ffb0-4406-9c92-5dad954c3a2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1329143363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d68c72b1454d78934269042633293f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83003593-cf", "ovs_interfaceid": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:31:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-636bef6d-3a38-4d1f-bf6d-032fb801fa81 req-ab5a69b9-af54-415e-949e-6534618af213 service nova] Releasing lock "refresh_cache-9ea2a759-7a26-4ad6-9902-b8b75931b5f0" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:31:35 user nova-compute[72773]: DEBUG nova.compute.manager [req-45cd9b36-4663-41b2-a10e-e19b2723c6c3 req-fbc4bce6-3fc8-4af4-ac9f-abc80e7621e5 service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Received event network-vif-unplugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:31:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-45cd9b36-4663-41b2-a10e-e19b2723c6c3 req-fbc4bce6-3fc8-4af4-ac9f-abc80e7621e5 service nova] Acquiring lock "030d076d-5099-4236-ae31-6025017eb51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-45cd9b36-4663-41b2-a10e-e19b2723c6c3 req-fbc4bce6-3fc8-4af4-ac9f-abc80e7621e5 service nova] Lock "030d076d-5099-4236-ae31-6025017eb51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-45cd9b36-4663-41b2-a10e-e19b2723c6c3 req-fbc4bce6-3fc8-4af4-ac9f-abc80e7621e5 service nova] Lock "030d076d-5099-4236-ae31-6025017eb51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:35 user nova-compute[72773]: DEBUG nova.compute.manager [req-45cd9b36-4663-41b2-a10e-e19b2723c6c3 req-fbc4bce6-3fc8-4af4-ac9f-abc80e7621e5 service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] No waiting events found dispatching network-vif-unplugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:31:35 user nova-compute[72773]: WARNING nova.compute.manager [req-45cd9b36-4663-41b2-a10e-e19b2723c6c3 req-fbc4bce6-3fc8-4af4-ac9f-abc80e7621e5 service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Received unexpected event network-vif-unplugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c for instance with vm_state rescued and task_state unrescuing.
Aug 16 22:31:35 user nova-compute[72773]: DEBUG nova.network.neutron [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Successfully updated port: aa173151-ed37-4416-97d6-4bb197ad7396 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:31:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Acquiring lock "refresh_cache-ac2b49e4-59bc-46cd-b7d9-67aa68296e4e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:31:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Acquired lock "refresh_cache-ac2b49e4-59bc-46cd-b7d9-67aa68296e4e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:31:35 user nova-compute[72773]: DEBUG nova.network.neutron [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:31:35 user nova-compute[72773]: DEBUG nova.compute.manager [req-c164eda9-67f5-4ccc-be47-71a1b301cfac req-350787d0-7639-49da-8c1e-85c89c7fc911 service nova] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Received event network-changed-aa173151-ed37-4416-97d6-4bb197ad7396 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:31:35 user nova-compute[72773]: DEBUG nova.compute.manager [req-c164eda9-67f5-4ccc-be47-71a1b301cfac req-350787d0-7639-49da-8c1e-85c89c7fc911 service nova] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Refreshing instance network info cache due to event network-changed-aa173151-ed37-4416-97d6-4bb197ad7396. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:31:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c164eda9-67f5-4ccc-be47-71a1b301cfac req-350787d0-7639-49da-8c1e-85c89c7fc911 service nova] Acquiring lock "refresh_cache-ac2b49e4-59bc-46cd-b7d9-67aa68296e4e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:31:35 user nova-compute[72773]: DEBUG nova.network.neutron [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG nova.network.neutron [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Updating instance_info_cache with network_info: [{"id": "aa173151-ed37-4416-97d6-4bb197ad7396", "address": "fa:16:3e:f3:88:89", "network": {"id": "0567b846-3f19-403c-9ec6-ac2a82af5f4a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-290484898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a20f7a479ca4dbebe1ef08f466d2e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa173151-ed", "ovs_interfaceid": "aa173151-ed37-4416-97d6-4bb197ad7396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Releasing lock "refresh_cache-ac2b49e4-59bc-46cd-b7d9-67aa68296e4e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG nova.compute.manager [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Instance network_info: |[{"id": "aa173151-ed37-4416-97d6-4bb197ad7396", "address": "fa:16:3e:f3:88:89", "network": {"id": "0567b846-3f19-403c-9ec6-ac2a82af5f4a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-290484898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a20f7a479ca4dbebe1ef08f466d2e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa173151-ed", "ovs_interfaceid": "aa173151-ed37-4416-97d6-4bb197ad7396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c164eda9-67f5-4ccc-be47-71a1b301cfac req-350787d0-7639-49da-8c1e-85c89c7fc911 service nova] Acquired lock "refresh_cache-ac2b49e4-59bc-46cd-b7d9-67aa68296e4e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG nova.network.neutron [req-c164eda9-67f5-4ccc-be47-71a1b301cfac req-350787d0-7639-49da-8c1e-85c89c7fc911 service nova] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Refreshing network info cache for port aa173151-ed37-4416-97d6-4bb197ad7396 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Start _get_guest_xml network_info=[{"id": "aa173151-ed37-4416-97d6-4bb197ad7396", "address": "fa:16:3e:f3:88:89", "network": {"id": "0567b846-3f19-403c-9ec6-ac2a82af5f4a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-290484898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a20f7a479ca4dbebe1ef08f466d2e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa173151-ed", "ovs_interfaceid": "aa173151-ed37-4416-97d6-4bb197ad7396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:31:36 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:31:36 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:31:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:31:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1449502529',display_name='tempest-ServersNegativeTestJSON-server-1449502529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1449502529',id=20,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a20f7a479ca4dbebe1ef08f466d2e55',ramdisk_id='',reservation_id='r-l90m3qw5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-526921722',owner_user_name='tempest-ServersNegativeTestJSON-526921722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:31:34Z,user_data=None,user_id='0d14c71e4a9d42d886602349c6d568e8',uuid=ac2b49e4-59bc-46cd-b7d9-67aa68296e4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa173151-ed37-4416-97d6-4bb197ad7396", "address": "fa:16:3e:f3:88:89", "network": {"id": "0567b846-3f19-403c-9ec6-ac2a82af5f4a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-290484898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a20f7a479ca4dbebe1ef08f466d2e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa173151-ed", "ovs_interfaceid": "aa173151-ed37-4416-97d6-4bb197ad7396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Converting VIF {"id": "aa173151-ed37-4416-97d6-4bb197ad7396", "address": "fa:16:3e:f3:88:89", "network": {"id": "0567b846-3f19-403c-9ec6-ac2a82af5f4a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-290484898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a20f7a479ca4dbebe1ef08f466d2e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa173151-ed", "ovs_interfaceid": "aa173151-ed37-4416-97d6-4bb197ad7396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:88:89,bridge_name='br-int',has_traffic_filtering=True,id=aa173151-ed37-4416-97d6-4bb197ad7396,network=Network(0567b846-3f19-403c-9ec6-ac2a82af5f4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa173151-ed') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG nova.objects.instance [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lazy-loading 'pci_devices' on Instance uuid ac2b49e4-59bc-46cd-b7d9-67aa68296e4e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:31:36 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Took 1.78 seconds to deallocate network for instance.
Aug 16 22:31:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:31:36 user nova-compute[72773]:   <uuid>ac2b49e4-59bc-46cd-b7d9-67aa68296e4e</uuid>
Aug 16 22:31:36 user nova-compute[72773]:   <name>instance-00000014</name>
Aug 16 22:31:36 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:31:36 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:31:36 user nova-compute[72773]:   <metadata>
Aug 16 22:31:36 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:31:36 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:31:36 user nova-compute[72773]:       <nova:name>tempest-ServersNegativeTestJSON-server-1449502529</nova:name>
Aug 16 22:31:36 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:31:36</nova:creationTime>
Aug 16 22:31:36 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:31:36 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:31:36 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:31:36 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:31:36 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:31:36 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:31:36 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:31:36 user nova-compute[72773]:       <nova:owner>
Aug 16 22:31:36 user nova-compute[72773]:         <nova:user uuid="0d14c71e4a9d42d886602349c6d568e8">tempest-ServersNegativeTestJSON-526921722-project-member</nova:user>
Aug 16 22:31:36 user nova-compute[72773]:         <nova:project uuid="7a20f7a479ca4dbebe1ef08f466d2e55">tempest-ServersNegativeTestJSON-526921722</nova:project>
Aug 16 22:31:36 user nova-compute[72773]:       </nova:owner>
Aug 16 22:31:36 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:31:36 user nova-compute[72773]:       <nova:ports>
Aug 16 22:31:36 user nova-compute[72773]:         <nova:port uuid="aa173151-ed37-4416-97d6-4bb197ad7396">
Aug 16 22:31:36 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 22:31:36 user nova-compute[72773]:         </nova:port>
Aug 16 22:31:36 user nova-compute[72773]:       </nova:ports>
Aug 16 22:31:36 user nova-compute[72773]:     </nova:instance>
Aug 16 22:31:36 user nova-compute[72773]:   </metadata>
Aug 16 22:31:36 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:31:36 user nova-compute[72773]:     <system>
Aug 16 22:31:36 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:31:36 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:31:36 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:31:36 user nova-compute[72773]:       <entry name="serial">ac2b49e4-59bc-46cd-b7d9-67aa68296e4e</entry>
Aug 16 22:31:36 user nova-compute[72773]:       <entry name="uuid">ac2b49e4-59bc-46cd-b7d9-67aa68296e4e</entry>
Aug 16 22:31:36 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:31:36 user nova-compute[72773]:     </system>
Aug 16 22:31:36 user nova-compute[72773]:   </sysinfo>
Aug 16 22:31:36 user nova-compute[72773]:   <os>
Aug 16 22:31:36 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:31:36 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:31:36 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:31:36 user nova-compute[72773]:   </os>
Aug 16 22:31:36 user nova-compute[72773]:   <features>
Aug 16 22:31:36 user nova-compute[72773]:     <acpi/>
Aug 16 22:31:36 user nova-compute[72773]:     <apic/>
Aug 16 22:31:36 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:31:36 user nova-compute[72773]:   </features>
Aug 16 22:31:36 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:31:36 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:31:36 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:31:36 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:31:36 user nova-compute[72773]:   </clock>
Aug 16 22:31:36 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:31:36 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:31:36 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:31:36 user nova-compute[72773]:   </cpu>
Aug 16 22:31:36 user nova-compute[72773]:   <devices>
Aug 16 22:31:36 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:31:36 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:31:36 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk"/>
Aug 16 22:31:36 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:31:36 user nova-compute[72773]:     </disk>
Aug 16 22:31:36 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:31:36 user nova-compute[72773]:       <mac address="fa:16:3e:f3:88:89"/>
Aug 16 22:31:36 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:31:36 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:31:36 user nova-compute[72773]:       <target dev="tapaa173151-ed"/>
Aug 16 22:31:36 user nova-compute[72773]:     </interface>
Aug 16 22:31:36 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:31:36 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/console.log" append="off"/>
Aug 16 22:31:36 user nova-compute[72773]:     </serial>
Aug 16 22:31:36 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:31:36 user nova-compute[72773]:     <video>
Aug 16 22:31:36 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:31:36 user nova-compute[72773]:     </video>
Aug 16 22:31:36 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:31:36 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:31:36 user nova-compute[72773]:     </rng>
Aug 16 22:31:36 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:31:36 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:31:36 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:31:36 user nova-compute[72773]:     </memballoon>
Aug 16 22:31:36 user nova-compute[72773]:   </devices>
Aug 16 22:31:36 user nova-compute[72773]: </domain>
Aug 16 22:31:36 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:31:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1449502529',display_name='tempest-ServersNegativeTestJSON-server-1449502529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1449502529',id=20,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a20f7a479ca4dbebe1ef08f466d2e55',ramdisk_id='',reservation_id='r-l90m3qw5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-526921722',owner_user_name='tempest-ServersNegativeTestJSON-526921722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:31:34Z,user_data=None,user_id='0d14c71e4a9d42d886602349c6d568e8',uuid=ac2b49e4-59bc-46cd-b7d9-67aa68296e4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa173151-ed37-4416-97d6-4bb197ad7396", "address": "fa:16:3e:f3:88:89", "network": {"id": "0567b846-3f19-403c-9ec6-ac2a82af5f4a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-290484898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a20f7a479ca4dbebe1ef08f466d2e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa173151-ed", "ovs_interfaceid": "aa173151-ed37-4416-97d6-4bb197ad7396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Converting VIF {"id": "aa173151-ed37-4416-97d6-4bb197ad7396", "address": "fa:16:3e:f3:88:89", "network": {"id": "0567b846-3f19-403c-9ec6-ac2a82af5f4a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-290484898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a20f7a479ca4dbebe1ef08f466d2e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa173151-ed", "ovs_interfaceid": "aa173151-ed37-4416-97d6-4bb197ad7396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:88:89,bridge_name='br-int',has_traffic_filtering=True,id=aa173151-ed37-4416-97d6-4bb197ad7396,network=Network(0567b846-3f19-403c-9ec6-ac2a82af5f4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa173151-ed') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG os_vif [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:88:89,bridge_name='br-int',has_traffic_filtering=True,id=aa173151-ed37-4416-97d6-4bb197ad7396,network=Network(0567b846-3f19-403c-9ec6-ac2a82af5f4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa173151-ed') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa173151-ed, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaa173151-ed, col_values=(('external_ids', {'iface-id': 'aa173151-ed37-4416-97d6-4bb197ad7396', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:88:89', 'vm-uuid': 'ac2b49e4-59bc-46cd-b7d9-67aa68296e4e'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:31:36 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Instance destroyed successfully.
Aug 16 22:31:36 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:36 user nova-compute[72773]: INFO os_vif [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:88:89,bridge_name='br-int',has_traffic_filtering=True,id=aa173151-ed37-4416-97d6-4bb197ad7396,network=Network(0567b846-3f19-403c-9ec6-ac2a82af5f4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa173151-ed')
Aug 16 22:31:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-26ca93c3-7e39-4187-aa9e-6029e9f00ff7 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-26ca93c3-7e39-4187-aa9e-6029e9f00ff7 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] No VIF found with MAC fa:16:3e:f3:88:89, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-26ca93c3-7e39-4187-aa9e-6029e9f00ff7 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-26ca93c3-7e39-4187-aa9e-6029e9f00ff7 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-26ca93c3-7e39-4187-aa9e-6029e9f00ff7 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG nova.network.neutron [req-c164eda9-67f5-4ccc-be47-71a1b301cfac req-350787d0-7639-49da-8c1e-85c89c7fc911 service nova] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Updated VIF entry in instance network info cache for port aa173151-ed37-4416-97d6-4bb197ad7396. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG nova.network.neutron [req-c164eda9-67f5-4ccc-be47-71a1b301cfac req-350787d0-7639-49da-8c1e-85c89c7fc911 service nova] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Updating instance_info_cache with network_info: [{"id": "aa173151-ed37-4416-97d6-4bb197ad7396", "address": "fa:16:3e:f3:88:89", "network": {"id": "0567b846-3f19-403c-9ec6-ac2a82af5f4a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-290484898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a20f7a479ca4dbebe1ef08f466d2e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa173151-ed", "ovs_interfaceid": "aa173151-ed37-4416-97d6-4bb197ad7396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c164eda9-67f5-4ccc-be47-71a1b301cfac req-350787d0-7639-49da-8c1e-85c89c7fc911 service nova] Releasing lock "refresh_cache-ac2b49e4-59bc-46cd-b7d9-67aa68296e4e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:31:36 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-26ca93c3-7e39-4187-aa9e-6029e9f00ff7 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Deleted allocations for instance 02227d9f-5ddf-42fe-91a8-ce56d76aa274
Aug 16 22:31:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-26ca93c3-7e39-4187-aa9e-6029e9f00ff7 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "02227d9f-5ddf-42fe-91a8-ce56d76aa274" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.479s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:37 user nova-compute[72773]: DEBUG nova.compute.manager [req-a75b1242-40ef-4a68-8a03-818e5952a47c req-5f31036f-26c6-4bf7-a5be-dc6810f6160e service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Received event network-vif-plugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:31:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a75b1242-40ef-4a68-8a03-818e5952a47c req-5f31036f-26c6-4bf7-a5be-dc6810f6160e service nova] Acquiring lock "030d076d-5099-4236-ae31-6025017eb51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a75b1242-40ef-4a68-8a03-818e5952a47c req-5f31036f-26c6-4bf7-a5be-dc6810f6160e service nova] Lock "030d076d-5099-4236-ae31-6025017eb51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a75b1242-40ef-4a68-8a03-818e5952a47c req-5f31036f-26c6-4bf7-a5be-dc6810f6160e service nova] Lock "030d076d-5099-4236-ae31-6025017eb51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:37 user nova-compute[72773]: DEBUG nova.compute.manager [req-a75b1242-40ef-4a68-8a03-818e5952a47c req-5f31036f-26c6-4bf7-a5be-dc6810f6160e service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] No waiting events found dispatching network-vif-plugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:31:37 user nova-compute[72773]: WARNING nova.compute.manager [req-a75b1242-40ef-4a68-8a03-818e5952a47c req-5f31036f-26c6-4bf7-a5be-dc6810f6160e service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Received unexpected event network-vif-plugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c for instance with vm_state rescued and task_state unrescuing.
Aug 16 22:31:37 user nova-compute[72773]: DEBUG nova.compute.manager [req-a75b1242-40ef-4a68-8a03-818e5952a47c req-5f31036f-26c6-4bf7-a5be-dc6810f6160e service nova] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Received event network-vif-deleted-26ca6ee6-83b5-4553-b31c-d1b135b219e9 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:31:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:37 user nova-compute[72773]: DEBUG nova.compute.manager [req-07fdbf43-7e30-4fb3-8887-dbfce5fbd21c req-2bca54f9-3bf5-468a-8cfc-a72dca380f4c service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received event network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:31:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-07fdbf43-7e30-4fb3-8887-dbfce5fbd21c req-2bca54f9-3bf5-468a-8cfc-a72dca380f4c service nova] Acquiring lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-07fdbf43-7e30-4fb3-8887-dbfce5fbd21c req-2bca54f9-3bf5-468a-8cfc-a72dca380f4c service nova] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-07fdbf43-7e30-4fb3-8887-dbfce5fbd21c req-2bca54f9-3bf5-468a-8cfc-a72dca380f4c service nova] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:37 user nova-compute[72773]: DEBUG nova.compute.manager [req-07fdbf43-7e30-4fb3-8887-dbfce5fbd21c req-2bca54f9-3bf5-468a-8cfc-a72dca380f4c service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] No waiting events found dispatching network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:31:37 user nova-compute[72773]: WARNING nova.compute.manager [req-07fdbf43-7e30-4fb3-8887-dbfce5fbd21c req-2bca54f9-3bf5-468a-8cfc-a72dca380f4c service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received unexpected event network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd for instance with vm_state building and task_state spawning.
Aug 16 22:31:37 user nova-compute[72773]: DEBUG nova.compute.manager [req-07fdbf43-7e30-4fb3-8887-dbfce5fbd21c req-2bca54f9-3bf5-468a-8cfc-a72dca380f4c service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received event network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:31:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-07fdbf43-7e30-4fb3-8887-dbfce5fbd21c req-2bca54f9-3bf5-468a-8cfc-a72dca380f4c service nova] Acquiring lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-07fdbf43-7e30-4fb3-8887-dbfce5fbd21c req-2bca54f9-3bf5-468a-8cfc-a72dca380f4c service nova] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-07fdbf43-7e30-4fb3-8887-dbfce5fbd21c req-2bca54f9-3bf5-468a-8cfc-a72dca380f4c service nova] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:37 user nova-compute[72773]: DEBUG nova.compute.manager [req-07fdbf43-7e30-4fb3-8887-dbfce5fbd21c req-2bca54f9-3bf5-468a-8cfc-a72dca380f4c service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] No waiting events found dispatching network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:31:37 user nova-compute[72773]: WARNING nova.compute.manager [req-07fdbf43-7e30-4fb3-8887-dbfce5fbd21c req-2bca54f9-3bf5-468a-8cfc-a72dca380f4c service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received unexpected event network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd for instance with vm_state building and task_state spawning.
Aug 16 22:31:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:39 user nova-compute[72773]: DEBUG nova.compute.manager [req-0c758df1-5de0-4a7e-b944-337173425656 req-e9456c7f-c297-4f2b-b9f0-ecb0bfa27171 service nova] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Received event network-vif-plugged-aa173151-ed37-4416-97d6-4bb197ad7396 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:31:39 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0c758df1-5de0-4a7e-b944-337173425656 req-e9456c7f-c297-4f2b-b9f0-ecb0bfa27171 service nova] Acquiring lock "ac2b49e4-59bc-46cd-b7d9-67aa68296e4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:39 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0c758df1-5de0-4a7e-b944-337173425656 req-e9456c7f-c297-4f2b-b9f0-ecb0bfa27171 service nova] Lock "ac2b49e4-59bc-46cd-b7d9-67aa68296e4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:39 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0c758df1-5de0-4a7e-b944-337173425656 req-e9456c7f-c297-4f2b-b9f0-ecb0bfa27171 service nova] Lock "ac2b49e4-59bc-46cd-b7d9-67aa68296e4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:39 user nova-compute[72773]: DEBUG nova.compute.manager [req-0c758df1-5de0-4a7e-b944-337173425656 req-e9456c7f-c297-4f2b-b9f0-ecb0bfa27171 service nova] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] No waiting events found dispatching network-vif-plugged-aa173151-ed37-4416-97d6-4bb197ad7396 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:31:39 user nova-compute[72773]: WARNING nova.compute.manager [req-0c758df1-5de0-4a7e-b944-337173425656 req-e9456c7f-c297-4f2b-b9f0-ecb0bfa27171 service nova] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Received unexpected event network-vif-plugged-aa173151-ed37-4416-97d6-4bb197ad7396 for instance with vm_state building and task_state spawning.
Aug 16 22:31:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:39 user nova-compute[72773]: DEBUG nova.compute.manager [req-541502d8-16c0-4458-9c67-8cd6a81fcf5f req-50e03f90-3163-47b6-82be-5f1cd816d5de service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Received event network-vif-plugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:31:39 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-541502d8-16c0-4458-9c67-8cd6a81fcf5f req-50e03f90-3163-47b6-82be-5f1cd816d5de service nova] Acquiring lock "030d076d-5099-4236-ae31-6025017eb51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:39 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-541502d8-16c0-4458-9c67-8cd6a81fcf5f req-50e03f90-3163-47b6-82be-5f1cd816d5de service nova] Lock "030d076d-5099-4236-ae31-6025017eb51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:39 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-541502d8-16c0-4458-9c67-8cd6a81fcf5f req-50e03f90-3163-47b6-82be-5f1cd816d5de service nova] Lock "030d076d-5099-4236-ae31-6025017eb51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:39 user nova-compute[72773]: DEBUG nova.compute.manager [req-541502d8-16c0-4458-9c67-8cd6a81fcf5f req-50e03f90-3163-47b6-82be-5f1cd816d5de service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] No waiting events found dispatching network-vif-plugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:31:39 user nova-compute[72773]: WARNING nova.compute.manager [req-541502d8-16c0-4458-9c67-8cd6a81fcf5f req-50e03f90-3163-47b6-82be-5f1cd816d5de service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Received unexpected event network-vif-plugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c for instance with vm_state rescued and task_state unrescuing.
Aug 16 22:31:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:40 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225100.3676953, 9ea2a759-7a26-4ad6-9902-b8b75931b5f0 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:31:40 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] VM Resumed (Lifecycle Event)
Aug 16 22:31:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:31:40 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:31:40 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Instance spawned successfully.
Aug 16 22:31:40 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:31:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:31:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:31:40 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:31:40 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:31:40 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:31:40 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:31:40 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:31:40 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:31:40 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:31:40 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225100.3710592, 9ea2a759-7a26-4ad6-9902-b8b75931b5f0 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:31:40 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] VM Started (Lifecycle Event)
Aug 16 22:31:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:31:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:31:40 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:31:40 user nova-compute[72773]: INFO nova.compute.manager [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Took 10.60 seconds to spawn the instance on the hypervisor.
Aug 16 22:31:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:31:40 user nova-compute[72773]: INFO nova.compute.manager [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Took 11.29 seconds to build instance.
Aug 16 22:31:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-937652b4-702e-4713-8509-aece97c4ed59 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.383s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:41 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:41 user nova-compute[72773]: DEBUG nova.compute.manager [req-76620ee6-4c73-448d-9b7e-73aa783c3583 req-84f10afb-1d8c-4cc4-962b-1609c8a0e485 service nova] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Received event network-vif-plugged-aa173151-ed37-4416-97d6-4bb197ad7396 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:31:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-76620ee6-4c73-448d-9b7e-73aa783c3583 req-84f10afb-1d8c-4cc4-962b-1609c8a0e485 service nova] Acquiring lock "ac2b49e4-59bc-46cd-b7d9-67aa68296e4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-76620ee6-4c73-448d-9b7e-73aa783c3583 req-84f10afb-1d8c-4cc4-962b-1609c8a0e485 service nova] Lock "ac2b49e4-59bc-46cd-b7d9-67aa68296e4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-76620ee6-4c73-448d-9b7e-73aa783c3583 req-84f10afb-1d8c-4cc4-962b-1609c8a0e485 service nova] Lock "ac2b49e4-59bc-46cd-b7d9-67aa68296e4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:41 user nova-compute[72773]: DEBUG nova.compute.manager [req-76620ee6-4c73-448d-9b7e-73aa783c3583 req-84f10afb-1d8c-4cc4-962b-1609c8a0e485 service nova] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] No waiting events found dispatching network-vif-plugged-aa173151-ed37-4416-97d6-4bb197ad7396 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:31:41 user nova-compute[72773]: WARNING nova.compute.manager [req-76620ee6-4c73-448d-9b7e-73aa783c3583 req-84f10afb-1d8c-4cc4-962b-1609c8a0e485 service nova] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Received unexpected event network-vif-plugged-aa173151-ed37-4416-97d6-4bb197ad7396 for instance with vm_state building and task_state spawning.
Aug 16 22:31:41 user nova-compute[72773]: DEBUG nova.compute.manager [req-ffc898d1-7043-4a65-a300-a58e9c0b2bd1 req-f2b86976-0494-4868-8ab2-e28bb22b35b4 service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Received event network-vif-plugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:31:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ffc898d1-7043-4a65-a300-a58e9c0b2bd1 req-f2b86976-0494-4868-8ab2-e28bb22b35b4 service nova] Acquiring lock "030d076d-5099-4236-ae31-6025017eb51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ffc898d1-7043-4a65-a300-a58e9c0b2bd1 req-f2b86976-0494-4868-8ab2-e28bb22b35b4 service nova] Lock "030d076d-5099-4236-ae31-6025017eb51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ffc898d1-7043-4a65-a300-a58e9c0b2bd1 req-f2b86976-0494-4868-8ab2-e28bb22b35b4 service nova] Lock "030d076d-5099-4236-ae31-6025017eb51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:41 user nova-compute[72773]: DEBUG nova.compute.manager [req-ffc898d1-7043-4a65-a300-a58e9c0b2bd1 req-f2b86976-0494-4868-8ab2-e28bb22b35b4 service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] No waiting events found dispatching network-vif-plugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:31:41 user nova-compute[72773]: WARNING nova.compute.manager [req-ffc898d1-7043-4a65-a300-a58e9c0b2bd1 req-f2b86976-0494-4868-8ab2-e28bb22b35b4 service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Received unexpected event network-vif-plugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c for instance with vm_state rescued and task_state unrescuing.
Aug 16 22:31:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Removed pending event for 030d076d-5099-4236-ae31-6025017eb51e due to event {{(pid=72773) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 22:31:41 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225101.8900995, 030d076d-5099-4236-ae31-6025017eb51e => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:31:41 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 030d076d-5099-4236-ae31-6025017eb51e] VM Resumed (Lifecycle Event)
Aug 16 22:31:41 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a2cc3d50-6aa9-40fd-9f88-86280a60a683 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:31:41 user nova-compute[72773]: DEBUG nova.compute.manager [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:31:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:31:41 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:31:41 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Instance spawned successfully.
Aug 16 22:31:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:31:41 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:31:41 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 030d076d-5099-4236-ae31-6025017eb51e] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 22:31:41 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225101.892253, 030d076d-5099-4236-ae31-6025017eb51e => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:31:41 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 030d076d-5099-4236-ae31-6025017eb51e] VM Started (Lifecycle Event)
Aug 16 22:31:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:31:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:31:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:31:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:31:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:31:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:31:41 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:31:41 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:31:42 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225101.9001694, ac2b49e4-59bc-46cd-b7d9-67aa68296e4e => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:31:42 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] VM Resumed (Lifecycle Event)
Aug 16 22:31:42 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:31:42 user nova-compute[72773]: INFO nova.compute.manager [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Took 8.08 seconds to spawn the instance on the hypervisor.
Aug 16 22:31:42 user nova-compute[72773]: DEBUG nova.compute.manager [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:31:42 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:31:42 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:31:42 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225101.9008856, ac2b49e4-59bc-46cd-b7d9-67aa68296e4e => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:31:42 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] VM Started (Lifecycle Event)
Aug 16 22:31:42 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:31:42 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:31:42 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:31:42 user nova-compute[72773]: INFO nova.compute.manager [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Took 9.67 seconds to build instance.
Aug 16 22:31:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-fe803a8b-5e0b-4d22-abd0-964e29b47cec tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lock "ac2b49e4-59bc-46cd-b7d9-67aa68296e4e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.779s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:46 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692225091.1913993, 4efab321-f2aa-456c-a1ae-b32f399f694d => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:31:46 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] VM Stopped (Lifecycle Event)
Aug 16 22:31:46 user nova-compute[72773]: DEBUG nova.compute.manager [None req-c95a5dc5-0083-4425-87cc-6536f290dbef None None] [instance: 4efab321-f2aa-456c-a1ae-b32f399f694d] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:31:46 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:31:48 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:31:48 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:31:48 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:31:49 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692225094.2014947, 02227d9f-5ddf-42fe-91a8-ce56d76aa274 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:31:49 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] VM Stopped (Lifecycle Event)
Aug 16 22:31:49 user nova-compute[72773]: DEBUG nova.compute.manager [None req-5ae3568c-6d17-4d30-82d8-33bb1008fe09 None None] [instance: 02227d9f-5ddf-42fe-91a8-ce56d76aa274] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:31:50 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:31:50 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:31:50 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Rebuilding the list of instances to heal {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 22:31:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-956d334e-f190-4625-b144-ab44d2f3321a" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:31:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-956d334e-f190-4625-b144-ab44d2f3321a" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:31:50 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 22:31:50 user nova-compute[72773]: DEBUG nova.objects.instance [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lazy-loading 'info_cache' on Instance uuid 956d334e-f190-4625-b144-ab44d2f3321a {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:31:51 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Updating instance_info_cache with network_info: [{"id": "d1807881-ec54-4e55-8f2e-6f8046efd351", "address": "fa:16:3e:b5:0f:ad", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1807881-ec", "ovs_interfaceid": "d1807881-ec54-4e55-8f2e-6f8046efd351", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:31:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-956d334e-f190-4625-b144-ab44d2f3321a" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:31:51 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 22:31:51 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:31:51 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:31:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:31:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 22:31:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:31:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:31:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:51 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:31:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:52 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:31:53 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:31:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:53 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:31:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:31:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:31:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:31:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:31:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848668c7-4a90-4bb4-8617-3784cd33ed22/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:31:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848668c7-4a90-4bb4-8617-3784cd33ed22/disk --force-share --output=json" returned: 0 in 0.356s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:31:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848668c7-4a90-4bb4-8617-3784cd33ed22/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:31:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848668c7-4a90-4bb4-8617-3784cd33ed22/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:31:54 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:31:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:31:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:31:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:31:55 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:31:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:31:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8637b443-14a3-4981-820f-d3354331f592 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Acquiring lock "c6adfa95-47ac-40d3-abc1-0c6027507f07" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8637b443-14a3-4981-820f-d3354331f592 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "c6adfa95-47ac-40d3-abc1-0c6027507f07" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8637b443-14a3-4981-820f-d3354331f592 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Acquiring lock "c6adfa95-47ac-40d3-abc1-0c6027507f07-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8637b443-14a3-4981-820f-d3354331f592 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "c6adfa95-47ac-40d3-abc1-0c6027507f07-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8637b443-14a3-4981-820f-d3354331f592 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "c6adfa95-47ac-40d3-abc1-0c6027507f07-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:55 user nova-compute[72773]: INFO nova.compute.manager [None req-8637b443-14a3-4981-820f-d3354331f592 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Terminating instance
Aug 16 22:31:55 user nova-compute[72773]: DEBUG nova.compute.manager [None req-8637b443-14a3-4981-820f-d3354331f592 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:31:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:31:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:31:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:31:55 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:31:55 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:31:55 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:31:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:31:55 user nova-compute[72773]: DEBUG nova.compute.manager [req-f9341ddd-8a52-464a-9c21-19545feb706f req-48f72d9a-5c85-4a4a-96a8-5e765d708c9c service nova] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Received event network-vif-unplugged-813736f3-3cf2-4d52-9bf5-239b93647ee2 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:31:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f9341ddd-8a52-464a-9c21-19545feb706f req-48f72d9a-5c85-4a4a-96a8-5e765d708c9c service nova] Acquiring lock "c6adfa95-47ac-40d3-abc1-0c6027507f07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f9341ddd-8a52-464a-9c21-19545feb706f req-48f72d9a-5c85-4a4a-96a8-5e765d708c9c service nova] Lock "c6adfa95-47ac-40d3-abc1-0c6027507f07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f9341ddd-8a52-464a-9c21-19545feb706f req-48f72d9a-5c85-4a4a-96a8-5e765d708c9c service nova] Lock "c6adfa95-47ac-40d3-abc1-0c6027507f07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:55 user nova-compute[72773]: DEBUG nova.compute.manager [req-f9341ddd-8a52-464a-9c21-19545feb706f req-48f72d9a-5c85-4a4a-96a8-5e765d708c9c service nova] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] No waiting events found dispatching network-vif-unplugged-813736f3-3cf2-4d52-9bf5-239b93647ee2 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:31:55 user nova-compute[72773]: DEBUG nova.compute.manager [req-f9341ddd-8a52-464a-9c21-19545feb706f req-48f72d9a-5c85-4a4a-96a8-5e765d708c9c service nova] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Received event network-vif-unplugged-813736f3-3cf2-4d52-9bf5-239b93647ee2 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:31:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:31:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:31:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:31:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:31:56 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Instance destroyed successfully.
Aug 16 22:31:56 user nova-compute[72773]: DEBUG nova.objects.instance [None req-8637b443-14a3-4981-820f-d3354331f592 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lazy-loading 'resources' on Instance uuid c6adfa95-47ac-40d3-abc1-0c6027507f07 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:31:56 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-8637b443-14a3-4981-820f-d3354331f592 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1294117104',display_name='tempest-VolumesAdminNegativeTest-server-1294117104',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1294117104',id=6,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRWMftQ781JjYb0nzJaJuH2EAbEFNHAEEcXrOdOb0hALI/gs1sWKQ19FdNW8Om2Wh+Jz8h0z2FvT9bMF633wJJdBAFuAafzLnJxOEw1w7o2MkwWNxLorN7il/4PzN1jHQ==',key_name='tempest-keypair-1243701256',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:25:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9086072338454300bb7a455bff6d0757',ramdisk_id='',reservation_id='r-76ggpaa1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2096874148',owner_user_name='tempest-VolumesAdminNegativeTest-2096874148-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:25:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cdc2f4b4e44b46689635994d2d3ab066',uuid=c6adfa95-47ac-40d3-abc1-0c6027507f07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "813736f3-3cf2-4d52-9bf5-239b93647ee2", "address": "fa:16:3e:55:99:4d", "network": {"id": "db5b9d7a-8d3c-409c-961b-9bd7d882664c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1507737858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9086072338454300bb7a455bff6d0757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813736f3-3c", "ovs_interfaceid": "813736f3-3cf2-4d52-9bf5-239b93647ee2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:31:56 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-8637b443-14a3-4981-820f-d3354331f592 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Converting VIF {"id": "813736f3-3cf2-4d52-9bf5-239b93647ee2", "address": "fa:16:3e:55:99:4d", "network": {"id": "db5b9d7a-8d3c-409c-961b-9bd7d882664c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1507737858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9086072338454300bb7a455bff6d0757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813736f3-3c", "ovs_interfaceid": "813736f3-3cf2-4d52-9bf5-239b93647ee2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:31:56 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-8637b443-14a3-4981-820f-d3354331f592 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:99:4d,bridge_name='br-int',has_traffic_filtering=True,id=813736f3-3cf2-4d52-9bf5-239b93647ee2,network=Network(db5b9d7a-8d3c-409c-961b-9bd7d882664c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap813736f3-3c') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:31:56 user nova-compute[72773]: DEBUG os_vif [None req-8637b443-14a3-4981-820f-d3354331f592 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:99:4d,bridge_name='br-int',has_traffic_filtering=True,id=813736f3-3cf2-4d52-9bf5-239b93647ee2,network=Network(db5b9d7a-8d3c-409c-961b-9bd7d882664c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap813736f3-3c') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:31:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap813736f3-3c, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:31:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:31:56 user nova-compute[72773]: INFO os_vif [None req-8637b443-14a3-4981-820f-d3354331f592 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:99:4d,bridge_name='br-int',has_traffic_filtering=True,id=813736f3-3cf2-4d52-9bf5-239b93647ee2,network=Network(db5b9d7a-8d3c-409c-961b-9bd7d882664c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap813736f3-3c')
Aug 16 22:31:56 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-8637b443-14a3-4981-820f-d3354331f592 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Deleting instance files /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07_del
Aug 16 22:31:56 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-8637b443-14a3-4981-820f-d3354331f592 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Deletion of /opt/stack/data/nova/instances/c6adfa95-47ac-40d3-abc1-0c6027507f07_del complete
Aug 16 22:31:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:31:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:31:56 user nova-compute[72773]: INFO nova.compute.manager [None req-8637b443-14a3-4981-820f-d3354331f592 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 16 22:31:56 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-8637b443-14a3-4981-820f-d3354331f592 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:31:56 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:31:56 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:31:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:31:56 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:31:56 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:31:56 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=7566MB free_disk=25.774200439453125GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:31:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:57 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 956d334e-f190-4625-b144-ab44d2f3321a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:31:57 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance c6adfa95-47ac-40d3-abc1-0c6027507f07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:31:57 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 030d076d-5099-4236-ae31-6025017eb51e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:31:57 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 5aa5adad-599d-424f-bbfc-7d87ead31b57 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:31:57 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 384d4037-bac4-423f-bc7a-e64fe14d7f77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:31:57 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 848668c7-4a90-4bb4-8617-3784cd33ed22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:31:57 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 9ea2a759-7a26-4ad6-9902-b8b75931b5f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:31:57 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance ac2b49e4-59bc-46cd-b7d9-67aa68296e4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:31:57 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:31:57 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:31:57 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:31:57 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:31:57 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:31:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.481s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:57 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:31:57 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Took 1.26 seconds to deallocate network for instance.
Aug 16 22:31:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8637b443-14a3-4981-820f-d3354331f592 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8637b443-14a3-4981-820f-d3354331f592 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:57 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-8637b443-14a3-4981-820f-d3354331f592 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:31:57 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-8637b443-14a3-4981-820f-d3354331f592 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:31:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8637b443-14a3-4981-820f-d3354331f592 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.294s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:57 user nova-compute[72773]: DEBUG nova.compute.manager [req-83dacb3f-2111-4ce5-81df-888fe73b514e req-d9406113-cf94-4658-809b-8c55f2ecdcc4 service nova] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Received event network-vif-plugged-813736f3-3cf2-4d52-9bf5-239b93647ee2 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:31:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-83dacb3f-2111-4ce5-81df-888fe73b514e req-d9406113-cf94-4658-809b-8c55f2ecdcc4 service nova] Acquiring lock "c6adfa95-47ac-40d3-abc1-0c6027507f07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:31:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-83dacb3f-2111-4ce5-81df-888fe73b514e req-d9406113-cf94-4658-809b-8c55f2ecdcc4 service nova] Lock "c6adfa95-47ac-40d3-abc1-0c6027507f07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:31:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-83dacb3f-2111-4ce5-81df-888fe73b514e req-d9406113-cf94-4658-809b-8c55f2ecdcc4 service nova] Lock "c6adfa95-47ac-40d3-abc1-0c6027507f07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:57 user nova-compute[72773]: DEBUG nova.compute.manager [req-83dacb3f-2111-4ce5-81df-888fe73b514e req-d9406113-cf94-4658-809b-8c55f2ecdcc4 service nova] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] No waiting events found dispatching network-vif-plugged-813736f3-3cf2-4d52-9bf5-239b93647ee2 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:31:57 user nova-compute[72773]: WARNING nova.compute.manager [req-83dacb3f-2111-4ce5-81df-888fe73b514e req-d9406113-cf94-4658-809b-8c55f2ecdcc4 service nova] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Received unexpected event network-vif-plugged-813736f3-3cf2-4d52-9bf5-239b93647ee2 for instance with vm_state deleted and task_state None.
Aug 16 22:31:57 user nova-compute[72773]: DEBUG nova.compute.manager [req-83dacb3f-2111-4ce5-81df-888fe73b514e req-d9406113-cf94-4658-809b-8c55f2ecdcc4 service nova] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Received event network-vif-deleted-813736f3-3cf2-4d52-9bf5-239b93647ee2 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:31:57 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-8637b443-14a3-4981-820f-d3354331f592 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Deleted allocations for instance c6adfa95-47ac-40d3-abc1-0c6027507f07
Aug 16 22:31:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8637b443-14a3-4981-820f-d3354331f592 tempest-VolumesAdminNegativeTest-2096874148 tempest-VolumesAdminNegativeTest-2096874148-project-member] Lock "c6adfa95-47ac-40d3-abc1-0c6027507f07" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.752s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:31:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:31:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:03 user nova-compute[72773]: DEBUG nova.compute.manager [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:32:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:03 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:32:03 user nova-compute[72773]: INFO nova.compute.claims [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Claim successful on node user
Aug 16 22:32:03 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:32:03 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:32:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:03 user nova-compute[72773]: DEBUG nova.compute.manager [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:32:03 user nova-compute[72773]: DEBUG nova.compute.manager [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:32:03 user nova-compute[72773]: DEBUG nova.network.neutron [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:32:03 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:32:03 user nova-compute[72773]: DEBUG nova.compute.manager [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG nova.compute.manager [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:32:04 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Creating image(s)
Aug 16 22:32:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "/opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "/opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "/opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG nova.policy [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '62e5b77a149140fd8613d566f41cc23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8e068df8094356b16a6480cd231675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG nova.compute.manager [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.185s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:32:04 user nova-compute[72773]: INFO nova.compute.claims [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Claim successful on node user
Aug 16 22:32:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.185s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk 1073741824" returned: 0 in 0.049s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.184s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Checking if we can resize image /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.495s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG nova.compute.manager [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG nova.network.neutron [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Successfully created port: 6961298d-d62e-4f7b-b97e-4198a325816c {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Cannot resize image /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG nova.objects.instance [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lazy-loading 'migration_context' on Instance uuid 391a6006-4fe6-4398-a1e8-ae95b5edbf2b {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG nova.compute.manager [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG nova.network.neutron [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Ensure instance console log exists: /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:04 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:32:04 user nova-compute[72773]: DEBUG nova.compute.manager [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:32:04 user nova-compute[72773]: DEBUG nova.policy [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '62e5b77a149140fd8613d566f41cc23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8e068df8094356b16a6480cd231675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:32:05 user nova-compute[72773]: DEBUG nova.compute.manager [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:32:05 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:32:05 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Creating image(s)
Aug 16 22:32:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "/opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "/opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.192s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.167s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk 1073741824" returned: 0 in 0.052s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:05 user nova-compute[72773]: DEBUG nova.network.neutron [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Successfully created port: 96243341-8834-4a23-9bf3-964374e14014 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:32:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.191s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:05 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:32:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:05 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Cannot resize image /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:32:05 user nova-compute[72773]: DEBUG nova.objects.instance [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lazy-loading 'migration_context' on Instance uuid cf01c401-c424-4b3e-aa5b-439d62b1ae4c {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:32:05 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:32:05 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Ensure instance console log exists: /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:32:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.network.neutron [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Successfully updated port: 6961298d-d62e-4f7b-b97e-4198a325816c {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "refresh_cache-391a6006-4fe6-4398-a1e8-ae95b5edbf2b" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquired lock "refresh_cache-391a6006-4fe6-4398-a1e8-ae95b5edbf2b" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.network.neutron [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.compute.manager [req-51142394-8d2a-48bc-953c-dbc727e1ca8c req-aabc9337-0ab0-44e9-bfc9-b35ca9f99bfe service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Received event network-changed-6961298d-d62e-4f7b-b97e-4198a325816c {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.compute.manager [req-51142394-8d2a-48bc-953c-dbc727e1ca8c req-aabc9337-0ab0-44e9-bfc9-b35ca9f99bfe service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Refreshing instance network info cache due to event network-changed-6961298d-d62e-4f7b-b97e-4198a325816c. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-51142394-8d2a-48bc-953c-dbc727e1ca8c req-aabc9337-0ab0-44e9-bfc9-b35ca9f99bfe service nova] Acquiring lock "refresh_cache-391a6006-4fe6-4398-a1e8-ae95b5edbf2b" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.network.neutron [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.compute.manager [req-e8a241d6-7f6a-42c1-a9a5-146c538e37ef req-383af839-7462-4791-97c6-88150e9f5a60 service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Received event network-changed-1b75dfbd-e31b-435b-9adf-ea722cb75caf {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.compute.manager [req-e8a241d6-7f6a-42c1-a9a5-146c538e37ef req-383af839-7462-4791-97c6-88150e9f5a60 service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Refreshing instance network info cache due to event network-changed-1b75dfbd-e31b-435b-9adf-ea722cb75caf. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e8a241d6-7f6a-42c1-a9a5-146c538e37ef req-383af839-7462-4791-97c6-88150e9f5a60 service nova] Acquiring lock "refresh_cache-384d4037-bac4-423f-bc7a-e64fe14d7f77" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e8a241d6-7f6a-42c1-a9a5-146c538e37ef req-383af839-7462-4791-97c6-88150e9f5a60 service nova] Acquired lock "refresh_cache-384d4037-bac4-423f-bc7a-e64fe14d7f77" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.network.neutron [req-e8a241d6-7f6a-42c1-a9a5-146c538e37ef req-383af839-7462-4791-97c6-88150e9f5a60 service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Refreshing network info cache for port 1b75dfbd-e31b-435b-9adf-ea722cb75caf {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.network.neutron [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Successfully updated port: 96243341-8834-4a23-9bf3-964374e14014 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "refresh_cache-cf01c401-c424-4b3e-aa5b-439d62b1ae4c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquired lock "refresh_cache-cf01c401-c424-4b3e-aa5b-439d62b1ae4c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.network.neutron [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.compute.manager [req-3d77d3c6-7cd2-495f-a724-d19d9d8bae5d req-50874af9-73bf-4a5f-9dab-37c9e603c17a service nova] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Received event network-changed-96243341-8834-4a23-9bf3-964374e14014 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.compute.manager [req-3d77d3c6-7cd2-495f-a724-d19d9d8bae5d req-50874af9-73bf-4a5f-9dab-37c9e603c17a service nova] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Refreshing instance network info cache due to event network-changed-96243341-8834-4a23-9bf3-964374e14014. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3d77d3c6-7cd2-495f-a724-d19d9d8bae5d req-50874af9-73bf-4a5f-9dab-37c9e603c17a service nova] Acquiring lock "refresh_cache-cf01c401-c424-4b3e-aa5b-439d62b1ae4c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.network.neutron [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.network.neutron [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Updating instance_info_cache with network_info: [{"id": "6961298d-d62e-4f7b-b97e-4198a325816c", "address": "fa:16:3e:2d:58:d4", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6961298d-d6", "ovs_interfaceid": "6961298d-d62e-4f7b-b97e-4198a325816c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Releasing lock "refresh_cache-391a6006-4fe6-4398-a1e8-ae95b5edbf2b" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.compute.manager [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Instance network_info: |[{"id": "6961298d-d62e-4f7b-b97e-4198a325816c", "address": "fa:16:3e:2d:58:d4", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6961298d-d6", "ovs_interfaceid": "6961298d-d62e-4f7b-b97e-4198a325816c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-51142394-8d2a-48bc-953c-dbc727e1ca8c req-aabc9337-0ab0-44e9-bfc9-b35ca9f99bfe service nova] Acquired lock "refresh_cache-391a6006-4fe6-4398-a1e8-ae95b5edbf2b" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.network.neutron [req-51142394-8d2a-48bc-953c-dbc727e1ca8c req-aabc9337-0ab0-44e9-bfc9-b35ca9f99bfe service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Refreshing network info cache for port 6961298d-d62e-4f7b-b97e-4198a325816c {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Start _get_guest_xml network_info=[{"id": "6961298d-d62e-4f7b-b97e-4198a325816c", "address": "fa:16:3e:2d:58:d4", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6961298d-d6", "ovs_interfaceid": "6961298d-d62e-4f7b-b97e-4198a325816c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:32:06 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:32:06 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:32:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1414401215',display_name='tempest-ServerRescueNegativeTestJSON-server-1414401215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1414401215',id=21,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f8e068df8094356b16a6480cd231675',ramdisk_id='',reservation_id='r-biq7d4v4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1754829282',owner_user_name='tempest-ServerRescueNegativeTestJSON-1754829282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:32:04Z,user_data=None,user_id='62e5b77a149140fd8613d566f41cc23d',uuid=391a6006-4fe6-4398-a1e8-ae95b5edbf2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6961298d-d62e-4f7b-b97e-4198a325816c", "address": "fa:16:3e:2d:58:d4", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6961298d-d6", "ovs_interfaceid": "6961298d-d62e-4f7b-b97e-4198a325816c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Converting VIF {"id": "6961298d-d62e-4f7b-b97e-4198a325816c", "address": "fa:16:3e:2d:58:d4", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6961298d-d6", "ovs_interfaceid": "6961298d-d62e-4f7b-b97e-4198a325816c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:58:d4,bridge_name='br-int',has_traffic_filtering=True,id=6961298d-d62e-4f7b-b97e-4198a325816c,network=Network(8a43bbad-aab2-44c9-a7e4-62696d908234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6961298d-d6') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.objects.instance [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lazy-loading 'pci_devices' on Instance uuid 391a6006-4fe6-4398-a1e8-ae95b5edbf2b {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.network.neutron [req-e8a241d6-7f6a-42c1-a9a5-146c538e37ef req-383af839-7462-4791-97c6-88150e9f5a60 service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Updated VIF entry in instance network info cache for port 1b75dfbd-e31b-435b-9adf-ea722cb75caf. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.network.neutron [req-e8a241d6-7f6a-42c1-a9a5-146c538e37ef req-383af839-7462-4791-97c6-88150e9f5a60 service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Updating instance_info_cache with network_info: [{"id": "1b75dfbd-e31b-435b-9adf-ea722cb75caf", "address": "fa:16:3e:19:aa:35", "network": {"id": "6713e8d9-0a25-439f-bf23-793daef39f3d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1456160285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf394e6df5cf44698ab7a57554816db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b75dfbd-e3", "ovs_interfaceid": "1b75dfbd-e31b-435b-9adf-ea722cb75caf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:32:06 user nova-compute[72773]:   <uuid>391a6006-4fe6-4398-a1e8-ae95b5edbf2b</uuid>
Aug 16 22:32:06 user nova-compute[72773]:   <name>instance-00000015</name>
Aug 16 22:32:06 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:32:06 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:32:06 user nova-compute[72773]:   <metadata>
Aug 16 22:32:06 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:32:06 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:32:06 user nova-compute[72773]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1414401215</nova:name>
Aug 16 22:32:06 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:32:06</nova:creationTime>
Aug 16 22:32:06 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:32:06 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:32:06 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:32:06 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:32:06 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:32:06 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:32:06 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:32:06 user nova-compute[72773]:       <nova:owner>
Aug 16 22:32:06 user nova-compute[72773]:         <nova:user uuid="62e5b77a149140fd8613d566f41cc23d">tempest-ServerRescueNegativeTestJSON-1754829282-project-member</nova:user>
Aug 16 22:32:06 user nova-compute[72773]:         <nova:project uuid="0f8e068df8094356b16a6480cd231675">tempest-ServerRescueNegativeTestJSON-1754829282</nova:project>
Aug 16 22:32:06 user nova-compute[72773]:       </nova:owner>
Aug 16 22:32:06 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:32:06 user nova-compute[72773]:       <nova:ports>
Aug 16 22:32:06 user nova-compute[72773]:         <nova:port uuid="6961298d-d62e-4f7b-b97e-4198a325816c">
Aug 16 22:32:06 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 22:32:06 user nova-compute[72773]:         </nova:port>
Aug 16 22:32:06 user nova-compute[72773]:       </nova:ports>
Aug 16 22:32:06 user nova-compute[72773]:     </nova:instance>
Aug 16 22:32:06 user nova-compute[72773]:   </metadata>
Aug 16 22:32:06 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:32:06 user nova-compute[72773]:     <system>
Aug 16 22:32:06 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:32:06 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:32:06 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:32:06 user nova-compute[72773]:       <entry name="serial">391a6006-4fe6-4398-a1e8-ae95b5edbf2b</entry>
Aug 16 22:32:06 user nova-compute[72773]:       <entry name="uuid">391a6006-4fe6-4398-a1e8-ae95b5edbf2b</entry>
Aug 16 22:32:06 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:32:06 user nova-compute[72773]:     </system>
Aug 16 22:32:06 user nova-compute[72773]:   </sysinfo>
Aug 16 22:32:06 user nova-compute[72773]:   <os>
Aug 16 22:32:06 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:32:06 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:32:06 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:32:06 user nova-compute[72773]:   </os>
Aug 16 22:32:06 user nova-compute[72773]:   <features>
Aug 16 22:32:06 user nova-compute[72773]:     <acpi/>
Aug 16 22:32:06 user nova-compute[72773]:     <apic/>
Aug 16 22:32:06 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:32:06 user nova-compute[72773]:   </features>
Aug 16 22:32:06 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:32:06 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:32:06 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:32:06 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:32:06 user nova-compute[72773]:   </clock>
Aug 16 22:32:06 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:32:06 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:32:06 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:32:06 user nova-compute[72773]:   </cpu>
Aug 16 22:32:06 user nova-compute[72773]:   <devices>
Aug 16 22:32:06 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:32:06 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:32:06 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk"/>
Aug 16 22:32:06 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:32:06 user nova-compute[72773]:     </disk>
Aug 16 22:32:06 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:32:06 user nova-compute[72773]:       <mac address="fa:16:3e:2d:58:d4"/>
Aug 16 22:32:06 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:32:06 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:32:06 user nova-compute[72773]:       <target dev="tap6961298d-d6"/>
Aug 16 22:32:06 user nova-compute[72773]:     </interface>
Aug 16 22:32:06 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:32:06 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/console.log" append="off"/>
Aug 16 22:32:06 user nova-compute[72773]:     </serial>
Aug 16 22:32:06 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:32:06 user nova-compute[72773]:     <video>
Aug 16 22:32:06 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:32:06 user nova-compute[72773]:     </video>
Aug 16 22:32:06 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:32:06 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:32:06 user nova-compute[72773]:     </rng>
Aug 16 22:32:06 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:32:06 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:32:06 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:32:06 user nova-compute[72773]:     </memballoon>
Aug 16 22:32:06 user nova-compute[72773]:   </devices>
Aug 16 22:32:06 user nova-compute[72773]: </domain>
Aug 16 22:32:06 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:32:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1414401215',display_name='tempest-ServerRescueNegativeTestJSON-server-1414401215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1414401215',id=21,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f8e068df8094356b16a6480cd231675',ramdisk_id='',reservation_id='r-biq7d4v4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1754829282',owner_user_name='tempest-ServerRescueNegativeTestJSON-1754829282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:32:04Z,user_data=None,user_id='62e5b77a149140fd8613d566f41cc23d',uuid=391a6006-4fe6-4398-a1e8-ae95b5edbf2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6961298d-d62e-4f7b-b97e-4198a325816c", "address": "fa:16:3e:2d:58:d4", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6961298d-d6", "ovs_interfaceid": "6961298d-d62e-4f7b-b97e-4198a325816c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Converting VIF {"id": "6961298d-d62e-4f7b-b97e-4198a325816c", "address": "fa:16:3e:2d:58:d4", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6961298d-d6", "ovs_interfaceid": "6961298d-d62e-4f7b-b97e-4198a325816c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:58:d4,bridge_name='br-int',has_traffic_filtering=True,id=6961298d-d62e-4f7b-b97e-4198a325816c,network=Network(8a43bbad-aab2-44c9-a7e4-62696d908234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6961298d-d6') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG os_vif [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:58:d4,bridge_name='br-int',has_traffic_filtering=True,id=6961298d-d62e-4f7b-b97e-4198a325816c,network=Network(8a43bbad-aab2-44c9-a7e4-62696d908234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6961298d-d6') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.network.neutron [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Updating instance_info_cache with network_info: [{"id": "96243341-8834-4a23-9bf3-964374e14014", "address": "fa:16:3e:c6:b4:53", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96243341-88", "ovs_interfaceid": "96243341-8834-4a23-9bf3-964374e14014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e8a241d6-7f6a-42c1-a9a5-146c538e37ef req-383af839-7462-4791-97c6-88150e9f5a60 service nova] Releasing lock "refresh_cache-384d4037-bac4-423f-bc7a-e64fe14d7f77" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d1f00eb8-9ab8-43ef-834b-06d1f2c67988 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Acquiring lock "interface-384d4037-bac4-423f-bc7a-e64fe14d7f77-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d1f00eb8-9ab8-43ef-834b-06d1f2c67988 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lock "interface-384d4037-bac4-423f-bc7a-e64fe14d7f77-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.objects.instance [None req-d1f00eb8-9ab8-43ef-834b-06d1f2c67988 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lazy-loading 'flavor' on Instance uuid 384d4037-bac4-423f-bc7a-e64fe14d7f77 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Releasing lock "refresh_cache-cf01c401-c424-4b3e-aa5b-439d62b1ae4c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.compute.manager [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Instance network_info: |[{"id": "96243341-8834-4a23-9bf3-964374e14014", "address": "fa:16:3e:c6:b4:53", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96243341-88", "ovs_interfaceid": "96243341-8834-4a23-9bf3-964374e14014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6961298d-d6, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6961298d-d6, col_values=(('external_ids', {'iface-id': '6961298d-d62e-4f7b-b97e-4198a325816c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:58:d4', 'vm-uuid': '391a6006-4fe6-4398-a1e8-ae95b5edbf2b'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3d77d3c6-7cd2-495f-a724-d19d9d8bae5d req-50874af9-73bf-4a5f-9dab-37c9e603c17a service nova] Acquired lock "refresh_cache-cf01c401-c424-4b3e-aa5b-439d62b1ae4c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.network.neutron [req-3d77d3c6-7cd2-495f-a724-d19d9d8bae5d req-50874af9-73bf-4a5f-9dab-37c9e603c17a service nova] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Refreshing network info cache for port 96243341-8834-4a23-9bf3-964374e14014 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Start _get_guest_xml network_info=[{"id": "96243341-8834-4a23-9bf3-964374e14014", "address": "fa:16:3e:c6:b4:53", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96243341-88", "ovs_interfaceid": "96243341-8834-4a23-9bf3-964374e14014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:32:06 user nova-compute[72773]: INFO os_vif [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:58:d4,bridge_name='br-int',has_traffic_filtering=True,id=6961298d-d62e-4f7b-b97e-4198a325816c,network=Network(8a43bbad-aab2-44c9-a7e4-62696d908234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6961298d-d6')
Aug 16 22:32:06 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:32:06 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:32:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1457796534',display_name='tempest-ServerRescueNegativeTestJSON-server-1457796534',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1457796534',id=22,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f8e068df8094356b16a6480cd231675',ramdisk_id='',reservation_id='r-erb87mkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1754829282',owner_user_name='tempest-ServerRescueNegativeTestJSON-1754829282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:32:05Z,user_data=None,user_id='62e5b77a149140fd8613d566f41cc23d',uuid=cf01c401-c424-4b3e-aa5b-439d62b1ae4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96243341-8834-4a23-9bf3-964374e14014", "address": "fa:16:3e:c6:b4:53", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96243341-88", "ovs_interfaceid": "96243341-8834-4a23-9bf3-964374e14014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Converting VIF {"id": "96243341-8834-4a23-9bf3-964374e14014", "address": "fa:16:3e:c6:b4:53", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96243341-88", "ovs_interfaceid": "96243341-8834-4a23-9bf3-964374e14014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:b4:53,bridge_name='br-int',has_traffic_filtering=True,id=96243341-8834-4a23-9bf3-964374e14014,network=Network(8a43bbad-aab2-44c9-a7e4-62696d908234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96243341-88') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.objects.instance [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lazy-loading 'pci_devices' on Instance uuid cf01c401-c424-4b3e-aa5b-439d62b1ae4c {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:32:06 user nova-compute[72773]:   <uuid>cf01c401-c424-4b3e-aa5b-439d62b1ae4c</uuid>
Aug 16 22:32:06 user nova-compute[72773]:   <name>instance-00000016</name>
Aug 16 22:32:06 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:32:06 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:32:06 user nova-compute[72773]:   <metadata>
Aug 16 22:32:06 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:32:06 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:32:06 user nova-compute[72773]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1457796534</nova:name>
Aug 16 22:32:06 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:32:06</nova:creationTime>
Aug 16 22:32:06 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:32:06 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:32:06 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:32:06 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:32:06 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:32:06 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:32:06 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:32:06 user nova-compute[72773]:       <nova:owner>
Aug 16 22:32:06 user nova-compute[72773]:         <nova:user uuid="62e5b77a149140fd8613d566f41cc23d">tempest-ServerRescueNegativeTestJSON-1754829282-project-member</nova:user>
Aug 16 22:32:06 user nova-compute[72773]:         <nova:project uuid="0f8e068df8094356b16a6480cd231675">tempest-ServerRescueNegativeTestJSON-1754829282</nova:project>
Aug 16 22:32:06 user nova-compute[72773]:       </nova:owner>
Aug 16 22:32:06 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:32:06 user nova-compute[72773]:       <nova:ports>
Aug 16 22:32:06 user nova-compute[72773]:         <nova:port uuid="96243341-8834-4a23-9bf3-964374e14014">
Aug 16 22:32:06 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 22:32:06 user nova-compute[72773]:         </nova:port>
Aug 16 22:32:06 user nova-compute[72773]:       </nova:ports>
Aug 16 22:32:06 user nova-compute[72773]:     </nova:instance>
Aug 16 22:32:06 user nova-compute[72773]:   </metadata>
Aug 16 22:32:06 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:32:06 user nova-compute[72773]:     <system>
Aug 16 22:32:06 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:32:06 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:32:06 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:32:06 user nova-compute[72773]:       <entry name="serial">cf01c401-c424-4b3e-aa5b-439d62b1ae4c</entry>
Aug 16 22:32:06 user nova-compute[72773]:       <entry name="uuid">cf01c401-c424-4b3e-aa5b-439d62b1ae4c</entry>
Aug 16 22:32:06 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:32:06 user nova-compute[72773]:     </system>
Aug 16 22:32:06 user nova-compute[72773]:   </sysinfo>
Aug 16 22:32:06 user nova-compute[72773]:   <os>
Aug 16 22:32:06 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:32:06 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:32:06 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:32:06 user nova-compute[72773]:   </os>
Aug 16 22:32:06 user nova-compute[72773]:   <features>
Aug 16 22:32:06 user nova-compute[72773]:     <acpi/>
Aug 16 22:32:06 user nova-compute[72773]:     <apic/>
Aug 16 22:32:06 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:32:06 user nova-compute[72773]:   </features>
Aug 16 22:32:06 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:32:06 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:32:06 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:32:06 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:32:06 user nova-compute[72773]:   </clock>
Aug 16 22:32:06 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:32:06 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:32:06 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:32:06 user nova-compute[72773]:   </cpu>
Aug 16 22:32:06 user nova-compute[72773]:   <devices>
Aug 16 22:32:06 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:32:06 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:32:06 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk"/>
Aug 16 22:32:06 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:32:06 user nova-compute[72773]:     </disk>
Aug 16 22:32:06 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:32:06 user nova-compute[72773]:       <mac address="fa:16:3e:c6:b4:53"/>
Aug 16 22:32:06 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:32:06 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:32:06 user nova-compute[72773]:       <target dev="tap96243341-88"/>
Aug 16 22:32:06 user nova-compute[72773]:     </interface>
Aug 16 22:32:06 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:32:06 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/console.log" append="off"/>
Aug 16 22:32:06 user nova-compute[72773]:     </serial>
Aug 16 22:32:06 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:32:06 user nova-compute[72773]:     <video>
Aug 16 22:32:06 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:32:06 user nova-compute[72773]:     </video>
Aug 16 22:32:06 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:32:06 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:32:06 user nova-compute[72773]:     </rng>
Aug 16 22:32:06 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:32:06 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:32:06 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:32:06 user nova-compute[72773]:     </memballoon>
Aug 16 22:32:06 user nova-compute[72773]:   </devices>
Aug 16 22:32:06 user nova-compute[72773]: </domain>
Aug 16 22:32:06 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:32:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1457796534',display_name='tempest-ServerRescueNegativeTestJSON-server-1457796534',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1457796534',id=22,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f8e068df8094356b16a6480cd231675',ramdisk_id='',reservation_id='r-erb87mkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1754829282',owner_user_name='tempest-ServerRescueNegativeTestJSON-1754829282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:32:05Z,user_data=None,user_id='62e5b77a149140fd8613d566f41cc23d',uuid=cf01c401-c424-4b3e-aa5b-439d62b1ae4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96243341-8834-4a23-9bf3-964374e14014", "address": "fa:16:3e:c6:b4:53", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96243341-88", "ovs_interfaceid": "96243341-8834-4a23-9bf3-964374e14014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Converting VIF {"id": "96243341-8834-4a23-9bf3-964374e14014", "address": "fa:16:3e:c6:b4:53", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96243341-88", "ovs_interfaceid": "96243341-8834-4a23-9bf3-964374e14014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:b4:53,bridge_name='br-int',has_traffic_filtering=True,id=96243341-8834-4a23-9bf3-964374e14014,network=Network(8a43bbad-aab2-44c9-a7e4-62696d908234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96243341-88') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG os_vif [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:b4:53,bridge_name='br-int',has_traffic_filtering=True,id=96243341-8834-4a23-9bf3-964374e14014,network=Network(8a43bbad-aab2-44c9-a7e4-62696d908234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96243341-88') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96243341-88, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap96243341-88, col_values=(('external_ids', {'iface-id': '96243341-8834-4a23-9bf3-964374e14014', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:b4:53', 'vm-uuid': 'cf01c401-c424-4b3e-aa5b-439d62b1ae4c'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] No VIF found with MAC fa:16:3e:2d:58:d4, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:32:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:07 user nova-compute[72773]: INFO os_vif [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:b4:53,bridge_name='br-int',has_traffic_filtering=True,id=96243341-8834-4a23-9bf3-964374e14014,network=Network(8a43bbad-aab2-44c9-a7e4-62696d908234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96243341-88')
Aug 16 22:32:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:32:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] No VIF found with MAC fa:16:3e:c6:b4:53, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:32:07 user nova-compute[72773]: DEBUG nova.objects.instance [None req-d1f00eb8-9ab8-43ef-834b-06d1f2c67988 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lazy-loading 'pci_requests' on Instance uuid 384d4037-bac4-423f-bc7a-e64fe14d7f77 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:32:07 user nova-compute[72773]: DEBUG nova.network.neutron [None req-d1f00eb8-9ab8-43ef-834b-06d1f2c67988 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:32:07 user nova-compute[72773]: DEBUG nova.policy [None req-d1f00eb8-9ab8-43ef-834b-06d1f2c67988 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c282abb16d84eedbf4703c3a68ec3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf394e6df5cf44698ab7a57554816db8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:32:07 user nova-compute[72773]: DEBUG nova.network.neutron [req-51142394-8d2a-48bc-953c-dbc727e1ca8c req-aabc9337-0ab0-44e9-bfc9-b35ca9f99bfe service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Updated VIF entry in instance network info cache for port 6961298d-d62e-4f7b-b97e-4198a325816c. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:32:07 user nova-compute[72773]: DEBUG nova.network.neutron [req-51142394-8d2a-48bc-953c-dbc727e1ca8c req-aabc9337-0ab0-44e9-bfc9-b35ca9f99bfe service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Updating instance_info_cache with network_info: [{"id": "6961298d-d62e-4f7b-b97e-4198a325816c", "address": "fa:16:3e:2d:58:d4", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6961298d-d6", "ovs_interfaceid": "6961298d-d62e-4f7b-b97e-4198a325816c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:32:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-51142394-8d2a-48bc-953c-dbc727e1ca8c req-aabc9337-0ab0-44e9-bfc9-b35ca9f99bfe service nova] Releasing lock "refresh_cache-391a6006-4fe6-4398-a1e8-ae95b5edbf2b" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:32:07 user nova-compute[72773]: DEBUG nova.network.neutron [req-3d77d3c6-7cd2-495f-a724-d19d9d8bae5d req-50874af9-73bf-4a5f-9dab-37c9e603c17a service nova] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Updated VIF entry in instance network info cache for port 96243341-8834-4a23-9bf3-964374e14014. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:32:07 user nova-compute[72773]: DEBUG nova.network.neutron [req-3d77d3c6-7cd2-495f-a724-d19d9d8bae5d req-50874af9-73bf-4a5f-9dab-37c9e603c17a service nova] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Updating instance_info_cache with network_info: [{"id": "96243341-8834-4a23-9bf3-964374e14014", "address": "fa:16:3e:c6:b4:53", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96243341-88", "ovs_interfaceid": "96243341-8834-4a23-9bf3-964374e14014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:32:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3d77d3c6-7cd2-495f-a724-d19d9d8bae5d req-50874af9-73bf-4a5f-9dab-37c9e603c17a service nova] Releasing lock "refresh_cache-cf01c401-c424-4b3e-aa5b-439d62b1ae4c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:32:07 user nova-compute[72773]: DEBUG nova.network.neutron [None req-d1f00eb8-9ab8-43ef-834b-06d1f2c67988 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Successfully created port: 2be096ff-0d79-453c-b879-0de5692a28be {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:32:08 user nova-compute[72773]: DEBUG nova.network.neutron [None req-d1f00eb8-9ab8-43ef-834b-06d1f2c67988 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Successfully updated port: 2be096ff-0d79-453c-b879-0de5692a28be {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:32:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d1f00eb8-9ab8-43ef-834b-06d1f2c67988 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Acquiring lock "refresh_cache-384d4037-bac4-423f-bc7a-e64fe14d7f77" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:32:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d1f00eb8-9ab8-43ef-834b-06d1f2c67988 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Acquired lock "refresh_cache-384d4037-bac4-423f-bc7a-e64fe14d7f77" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:32:08 user nova-compute[72773]: DEBUG nova.network.neutron [None req-d1f00eb8-9ab8-43ef-834b-06d1f2c67988 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:32:08 user nova-compute[72773]: DEBUG nova.compute.manager [req-62c12bb0-36bd-440d-9ceb-9b440b2dd418 req-8733a32f-17af-42e3-87af-08e1479baff3 service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Received event network-changed-2be096ff-0d79-453c-b879-0de5692a28be {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:08 user nova-compute[72773]: DEBUG nova.compute.manager [req-62c12bb0-36bd-440d-9ceb-9b440b2dd418 req-8733a32f-17af-42e3-87af-08e1479baff3 service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Refreshing instance network info cache due to event network-changed-2be096ff-0d79-453c-b879-0de5692a28be. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:32:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-62c12bb0-36bd-440d-9ceb-9b440b2dd418 req-8733a32f-17af-42e3-87af-08e1479baff3 service nova] Acquiring lock "refresh_cache-384d4037-bac4-423f-bc7a-e64fe14d7f77" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG nova.network.neutron [None req-d1f00eb8-9ab8-43ef-834b-06d1f2c67988 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Updating instance_info_cache with network_info: [{"id": "1b75dfbd-e31b-435b-9adf-ea722cb75caf", "address": "fa:16:3e:19:aa:35", "network": {"id": "6713e8d9-0a25-439f-bf23-793daef39f3d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1456160285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf394e6df5cf44698ab7a57554816db8", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b75dfbd-e3", "ovs_interfaceid": "1b75dfbd-e31b-435b-9adf-ea722cb75caf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2be096ff-0d79-453c-b879-0de5692a28be", "address": "fa:16:3e:51:f2:74", "network": {"id": "381f454a-313a-4b90-80e5-92ca6f7a6c1a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-422292203", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cf394e6df5cf44698ab7a57554816db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be096ff-0d", "ovs_interfaceid": "2be096ff-0d79-453c-b879-0de5692a28be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d1f00eb8-9ab8-43ef-834b-06d1f2c67988 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Releasing lock "refresh_cache-384d4037-bac4-423f-bc7a-e64fe14d7f77" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-62c12bb0-36bd-440d-9ceb-9b440b2dd418 req-8733a32f-17af-42e3-87af-08e1479baff3 service nova] Acquired lock "refresh_cache-384d4037-bac4-423f-bc7a-e64fe14d7f77" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG nova.network.neutron [req-62c12bb0-36bd-440d-9ceb-9b440b2dd418 req-8733a32f-17af-42e3-87af-08e1479baff3 service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Refreshing network info cache for port 2be096ff-0d79-453c-b879-0de5692a28be {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-d1f00eb8-9ab8-43ef-834b-06d1f2c67988 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:30:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1108383111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1108383111',id=17,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvb+XXJ07gUgM7WTapGtd5zb0H3iNTtoq/EYxrHakBL6gizVJGYx1kgeqKzUw19L3aJYy8W16uUXKArptPekGSHwpwooFaxqZLsCatgnClHk+8k8Wbl/vcIiJqX7kwpeQ==',key_name='tempest-keypair-382369375',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:30:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cf394e6df5cf44698ab7a57554816db8',ramdisk_id='',reservation_id='r-rihg7lgl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-740368644',owner_user_name='tempest-TaggedAttachmentsTest-740368644-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:30:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c282abb16d84eedbf4703c3a68ec3a2',uuid=384d4037-bac4-423f-bc7a-e64fe14d7f77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2be096ff-0d79-453c-b879-0de5692a28be", "address": "fa:16:3e:51:f2:74", "network": {"id": "381f454a-313a-4b90-80e5-92ca6f7a6c1a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-422292203", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cf394e6df5cf44698ab7a57554816db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be096ff-0d", "ovs_interfaceid": "2be096ff-0d79-453c-b879-0de5692a28be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-d1f00eb8-9ab8-43ef-834b-06d1f2c67988 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Converting VIF {"id": "2be096ff-0d79-453c-b879-0de5692a28be", "address": "fa:16:3e:51:f2:74", "network": {"id": "381f454a-313a-4b90-80e5-92ca6f7a6c1a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-422292203", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cf394e6df5cf44698ab7a57554816db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be096ff-0d", "ovs_interfaceid": "2be096ff-0d79-453c-b879-0de5692a28be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-d1f00eb8-9ab8-43ef-834b-06d1f2c67988 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:f2:74,bridge_name='br-int',has_traffic_filtering=True,id=2be096ff-0d79-453c-b879-0de5692a28be,network=Network(381f454a-313a-4b90-80e5-92ca6f7a6c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2be096ff-0d') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG os_vif [None req-d1f00eb8-9ab8-43ef-834b-06d1f2c67988 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:f2:74,bridge_name='br-int',has_traffic_filtering=True,id=2be096ff-0d79-453c-b879-0de5692a28be,network=Network(381f454a-313a-4b90-80e5-92ca6f7a6c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2be096ff-0d') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2be096ff-0d, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2be096ff-0d, col_values=(('external_ids', {'iface-id': '2be096ff-0d79-453c-b879-0de5692a28be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:f2:74', 'vm-uuid': '384d4037-bac4-423f-bc7a-e64fe14d7f77'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:09 user nova-compute[72773]: INFO os_vif [None req-d1f00eb8-9ab8-43ef-834b-06d1f2c67988 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:f2:74,bridge_name='br-int',has_traffic_filtering=True,id=2be096ff-0d79-453c-b879-0de5692a28be,network=Network(381f454a-313a-4b90-80e5-92ca6f7a6c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2be096ff-0d')
Aug 16 22:32:09 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-d1f00eb8-9ab8-43ef-834b-06d1f2c67988 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:30:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1108383111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1108383111',id=17,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvb+XXJ07gUgM7WTapGtd5zb0H3iNTtoq/EYxrHakBL6gizVJGYx1kgeqKzUw19L3aJYy8W16uUXKArptPekGSHwpwooFaxqZLsCatgnClHk+8k8Wbl/vcIiJqX7kwpeQ==',key_name='tempest-keypair-382369375',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:30:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cf394e6df5cf44698ab7a57554816db8',ramdisk_id='',reservation_id='r-rihg7lgl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-740368644',owner_user_name='tempest-TaggedAttachmentsTest-740368644-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:30:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c282abb16d84eedbf4703c3a68ec3a2',uuid=384d4037-bac4-423f-bc7a-e64fe14d7f77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2be096ff-0d79-453c-b879-0de5692a28be", "address": "fa:16:3e:51:f2:74", "network": {"id": "381f454a-313a-4b90-80e5-92ca6f7a6c1a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-422292203", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cf394e6df5cf44698ab7a57554816db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be096ff-0d", "ovs_interfaceid": "2be096ff-0d79-453c-b879-0de5692a28be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-d1f00eb8-9ab8-43ef-834b-06d1f2c67988 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Converting VIF {"id": "2be096ff-0d79-453c-b879-0de5692a28be", "address": "fa:16:3e:51:f2:74", "network": {"id": "381f454a-313a-4b90-80e5-92ca6f7a6c1a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-422292203", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cf394e6df5cf44698ab7a57554816db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be096ff-0d", "ovs_interfaceid": "2be096ff-0d79-453c-b879-0de5692a28be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-d1f00eb8-9ab8-43ef-834b-06d1f2c67988 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:f2:74,bridge_name='br-int',has_traffic_filtering=True,id=2be096ff-0d79-453c-b879-0de5692a28be,network=Network(381f454a-313a-4b90-80e5-92ca6f7a6c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2be096ff-0d') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Acquiring lock "b66ff126-5cbb-4e39-8867-9f5c1538cf91" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lock "b66ff126-5cbb-4e39-8867-9f5c1538cf91" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-d1f00eb8-9ab8-43ef-834b-06d1f2c67988 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] attach device xml: <interface type="ethernet">
Aug 16 22:32:09 user nova-compute[72773]:   <mac address="fa:16:3e:51:f2:74"/>
Aug 16 22:32:09 user nova-compute[72773]:   <model type="virtio"/>
Aug 16 22:32:09 user nova-compute[72773]:   <mtu size="1442"/>
Aug 16 22:32:09 user nova-compute[72773]:   <target dev="tap2be096ff-0d"/>
Aug 16 22:32:09 user nova-compute[72773]: </interface>
Aug 16 22:32:09 user nova-compute[72773]:  {{(pid=72773) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG nova.compute.manager [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:32:09 user nova-compute[72773]: INFO nova.compute.claims [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Claim successful on node user
Aug 16 22:32:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG nova.compute.manager [req-c6565799-487e-4b06-835c-6a62efd38dae req-b0493f9e-237c-419f-826c-a54ae00a70f9 service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Received event network-vif-plugged-2be096ff-0d79-453c-b879-0de5692a28be {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c6565799-487e-4b06-835c-6a62efd38dae req-b0493f9e-237c-419f-826c-a54ae00a70f9 service nova] Acquiring lock "384d4037-bac4-423f-bc7a-e64fe14d7f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c6565799-487e-4b06-835c-6a62efd38dae req-b0493f9e-237c-419f-826c-a54ae00a70f9 service nova] Lock "384d4037-bac4-423f-bc7a-e64fe14d7f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c6565799-487e-4b06-835c-6a62efd38dae req-b0493f9e-237c-419f-826c-a54ae00a70f9 service nova] Lock "384d4037-bac4-423f-bc7a-e64fe14d7f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG nova.compute.manager [req-c6565799-487e-4b06-835c-6a62efd38dae req-b0493f9e-237c-419f-826c-a54ae00a70f9 service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] No waiting events found dispatching network-vif-plugged-2be096ff-0d79-453c-b879-0de5692a28be {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:32:09 user nova-compute[72773]: WARNING nova.compute.manager [req-c6565799-487e-4b06-835c-6a62efd38dae req-b0493f9e-237c-419f-826c-a54ae00a70f9 service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Received unexpected event network-vif-plugged-2be096ff-0d79-453c-b879-0de5692a28be for instance with vm_state active and task_state None.
Aug 16 22:32:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG nova.compute.manager [req-c0238270-3bce-4063-b0b7-aa2344c55c14 req-173906cf-9039-41df-b177-df7b49c8ca2d service nova] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Received event network-vif-plugged-96243341-8834-4a23-9bf3-964374e14014 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c0238270-3bce-4063-b0b7-aa2344c55c14 req-173906cf-9039-41df-b177-df7b49c8ca2d service nova] Acquiring lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c0238270-3bce-4063-b0b7-aa2344c55c14 req-173906cf-9039-41df-b177-df7b49c8ca2d service nova] Lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c0238270-3bce-4063-b0b7-aa2344c55c14 req-173906cf-9039-41df-b177-df7b49c8ca2d service nova] Lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG nova.compute.manager [req-c0238270-3bce-4063-b0b7-aa2344c55c14 req-173906cf-9039-41df-b177-df7b49c8ca2d service nova] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] No waiting events found dispatching network-vif-plugged-96243341-8834-4a23-9bf3-964374e14014 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:32:09 user nova-compute[72773]: WARNING nova.compute.manager [req-c0238270-3bce-4063-b0b7-aa2344c55c14 req-173906cf-9039-41df-b177-df7b49c8ca2d service nova] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Received unexpected event network-vif-plugged-96243341-8834-4a23-9bf3-964374e14014 for instance with vm_state building and task_state spawning.
Aug 16 22:32:09 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d1f00eb8-9ab8-43ef-834b-06d1f2c67988 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d1f00eb8-9ab8-43ef-834b-06d1f2c67988 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] No BDM found with device name hda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d1f00eb8-9ab8-43ef-834b-06d1f2c67988 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] No VIF found with MAC fa:16:3e:19:aa:35, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-d1f00eb8-9ab8-43ef-834b-06d1f2c67988 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:32:09 user nova-compute[72773]:   <nova:package version="0.0.0"/>
Aug 16 22:32:09 user nova-compute[72773]:   <nova:name>tempest-device-tagging-server-1108383111</nova:name>
Aug 16 22:32:09 user nova-compute[72773]:   <nova:creationTime>2023-08-16 22:32:09</nova:creationTime>
Aug 16 22:32:09 user nova-compute[72773]:   <nova:flavor name="m1.tiny">
Aug 16 22:32:09 user nova-compute[72773]:     <nova:memory>512</nova:memory>
Aug 16 22:32:09 user nova-compute[72773]:     <nova:disk>1</nova:disk>
Aug 16 22:32:09 user nova-compute[72773]:     <nova:swap>0</nova:swap>
Aug 16 22:32:09 user nova-compute[72773]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:32:09 user nova-compute[72773]:     <nova:vcpus>1</nova:vcpus>
Aug 16 22:32:09 user nova-compute[72773]:   </nova:flavor>
Aug 16 22:32:09 user nova-compute[72773]:   <nova:owner>
Aug 16 22:32:09 user nova-compute[72773]:     <nova:user uuid="1c282abb16d84eedbf4703c3a68ec3a2">tempest-TaggedAttachmentsTest-740368644-project-member</nova:user>
Aug 16 22:32:09 user nova-compute[72773]:     <nova:project uuid="cf394e6df5cf44698ab7a57554816db8">tempest-TaggedAttachmentsTest-740368644</nova:project>
Aug 16 22:32:09 user nova-compute[72773]:   </nova:owner>
Aug 16 22:32:09 user nova-compute[72773]:   <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:32:09 user nova-compute[72773]:   <nova:ports>
Aug 16 22:32:09 user nova-compute[72773]:     <nova:port uuid="1b75dfbd-e31b-435b-9adf-ea722cb75caf">
Aug 16 22:32:09 user nova-compute[72773]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 22:32:09 user nova-compute[72773]:     </nova:port>
Aug 16 22:32:09 user nova-compute[72773]:     <nova:port uuid="2be096ff-0d79-453c-b879-0de5692a28be">
Aug 16 22:32:09 user nova-compute[72773]:       <nova:ip type="fixed" address="10.10.10.101" ipVersion="4"/>
Aug 16 22:32:09 user nova-compute[72773]:     </nova:port>
Aug 16 22:32:09 user nova-compute[72773]:   </nova:ports>
Aug 16 22:32:09 user nova-compute[72773]: </nova:instance>
Aug 16 22:32:09 user nova-compute[72773]:  {{(pid=72773) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d1f00eb8-9ab8-43ef-834b-06d1f2c67988 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lock "interface-384d4037-bac4-423f-bc7a-e64fe14d7f77-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.148s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG nova.network.neutron [req-62c12bb0-36bd-440d-9ceb-9b440b2dd418 req-8733a32f-17af-42e3-87af-08e1479baff3 service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Updated VIF entry in instance network info cache for port 2be096ff-0d79-453c-b879-0de5692a28be. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG nova.network.neutron [req-62c12bb0-36bd-440d-9ceb-9b440b2dd418 req-8733a32f-17af-42e3-87af-08e1479baff3 service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Updating instance_info_cache with network_info: [{"id": "1b75dfbd-e31b-435b-9adf-ea722cb75caf", "address": "fa:16:3e:19:aa:35", "network": {"id": "6713e8d9-0a25-439f-bf23-793daef39f3d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1456160285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf394e6df5cf44698ab7a57554816db8", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b75dfbd-e3", "ovs_interfaceid": "1b75dfbd-e31b-435b-9adf-ea722cb75caf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2be096ff-0d79-453c-b879-0de5692a28be", "address": "fa:16:3e:51:f2:74", "network": {"id": "381f454a-313a-4b90-80e5-92ca6f7a6c1a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-422292203", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cf394e6df5cf44698ab7a57554816db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be096ff-0d", "ovs_interfaceid": "2be096ff-0d79-453c-b879-0de5692a28be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.641s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG nova.compute.manager [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-62c12bb0-36bd-440d-9ceb-9b440b2dd418 req-8733a32f-17af-42e3-87af-08e1479baff3 service nova] Releasing lock "refresh_cache-384d4037-bac4-423f-bc7a-e64fe14d7f77" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG nova.compute.manager [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG nova.network.neutron [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:32:10 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:32:10 user nova-compute[72773]: DEBUG nova.compute.manager [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG nova.compute.manager [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:32:10 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Creating image(s)
Aug 16 22:32:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Acquiring lock "/opt/stack/data/nova/instances/b66ff126-5cbb-4e39-8867-9f5c1538cf91/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lock "/opt/stack/data/nova/instances/b66ff126-5cbb-4e39-8867-9f5c1538cf91/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lock "/opt/stack/data/nova/instances/b66ff126-5cbb-4e39-8867-9f5c1538cf91/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.200s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Acquiring lock "384d4037-bac4-423f-bc7a-e64fe14d7f77" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lock "384d4037-bac4-423f-bc7a-e64fe14d7f77" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG nova.policy [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72a395fc29094394bbbe0411cbd4ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a319bbe5472b84c6fa3373d5c6e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG nova.objects.instance [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lazy-loading 'flavor' on Instance uuid 384d4037-bac4-423f-bc7a-e64fe14d7f77 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lock "384d4037-bac4-423f-bc7a-e64fe14d7f77" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG nova.compute.manager [req-e4c34f72-cf11-4ac9-baa8-2a86e1c4fcbb req-a37e4b71-7309-47bf-99a9-ec2ab1297804 service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Received event network-vif-plugged-6961298d-d62e-4f7b-b97e-4198a325816c {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e4c34f72-cf11-4ac9-baa8-2a86e1c4fcbb req-a37e4b71-7309-47bf-99a9-ec2ab1297804 service nova] Acquiring lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e4c34f72-cf11-4ac9-baa8-2a86e1c4fcbb req-a37e4b71-7309-47bf-99a9-ec2ab1297804 service nova] Lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e4c34f72-cf11-4ac9-baa8-2a86e1c4fcbb req-a37e4b71-7309-47bf-99a9-ec2ab1297804 service nova] Lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG nova.compute.manager [req-e4c34f72-cf11-4ac9-baa8-2a86e1c4fcbb req-a37e4b71-7309-47bf-99a9-ec2ab1297804 service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] No waiting events found dispatching network-vif-plugged-6961298d-d62e-4f7b-b97e-4198a325816c {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:32:10 user nova-compute[72773]: WARNING nova.compute.manager [req-e4c34f72-cf11-4ac9-baa8-2a86e1c4fcbb req-a37e4b71-7309-47bf-99a9-ec2ab1297804 service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Received unexpected event network-vif-plugged-6961298d-d62e-4f7b-b97e-4198a325816c for instance with vm_state building and task_state spawning.
Aug 16 22:32:10 user nova-compute[72773]: DEBUG nova.compute.manager [req-e4c34f72-cf11-4ac9-baa8-2a86e1c4fcbb req-a37e4b71-7309-47bf-99a9-ec2ab1297804 service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Received event network-vif-plugged-6961298d-d62e-4f7b-b97e-4198a325816c {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e4c34f72-cf11-4ac9-baa8-2a86e1c4fcbb req-a37e4b71-7309-47bf-99a9-ec2ab1297804 service nova] Acquiring lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e4c34f72-cf11-4ac9-baa8-2a86e1c4fcbb req-a37e4b71-7309-47bf-99a9-ec2ab1297804 service nova] Lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e4c34f72-cf11-4ac9-baa8-2a86e1c4fcbb req-a37e4b71-7309-47bf-99a9-ec2ab1297804 service nova] Lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG nova.compute.manager [req-e4c34f72-cf11-4ac9-baa8-2a86e1c4fcbb req-a37e4b71-7309-47bf-99a9-ec2ab1297804 service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] No waiting events found dispatching network-vif-plugged-6961298d-d62e-4f7b-b97e-4198a325816c {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:32:10 user nova-compute[72773]: WARNING nova.compute.manager [req-e4c34f72-cf11-4ac9-baa8-2a86e1c4fcbb req-a37e4b71-7309-47bf-99a9-ec2ab1297804 service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Received unexpected event network-vif-plugged-6961298d-d62e-4f7b-b97e-4198a325816c for instance with vm_state building and task_state spawning.
Aug 16 22:32:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.182s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/b66ff126-5cbb-4e39-8867-9f5c1538cf91/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/b66ff126-5cbb-4e39-8867-9f5c1538cf91/disk 1073741824" returned: 0 in 0.062s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Acquiring lock "384d4037-bac4-423f-bc7a-e64fe14d7f77" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lock "384d4037-bac4-423f-bc7a-e64fe14d7f77" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:10 user nova-compute[72773]: INFO nova.compute.manager [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Attaching volume fc503cc7-6ebc-4b0a-ba76-53747ca3ded8 to /dev/vdb
Aug 16 22:32:10 user nova-compute[72773]: DEBUG os_brick.utils [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.196s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b66ff126-5cbb-4e39-8867-9f5c1538cf91/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66ff126-5cbb-4e39-8867-9f5c1538cf91/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b26ca2d-b753-4eac-89fa-ea47c2151027]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.028s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[59053c3e-e230-4820-868a-d84f42f867fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d427c2fc-9973-4bff-95d3-f199fce02e23]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fdb404-424e-4f4c-865a-27770d562ea6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692225116.0976217, c6adfa95-47ac-40d3-abc1-0c6027507f07 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:32:11 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] VM Stopped (Lifecycle Event)
Aug 16 22:32:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG nova.compute.manager [None req-ebe655e7-b7c6-4068-8b5d-440b4d3fa3d6 None None] [instance: c6adfa95-47ac-40d3-abc1-0c6027507f07] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:32:11 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:32:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad53f28c-8853-4f42-ae3e-94bb84c03372]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG os_brick.utils [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] <== get_connector_properties: return (202ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Updating existing volume attachment record: cfbcaa99-506a-469a-b4db-ee41b7d0af06 {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66ff126-5cbb-4e39-8867-9f5c1538cf91/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Cannot resize image /opt/stack/data/nova/instances/b66ff126-5cbb-4e39-8867-9f5c1538cf91/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG nova.objects.instance [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lazy-loading 'migration_context' on Instance uuid b66ff126-5cbb-4e39-8867-9f5c1538cf91 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Ensure instance console log exists: /opt/stack/data/nova/instances/b66ff126-5cbb-4e39-8867-9f5c1538cf91/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG nova.network.neutron [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Successfully created port: 98ad4609-c2b4-4836-ab03-0d3e3b736fce {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG nova.compute.manager [req-f2f2e883-68f9-4abc-aa46-54479336a5e3 req-47a0949d-0650-4c79-9ddf-6fdc466b588e service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Received event network-vif-plugged-2be096ff-0d79-453c-b879-0de5692a28be {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f2f2e883-68f9-4abc-aa46-54479336a5e3 req-47a0949d-0650-4c79-9ddf-6fdc466b588e service nova] Acquiring lock "384d4037-bac4-423f-bc7a-e64fe14d7f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f2f2e883-68f9-4abc-aa46-54479336a5e3 req-47a0949d-0650-4c79-9ddf-6fdc466b588e service nova] Lock "384d4037-bac4-423f-bc7a-e64fe14d7f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f2f2e883-68f9-4abc-aa46-54479336a5e3 req-47a0949d-0650-4c79-9ddf-6fdc466b588e service nova] Lock "384d4037-bac4-423f-bc7a-e64fe14d7f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG nova.compute.manager [req-f2f2e883-68f9-4abc-aa46-54479336a5e3 req-47a0949d-0650-4c79-9ddf-6fdc466b588e service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] No waiting events found dispatching network-vif-plugged-2be096ff-0d79-453c-b879-0de5692a28be {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:32:11 user nova-compute[72773]: WARNING nova.compute.manager [req-f2f2e883-68f9-4abc-aa46-54479336a5e3 req-47a0949d-0650-4c79-9ddf-6fdc466b588e service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Received unexpected event network-vif-plugged-2be096ff-0d79-453c-b879-0de5692a28be for instance with vm_state active and task_state None.
Aug 16 22:32:11 user nova-compute[72773]: DEBUG nova.compute.manager [req-8225d2e0-d768-46a9-b0b0-4580b0141383 req-3f491ad1-b27d-479d-9a6e-2d4fa47ac0b1 service nova] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Received event network-vif-plugged-96243341-8834-4a23-9bf3-964374e14014 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-8225d2e0-d768-46a9-b0b0-4580b0141383 req-3f491ad1-b27d-479d-9a6e-2d4fa47ac0b1 service nova] Acquiring lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-8225d2e0-d768-46a9-b0b0-4580b0141383 req-3f491ad1-b27d-479d-9a6e-2d4fa47ac0b1 service nova] Lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-8225d2e0-d768-46a9-b0b0-4580b0141383 req-3f491ad1-b27d-479d-9a6e-2d4fa47ac0b1 service nova] Lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:11 user nova-compute[72773]: DEBUG nova.compute.manager [req-8225d2e0-d768-46a9-b0b0-4580b0141383 req-3f491ad1-b27d-479d-9a6e-2d4fa47ac0b1 service nova] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] No waiting events found dispatching network-vif-plugged-96243341-8834-4a23-9bf3-964374e14014 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:32:11 user nova-compute[72773]: WARNING nova.compute.manager [req-8225d2e0-d768-46a9-b0b0-4580b0141383 req-3f491ad1-b27d-479d-9a6e-2d4fa47ac0b1 service nova] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Received unexpected event network-vif-plugged-96243341-8834-4a23-9bf3-964374e14014 for instance with vm_state building and task_state spawning.
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.network.neutron [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Successfully updated port: 98ad4609-c2b4-4836-ab03-0d3e3b736fce {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Acquiring lock "refresh_cache-b66ff126-5cbb-4e39-8867-9f5c1538cf91" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Acquired lock "refresh_cache-b66ff126-5cbb-4e39-8867-9f5c1538cf91" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.network.neutron [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.network.neutron [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.compute.manager [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225132.405163, cf01c401-c424-4b3e-aa5b-439d62b1ae4c => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:32:12 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] VM Resumed (Lifecycle Event)
Aug 16 22:32:12 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Instance spawned successfully.
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:32:12 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225132.4072962, cf01c401-c424-4b3e-aa5b-439d62b1ae4c => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:32:12 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] VM Started (Lifecycle Event)
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:32:12 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.network.neutron [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Updating instance_info_cache with network_info: [{"id": "98ad4609-c2b4-4836-ab03-0d3e3b736fce", "address": "fa:16:3e:1e:7d:35", "network": {"id": "5cde2c8a-cc09-442d-b474-eb3cd32efbf1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1685780614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc5a319bbe5472b84c6fa3373d5c6e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ad4609-c2", "ovs_interfaceid": "98ad4609-c2b4-4836-ab03-0d3e3b736fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:32:12 user nova-compute[72773]: INFO nova.compute.manager [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Took 7.50 seconds to spawn the instance on the hypervisor.
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.compute.manager [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Releasing lock "refresh_cache-b66ff126-5cbb-4e39-8867-9f5c1538cf91" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.compute.manager [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Instance network_info: |[{"id": "98ad4609-c2b4-4836-ab03-0d3e3b736fce", "address": "fa:16:3e:1e:7d:35", "network": {"id": "5cde2c8a-cc09-442d-b474-eb3cd32efbf1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1685780614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc5a319bbe5472b84c6fa3373d5c6e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ad4609-c2", "ovs_interfaceid": "98ad4609-c2b4-4836-ab03-0d3e3b736fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Start _get_guest_xml network_info=[{"id": "98ad4609-c2b4-4836-ab03-0d3e3b736fce", "address": "fa:16:3e:1e:7d:35", "network": {"id": "5cde2c8a-cc09-442d-b474-eb3cd32efbf1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1685780614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc5a319bbe5472b84c6fa3373d5c6e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ad4609-c2", "ovs_interfaceid": "98ad4609-c2b4-4836-ab03-0d3e3b736fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:32:12 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:32:12 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:32:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2117739987',display_name='tempest-VolumesActionsTest-instance-2117739987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2117739987',id=23,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9fc5a319bbe5472b84c6fa3373d5c6e8',ramdisk_id='',reservation_id='r-hvlmpl40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1300049092',owner_user_name='tempest-VolumesActionsTest-1300049092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:32:10Z,user_data=None,user_id='72a395fc29094394bbbe0411cbd4ccfc',uuid=b66ff126-5cbb-4e39-8867-9f5c1538cf91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98ad4609-c2b4-4836-ab03-0d3e3b736fce", "address": "fa:16:3e:1e:7d:35", "network": {"id": "5cde2c8a-cc09-442d-b474-eb3cd32efbf1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1685780614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc5a319bbe5472b84c6fa3373d5c6e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ad4609-c2", "ovs_interfaceid": "98ad4609-c2b4-4836-ab03-0d3e3b736fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Converting VIF {"id": "98ad4609-c2b4-4836-ab03-0d3e3b736fce", "address": "fa:16:3e:1e:7d:35", "network": {"id": "5cde2c8a-cc09-442d-b474-eb3cd32efbf1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1685780614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc5a319bbe5472b84c6fa3373d5c6e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ad4609-c2", "ovs_interfaceid": "98ad4609-c2b4-4836-ab03-0d3e3b736fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:7d:35,bridge_name='br-int',has_traffic_filtering=True,id=98ad4609-c2b4-4836-ab03-0d3e3b736fce,network=Network(5cde2c8a-cc09-442d-b474-eb3cd32efbf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98ad4609-c2') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.objects.instance [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lazy-loading 'pci_devices' on Instance uuid b66ff126-5cbb-4e39-8867-9f5c1538cf91 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225132.6092076, 391a6006-4fe6-4398-a1e8-ae95b5edbf2b => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:32:12 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] VM Resumed (Lifecycle Event)
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.compute.manager [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:32:12 user nova-compute[72773]: INFO nova.compute.manager [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Took 8.33 seconds to build instance.
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:32:12 user nova-compute[72773]:   <uuid>b66ff126-5cbb-4e39-8867-9f5c1538cf91</uuid>
Aug 16 22:32:12 user nova-compute[72773]:   <name>instance-00000017</name>
Aug 16 22:32:12 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:32:12 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:32:12 user nova-compute[72773]:   <metadata>
Aug 16 22:32:12 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:32:12 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:32:12 user nova-compute[72773]:       <nova:name>tempest-VolumesActionsTest-instance-2117739987</nova:name>
Aug 16 22:32:12 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:32:12</nova:creationTime>
Aug 16 22:32:12 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:32:12 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:32:12 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:32:12 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:32:12 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:32:12 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:32:12 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:32:12 user nova-compute[72773]:       <nova:owner>
Aug 16 22:32:12 user nova-compute[72773]:         <nova:user uuid="72a395fc29094394bbbe0411cbd4ccfc">tempest-VolumesActionsTest-1300049092-project-member</nova:user>
Aug 16 22:32:12 user nova-compute[72773]:         <nova:project uuid="9fc5a319bbe5472b84c6fa3373d5c6e8">tempest-VolumesActionsTest-1300049092</nova:project>
Aug 16 22:32:12 user nova-compute[72773]:       </nova:owner>
Aug 16 22:32:12 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:32:12 user nova-compute[72773]:       <nova:ports>
Aug 16 22:32:12 user nova-compute[72773]:         <nova:port uuid="98ad4609-c2b4-4836-ab03-0d3e3b736fce">
Aug 16 22:32:12 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 22:32:12 user nova-compute[72773]:         </nova:port>
Aug 16 22:32:12 user nova-compute[72773]:       </nova:ports>
Aug 16 22:32:12 user nova-compute[72773]:     </nova:instance>
Aug 16 22:32:12 user nova-compute[72773]:   </metadata>
Aug 16 22:32:12 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:32:12 user nova-compute[72773]:     <system>
Aug 16 22:32:12 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:32:12 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:32:12 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:32:12 user nova-compute[72773]:       <entry name="serial">b66ff126-5cbb-4e39-8867-9f5c1538cf91</entry>
Aug 16 22:32:12 user nova-compute[72773]:       <entry name="uuid">b66ff126-5cbb-4e39-8867-9f5c1538cf91</entry>
Aug 16 22:32:12 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:32:12 user nova-compute[72773]:     </system>
Aug 16 22:32:12 user nova-compute[72773]:   </sysinfo>
Aug 16 22:32:12 user nova-compute[72773]:   <os>
Aug 16 22:32:12 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:32:12 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:32:12 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:32:12 user nova-compute[72773]:   </os>
Aug 16 22:32:12 user nova-compute[72773]:   <features>
Aug 16 22:32:12 user nova-compute[72773]:     <acpi/>
Aug 16 22:32:12 user nova-compute[72773]:     <apic/>
Aug 16 22:32:12 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:32:12 user nova-compute[72773]:   </features>
Aug 16 22:32:12 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:32:12 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:32:12 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:32:12 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:32:12 user nova-compute[72773]:   </clock>
Aug 16 22:32:12 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:32:12 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:32:12 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:32:12 user nova-compute[72773]:   </cpu>
Aug 16 22:32:12 user nova-compute[72773]:   <devices>
Aug 16 22:32:12 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:32:12 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:32:12 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/b66ff126-5cbb-4e39-8867-9f5c1538cf91/disk"/>
Aug 16 22:32:12 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:32:12 user nova-compute[72773]:     </disk>
Aug 16 22:32:12 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:32:12 user nova-compute[72773]:       <mac address="fa:16:3e:1e:7d:35"/>
Aug 16 22:32:12 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:32:12 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:32:12 user nova-compute[72773]:       <target dev="tap98ad4609-c2"/>
Aug 16 22:32:12 user nova-compute[72773]:     </interface>
Aug 16 22:32:12 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:32:12 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/b66ff126-5cbb-4e39-8867-9f5c1538cf91/console.log" append="off"/>
Aug 16 22:32:12 user nova-compute[72773]:     </serial>
Aug 16 22:32:12 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:32:12 user nova-compute[72773]:     <video>
Aug 16 22:32:12 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:32:12 user nova-compute[72773]:     </video>
Aug 16 22:32:12 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:32:12 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:32:12 user nova-compute[72773]:     </rng>
Aug 16 22:32:12 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:32:12 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:32:12 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:32:12 user nova-compute[72773]:     </memballoon>
Aug 16 22:32:12 user nova-compute[72773]:   </devices>
Aug 16 22:32:12 user nova-compute[72773]: </domain>
Aug 16 22:32:12 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:32:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2117739987',display_name='tempest-VolumesActionsTest-instance-2117739987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2117739987',id=23,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9fc5a319bbe5472b84c6fa3373d5c6e8',ramdisk_id='',reservation_id='r-hvlmpl40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1300049092',owner_user_name='tempest-VolumesActionsTest-1300049092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:32:10Z,user_data=None,user_id='72a395fc29094394bbbe0411cbd4ccfc',uuid=b66ff126-5cbb-4e39-8867-9f5c1538cf91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98ad4609-c2b4-4836-ab03-0d3e3b736fce", "address": "fa:16:3e:1e:7d:35", "network": {"id": "5cde2c8a-cc09-442d-b474-eb3cd32efbf1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1685780614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc5a319bbe5472b84c6fa3373d5c6e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ad4609-c2", "ovs_interfaceid": "98ad4609-c2b4-4836-ab03-0d3e3b736fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Converting VIF {"id": "98ad4609-c2b4-4836-ab03-0d3e3b736fce", "address": "fa:16:3e:1e:7d:35", "network": {"id": "5cde2c8a-cc09-442d-b474-eb3cd32efbf1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1685780614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc5a319bbe5472b84c6fa3373d5c6e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ad4609-c2", "ovs_interfaceid": "98ad4609-c2b4-4836-ab03-0d3e3b736fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:7d:35,bridge_name='br-int',has_traffic_filtering=True,id=98ad4609-c2b4-4836-ab03-0d3e3b736fce,network=Network(5cde2c8a-cc09-442d-b474-eb3cd32efbf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98ad4609-c2') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG os_vif [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:7d:35,bridge_name='br-int',has_traffic_filtering=True,id=98ad4609-c2b4-4836-ab03-0d3e3b736fce,network=Network(5cde2c8a-cc09-442d-b474-eb3cd32efbf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98ad4609-c2') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-08d1dd1e-8047-40d3-b244-80534f5dfe2e tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.425s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98ad4609-c2, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap98ad4609-c2, col_values=(('external_ids', {'iface-id': '98ad4609-c2b4-4836-ab03-0d3e3b736fce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:7d:35', 'vm-uuid': 'b66ff126-5cbb-4e39-8867-9f5c1538cf91'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:32:12 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Instance spawned successfully.
Aug 16 22:32:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:12 user nova-compute[72773]: INFO os_vif [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:7d:35,bridge_name='br-int',has_traffic_filtering=True,id=98ad4609-c2b4-4836-ab03-0d3e3b736fce,network=Network(5cde2c8a-cc09-442d-b474-eb3cd32efbf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98ad4609-c2')
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:32:12 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225132.6102045, 391a6006-4fe6-4398-a1e8-ae95b5edbf2b => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:32:12 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] VM Started (Lifecycle Event)
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] No VIF found with MAC fa:16:3e:1e:7d:35, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:32:12 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.compute.manager [req-5624ea44-7c6a-4bcd-a68e-671a7bc27047 req-42ecd45d-4dca-43aa-b899-64515420be93 service nova] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Received event network-changed-98ad4609-c2b4-4836-ab03-0d3e3b736fce {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.compute.manager [req-5624ea44-7c6a-4bcd-a68e-671a7bc27047 req-42ecd45d-4dca-43aa-b899-64515420be93 service nova] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Refreshing instance network info cache due to event network-changed-98ad4609-c2b4-4836-ab03-0d3e3b736fce. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5624ea44-7c6a-4bcd-a68e-671a7bc27047 req-42ecd45d-4dca-43aa-b899-64515420be93 service nova] Acquiring lock "refresh_cache-b66ff126-5cbb-4e39-8867-9f5c1538cf91" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5624ea44-7c6a-4bcd-a68e-671a7bc27047 req-42ecd45d-4dca-43aa-b899-64515420be93 service nova] Acquired lock "refresh_cache-b66ff126-5cbb-4e39-8867-9f5c1538cf91" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.network.neutron [req-5624ea44-7c6a-4bcd-a68e-671a7bc27047 req-42ecd45d-4dca-43aa-b899-64515420be93 service nova] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Refreshing network info cache for port 98ad4609-c2b4-4836-ab03-0d3e3b736fce {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:32:12 user nova-compute[72773]: INFO nova.compute.manager [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Took 8.73 seconds to spawn the instance on the hypervisor.
Aug 16 22:32:12 user nova-compute[72773]: DEBUG nova.compute.manager [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:32:12 user nova-compute[72773]: INFO nova.compute.manager [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Took 9.47 seconds to build instance.
Aug 16 22:32:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c00286ff-5249-4007-b6cb-ea36a4e367db tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.563s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:13 user nova-compute[72773]: DEBUG nova.network.neutron [req-5624ea44-7c6a-4bcd-a68e-671a7bc27047 req-42ecd45d-4dca-43aa-b899-64515420be93 service nova] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Updated VIF entry in instance network info cache for port 98ad4609-c2b4-4836-ab03-0d3e3b736fce. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:32:13 user nova-compute[72773]: DEBUG nova.network.neutron [req-5624ea44-7c6a-4bcd-a68e-671a7bc27047 req-42ecd45d-4dca-43aa-b899-64515420be93 service nova] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Updating instance_info_cache with network_info: [{"id": "98ad4609-c2b4-4836-ab03-0d3e3b736fce", "address": "fa:16:3e:1e:7d:35", "network": {"id": "5cde2c8a-cc09-442d-b474-eb3cd32efbf1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1685780614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc5a319bbe5472b84c6fa3373d5c6e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ad4609-c2", "ovs_interfaceid": "98ad4609-c2b4-4836-ab03-0d3e3b736fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:32:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5624ea44-7c6a-4bcd-a68e-671a7bc27047 req-42ecd45d-4dca-43aa-b899-64515420be93 service nova] Releasing lock "refresh_cache-b66ff126-5cbb-4e39-8867-9f5c1538cf91" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:32:13 user nova-compute[72773]: DEBUG nova.compute.manager [req-80bdee1a-bd62-4f58-be9b-740cea1e8101 req-a3faad60-57b2-4446-9be5-fd61e770113c service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-changed-b47506d5-cd81-498a-8f7b-d735d0601f49 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:13 user nova-compute[72773]: DEBUG nova.compute.manager [req-80bdee1a-bd62-4f58-be9b-740cea1e8101 req-a3faad60-57b2-4446-9be5-fd61e770113c service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Refreshing instance network info cache due to event network-changed-b47506d5-cd81-498a-8f7b-d735d0601f49. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:32:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-80bdee1a-bd62-4f58-be9b-740cea1e8101 req-a3faad60-57b2-4446-9be5-fd61e770113c service nova] Acquiring lock "refresh_cache-5aa5adad-599d-424f-bbfc-7d87ead31b57" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:32:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-80bdee1a-bd62-4f58-be9b-740cea1e8101 req-a3faad60-57b2-4446-9be5-fd61e770113c service nova] Acquired lock "refresh_cache-5aa5adad-599d-424f-bbfc-7d87ead31b57" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:32:13 user nova-compute[72773]: DEBUG nova.network.neutron [req-80bdee1a-bd62-4f58-be9b-740cea1e8101 req-a3faad60-57b2-4446-9be5-fd61e770113c service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Refreshing network info cache for port b47506d5-cd81-498a-8f7b-d735d0601f49 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:32:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:14 user nova-compute[72773]: DEBUG nova.compute.manager [req-3c5ea8d2-c150-4e7e-aa31-f8683f00335b req-4af2c29f-b827-4c38-ad42-837e1bbe02c1 service nova] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Received event network-vif-plugged-98ad4609-c2b4-4836-ab03-0d3e3b736fce {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3c5ea8d2-c150-4e7e-aa31-f8683f00335b req-4af2c29f-b827-4c38-ad42-837e1bbe02c1 service nova] Acquiring lock "b66ff126-5cbb-4e39-8867-9f5c1538cf91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3c5ea8d2-c150-4e7e-aa31-f8683f00335b req-4af2c29f-b827-4c38-ad42-837e1bbe02c1 service nova] Lock "b66ff126-5cbb-4e39-8867-9f5c1538cf91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3c5ea8d2-c150-4e7e-aa31-f8683f00335b req-4af2c29f-b827-4c38-ad42-837e1bbe02c1 service nova] Lock "b66ff126-5cbb-4e39-8867-9f5c1538cf91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:14 user nova-compute[72773]: DEBUG nova.compute.manager [req-3c5ea8d2-c150-4e7e-aa31-f8683f00335b req-4af2c29f-b827-4c38-ad42-837e1bbe02c1 service nova] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] No waiting events found dispatching network-vif-plugged-98ad4609-c2b4-4836-ab03-0d3e3b736fce {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:32:14 user nova-compute[72773]: WARNING nova.compute.manager [req-3c5ea8d2-c150-4e7e-aa31-f8683f00335b req-4af2c29f-b827-4c38-ad42-837e1bbe02c1 service nova] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Received unexpected event network-vif-plugged-98ad4609-c2b4-4836-ab03-0d3e3b736fce for instance with vm_state building and task_state spawning.
Aug 16 22:32:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:14 user nova-compute[72773]: DEBUG nova.network.neutron [req-80bdee1a-bd62-4f58-be9b-740cea1e8101 req-a3faad60-57b2-4446-9be5-fd61e770113c service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Updated VIF entry in instance network info cache for port b47506d5-cd81-498a-8f7b-d735d0601f49. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:32:14 user nova-compute[72773]: DEBUG nova.network.neutron [req-80bdee1a-bd62-4f58-be9b-740cea1e8101 req-a3faad60-57b2-4446-9be5-fd61e770113c service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Updating instance_info_cache with network_info: [{"id": "b47506d5-cd81-498a-8f7b-d735d0601f49", "address": "fa:16:3e:14:c3:e5", "network": {"id": "8b3d0165-9b35-42e8-bb94-f9cb7d76409d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1320393408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47506d5-cd", "ovs_interfaceid": "b47506d5-cd81-498a-8f7b-d735d0601f49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4188d812-137b-448e-acb1-42dea2d8eb91", "address": "fa:16:3e:0f:fc:e8", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4188d812-13", "ovs_interfaceid": "4188d812-137b-448e-acb1-42dea2d8eb91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2dc74ea7-4f01-465f-8e7a-f5b4299ace47", "address": "fa:16:3e:cc:b0:44", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc74ea7-4f", "ovs_interfaceid": "2dc74ea7-4f01-465f-8e7a-f5b4299ace47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2581ab2b-5a7c-4c9a-8f59-f3c5a7228044", "address": "fa:16:3e:cc:9c:eb", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2581ab2b-5a", "ovs_interfaceid": "2581ab2b-5a7c-4c9a-8f59-f3c5a7228044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "464fb40c-7053-464f-b788-d285f283fb56", "address": "fa:16:3e:ce:aa:1f", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464fb40c-70", "ovs_interfaceid": "464fb40c-7053-464f-b788-d285f283fb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44f58154-ceae-45ef-a169-0681e0e9a3fb", "address": "fa:16:3e:95:7a:63", "network": {"id": "a2682c6d-c949-41e3-8efe-546921aea554", "bridge": "br-int", "label": "tempest-device-tagging-net2-870198650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44f58154-ce", "ovs_interfaceid": "44f58154-ceae-45ef-a169-0681e0e9a3fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0230e8bd-c876-4793-96f6-9ccc72deaa73", "address": "fa:16:3e:9d:92:42", "network": {"id": "a2682c6d-c949-41e3-8efe-546921aea554", "bridge": "br-int", "label": "tempest-device-tagging-net2-870198650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0230e8bd-c8", "ovs_interfaceid": "0230e8bd-c876-4793-96f6-9ccc72deaa73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:32:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-80bdee1a-bd62-4f58-be9b-740cea1e8101 req-a3faad60-57b2-4446-9be5-fd61e770113c service nova] Releasing lock "refresh_cache-5aa5adad-599d-424f-bbfc-7d87ead31b57" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:32:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:16 user nova-compute[72773]: DEBUG nova.compute.manager [req-54cb0842-a462-4df6-8ac7-0ee401bb0198 req-3cabe81a-5841-496b-b26e-9328db8e5ede service nova] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Received event network-vif-plugged-98ad4609-c2b4-4836-ab03-0d3e3b736fce {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-54cb0842-a462-4df6-8ac7-0ee401bb0198 req-3cabe81a-5841-496b-b26e-9328db8e5ede service nova] Acquiring lock "b66ff126-5cbb-4e39-8867-9f5c1538cf91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-54cb0842-a462-4df6-8ac7-0ee401bb0198 req-3cabe81a-5841-496b-b26e-9328db8e5ede service nova] Lock "b66ff126-5cbb-4e39-8867-9f5c1538cf91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-54cb0842-a462-4df6-8ac7-0ee401bb0198 req-3cabe81a-5841-496b-b26e-9328db8e5ede service nova] Lock "b66ff126-5cbb-4e39-8867-9f5c1538cf91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:16 user nova-compute[72773]: DEBUG nova.compute.manager [req-54cb0842-a462-4df6-8ac7-0ee401bb0198 req-3cabe81a-5841-496b-b26e-9328db8e5ede service nova] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] No waiting events found dispatching network-vif-plugged-98ad4609-c2b4-4836-ab03-0d3e3b736fce {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:32:16 user nova-compute[72773]: WARNING nova.compute.manager [req-54cb0842-a462-4df6-8ac7-0ee401bb0198 req-3cabe81a-5841-496b-b26e-9328db8e5ede service nova] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Received unexpected event network-vif-plugged-98ad4609-c2b4-4836-ab03-0d3e3b736fce for instance with vm_state building and task_state spawning.
Aug 16 22:32:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Acquiring lock "5aa5adad-599d-424f-bbfc-7d87ead31b57" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Acquiring lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:17 user nova-compute[72773]: INFO nova.compute.manager [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Terminating instance
Aug 16 22:32:17 user nova-compute[72773]: DEBUG nova.compute.manager [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:32:17 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225137.2420564, b66ff126-5cbb-4e39-8867-9f5c1538cf91 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:32:17 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] VM Resumed (Lifecycle Event)
Aug 16 22:32:17 user nova-compute[72773]: DEBUG nova.compute.manager [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:32:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:32:17 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Instance spawned successfully.
Aug 16 22:32:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:32:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:17 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:32:17 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:32:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:32:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:32:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:32:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:32:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:32:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:32:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:17 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:32:17 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225137.242264, b66ff126-5cbb-4e39-8867-9f5c1538cf91 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:32:17 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] VM Started (Lifecycle Event)
Aug 16 22:32:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:17 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:32:17 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:32:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:17 user nova-compute[72773]: INFO nova.compute.manager [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Took 7.13 seconds to spawn the instance on the hypervisor.
Aug 16 22:32:17 user nova-compute[72773]: DEBUG nova.compute.manager [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:32:17 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:32:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:17 user nova-compute[72773]: INFO nova.compute.manager [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Took 8.16 seconds to build instance.
Aug 16 22:32:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cafec2d0-9ba2-4459-8fa0-2b7908092565 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lock "b66ff126-5cbb-4e39-8867-9f5c1538cf91" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.311s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:18 user nova-compute[72773]: DEBUG nova.compute.manager [req-842f2e8c-453c-469e-8ecc-64ccb8963915 req-270277fe-d092-47b1-b048-5b1a28cb28e1 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-unplugged-4188d812-137b-448e-acb1-42dea2d8eb91 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-842f2e8c-453c-469e-8ecc-64ccb8963915 req-270277fe-d092-47b1-b048-5b1a28cb28e1 service nova] Acquiring lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-842f2e8c-453c-469e-8ecc-64ccb8963915 req-270277fe-d092-47b1-b048-5b1a28cb28e1 service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-842f2e8c-453c-469e-8ecc-64ccb8963915 req-270277fe-d092-47b1-b048-5b1a28cb28e1 service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:18 user nova-compute[72773]: DEBUG nova.compute.manager [req-842f2e8c-453c-469e-8ecc-64ccb8963915 req-270277fe-d092-47b1-b048-5b1a28cb28e1 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] No waiting events found dispatching network-vif-unplugged-4188d812-137b-448e-acb1-42dea2d8eb91 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:32:18 user nova-compute[72773]: DEBUG nova.compute.manager [req-842f2e8c-453c-469e-8ecc-64ccb8963915 req-270277fe-d092-47b1-b048-5b1a28cb28e1 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-unplugged-4188d812-137b-448e-acb1-42dea2d8eb91 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:32:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:18 user nova-compute[72773]: DEBUG nova.compute.manager [req-c138ad75-a839-4b1d-be7b-b86bb1d160dc req-74e05483-094a-442c-87ff-e4ec0ddc01f2 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-unplugged-b47506d5-cd81-498a-8f7b-d735d0601f49 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c138ad75-a839-4b1d-be7b-b86bb1d160dc req-74e05483-094a-442c-87ff-e4ec0ddc01f2 service nova] Acquiring lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c138ad75-a839-4b1d-be7b-b86bb1d160dc req-74e05483-094a-442c-87ff-e4ec0ddc01f2 service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c138ad75-a839-4b1d-be7b-b86bb1d160dc req-74e05483-094a-442c-87ff-e4ec0ddc01f2 service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:18 user nova-compute[72773]: DEBUG nova.compute.manager [req-c138ad75-a839-4b1d-be7b-b86bb1d160dc req-74e05483-094a-442c-87ff-e4ec0ddc01f2 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] No waiting events found dispatching network-vif-unplugged-b47506d5-cd81-498a-8f7b-d735d0601f49 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:32:18 user nova-compute[72773]: DEBUG nova.compute.manager [req-c138ad75-a839-4b1d-be7b-b86bb1d160dc req-74e05483-094a-442c-87ff-e4ec0ddc01f2 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-unplugged-b47506d5-cd81-498a-8f7b-d735d0601f49 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:32:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:18 user nova-compute[72773]: DEBUG nova.compute.manager [req-39297e1a-30b3-4a0f-966e-d31420c56c0b req-4e18ae2f-d64f-4ec6-abd2-a91197bd967e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-unplugged-0230e8bd-c876-4793-96f6-9ccc72deaa73 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-39297e1a-30b3-4a0f-966e-d31420c56c0b req-4e18ae2f-d64f-4ec6-abd2-a91197bd967e service nova] Acquiring lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-39297e1a-30b3-4a0f-966e-d31420c56c0b req-4e18ae2f-d64f-4ec6-abd2-a91197bd967e service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-39297e1a-30b3-4a0f-966e-d31420c56c0b req-4e18ae2f-d64f-4ec6-abd2-a91197bd967e service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:18 user nova-compute[72773]: DEBUG nova.compute.manager [req-39297e1a-30b3-4a0f-966e-d31420c56c0b req-4e18ae2f-d64f-4ec6-abd2-a91197bd967e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] No waiting events found dispatching network-vif-unplugged-0230e8bd-c876-4793-96f6-9ccc72deaa73 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:32:18 user nova-compute[72773]: DEBUG nova.compute.manager [req-39297e1a-30b3-4a0f-966e-d31420c56c0b req-4e18ae2f-d64f-4ec6-abd2-a91197bd967e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-unplugged-0230e8bd-c876-4793-96f6-9ccc72deaa73 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:32:18 user nova-compute[72773]: DEBUG nova.compute.manager [req-39297e1a-30b3-4a0f-966e-d31420c56c0b req-4e18ae2f-d64f-4ec6-abd2-a91197bd967e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-plugged-0230e8bd-c876-4793-96f6-9ccc72deaa73 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-39297e1a-30b3-4a0f-966e-d31420c56c0b req-4e18ae2f-d64f-4ec6-abd2-a91197bd967e service nova] Acquiring lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-39297e1a-30b3-4a0f-966e-d31420c56c0b req-4e18ae2f-d64f-4ec6-abd2-a91197bd967e service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-39297e1a-30b3-4a0f-966e-d31420c56c0b req-4e18ae2f-d64f-4ec6-abd2-a91197bd967e service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:18 user nova-compute[72773]: DEBUG nova.compute.manager [req-39297e1a-30b3-4a0f-966e-d31420c56c0b req-4e18ae2f-d64f-4ec6-abd2-a91197bd967e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] No waiting events found dispatching network-vif-plugged-0230e8bd-c876-4793-96f6-9ccc72deaa73 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:32:18 user nova-compute[72773]: WARNING nova.compute.manager [req-39297e1a-30b3-4a0f-966e-d31420c56c0b req-4e18ae2f-d64f-4ec6-abd2-a91197bd967e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received unexpected event network-vif-plugged-0230e8bd-c876-4793-96f6-9ccc72deaa73 for instance with vm_state active and task_state deleting.
Aug 16 22:32:19 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Instance destroyed successfully.
Aug 16 22:32:19 user nova-compute[72773]: DEBUG nova.objects.instance [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Lazy-loading 'resources' on Instance uuid 5aa5adad-599d-424f-bbfc-7d87ead31b57 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:29:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765625997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765625997',id=16,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMScjTcOHYjO3eWRs/Yuo7fSh7MpfYYQLIrHFfw9fG9QqwSK31lTCad/jiuVUnjerxxkGXkhhw4WPLykaRhxGmubPPDDZ3Tm+anQtKHRudc+w9uSIuAED6NyB/kjjLGhNQ==',key_name='tempest-keypair-941332691',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:30:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3a13289351c4eb58e8a2b56e83763fd',ramdisk_id='',reservation_id='r-5o83v8o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-712587175',owner_user_name='tempest-TaggedBootDevicesTest_v242-712587175-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:30:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4682d0544d4646099b16e3af92d6cc39',uuid=5aa5adad-599d-424f-bbfc-7d87ead31b57,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b47506d5-cd81-498a-8f7b-d735d0601f49", "address": "fa:16:3e:14:c3:e5", "network": {"id": "8b3d0165-9b35-42e8-bb94-f9cb7d76409d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1320393408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47506d5-cd", "ovs_interfaceid": "b47506d5-cd81-498a-8f7b-d735d0601f49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converting VIF {"id": "b47506d5-cd81-498a-8f7b-d735d0601f49", "address": "fa:16:3e:14:c3:e5", "network": {"id": "8b3d0165-9b35-42e8-bb94-f9cb7d76409d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1320393408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47506d5-cd", "ovs_interfaceid": "b47506d5-cd81-498a-8f7b-d735d0601f49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:c3:e5,bridge_name='br-int',has_traffic_filtering=True,id=b47506d5-cd81-498a-8f7b-d735d0601f49,network=Network(8b3d0165-9b35-42e8-bb94-f9cb7d76409d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb47506d5-cd') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG os_vif [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:c3:e5,bridge_name='br-int',has_traffic_filtering=True,id=b47506d5-cd81-498a-8f7b-d735d0601f49,network=Network(8b3d0165-9b35-42e8-bb94-f9cb7d76409d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb47506d5-cd') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb47506d5-cd, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:19 user nova-compute[72773]: INFO os_vif [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:c3:e5,bridge_name='br-int',has_traffic_filtering=True,id=b47506d5-cd81-498a-8f7b-d735d0601f49,network=Network(8b3d0165-9b35-42e8-bb94-f9cb7d76409d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb47506d5-cd')
Aug 16 22:32:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:29:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765625997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765625997',id=16,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMScjTcOHYjO3eWRs/Yuo7fSh7MpfYYQLIrHFfw9fG9QqwSK31lTCad/jiuVUnjerxxkGXkhhw4WPLykaRhxGmubPPDDZ3Tm+anQtKHRudc+w9uSIuAED6NyB/kjjLGhNQ==',key_name='tempest-keypair-941332691',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:30:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3a13289351c4eb58e8a2b56e83763fd',ramdisk_id='',reservation_id='r-5o83v8o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-712587175',owner_user_name='tempest-TaggedBootDevicesTest_v242-712587175-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:30:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4682d0544d4646099b16e3af92d6cc39',uuid=5aa5adad-599d-424f-bbfc-7d87ead31b57,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4188d812-137b-448e-acb1-42dea2d8eb91", "address": "fa:16:3e:0f:fc:e8", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4188d812-13", "ovs_interfaceid": "4188d812-137b-448e-acb1-42dea2d8eb91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converting VIF {"id": "4188d812-137b-448e-acb1-42dea2d8eb91", "address": "fa:16:3e:0f:fc:e8", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4188d812-13", "ovs_interfaceid": "4188d812-137b-448e-acb1-42dea2d8eb91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:fc:e8,bridge_name='br-int',has_traffic_filtering=True,id=4188d812-137b-448e-acb1-42dea2d8eb91,network=Network(2b2b1125-d184-44d3-9cfd-0b0808ce15f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4188d812-13') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG os_vif [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:fc:e8,bridge_name='br-int',has_traffic_filtering=True,id=4188d812-137b-448e-acb1-42dea2d8eb91,network=Network(2b2b1125-d184-44d3-9cfd-0b0808ce15f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4188d812-13') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4188d812-13, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:19 user nova-compute[72773]: INFO os_vif [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:fc:e8,bridge_name='br-int',has_traffic_filtering=True,id=4188d812-137b-448e-acb1-42dea2d8eb91,network=Network(2b2b1125-d184-44d3-9cfd-0b0808ce15f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4188d812-13')
Aug 16 22:32:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:29:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765625997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765625997',id=16,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMScjTcOHYjO3eWRs/Yuo7fSh7MpfYYQLIrHFfw9fG9QqwSK31lTCad/jiuVUnjerxxkGXkhhw4WPLykaRhxGmubPPDDZ3Tm+anQtKHRudc+w9uSIuAED6NyB/kjjLGhNQ==',key_name='tempest-keypair-941332691',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:30:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3a13289351c4eb58e8a2b56e83763fd',ramdisk_id='',reservation_id='r-5o83v8o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-712587175',owner_user_name='tempest-TaggedBootDevicesTest_v242-712587175-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:30:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4682d0544d4646099b16e3af92d6cc39',uuid=5aa5adad-599d-424f-bbfc-7d87ead31b57,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2dc74ea7-4f01-465f-8e7a-f5b4299ace47", "address": "fa:16:3e:cc:b0:44", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc74ea7-4f", "ovs_interfaceid": "2dc74ea7-4f01-465f-8e7a-f5b4299ace47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converting VIF {"id": "2dc74ea7-4f01-465f-8e7a-f5b4299ace47", "address": "fa:16:3e:cc:b0:44", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc74ea7-4f", "ovs_interfaceid": "2dc74ea7-4f01-465f-8e7a-f5b4299ace47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:b0:44,bridge_name='br-int',has_traffic_filtering=True,id=2dc74ea7-4f01-465f-8e7a-f5b4299ace47,network=Network(2b2b1125-d184-44d3-9cfd-0b0808ce15f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2dc74ea7-4f') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG os_vif [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:b0:44,bridge_name='br-int',has_traffic_filtering=True,id=2dc74ea7-4f01-465f-8e7a-f5b4299ace47,network=Network(2b2b1125-d184-44d3-9cfd-0b0808ce15f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2dc74ea7-4f') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2dc74ea7-4f, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:19 user nova-compute[72773]: INFO os_vif [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:b0:44,bridge_name='br-int',has_traffic_filtering=True,id=2dc74ea7-4f01-465f-8e7a-f5b4299ace47,network=Network(2b2b1125-d184-44d3-9cfd-0b0808ce15f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2dc74ea7-4f')
Aug 16 22:32:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:29:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765625997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765625997',id=16,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMScjTcOHYjO3eWRs/Yuo7fSh7MpfYYQLIrHFfw9fG9QqwSK31lTCad/jiuVUnjerxxkGXkhhw4WPLykaRhxGmubPPDDZ3Tm+anQtKHRudc+w9uSIuAED6NyB/kjjLGhNQ==',key_name='tempest-keypair-941332691',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:30:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3a13289351c4eb58e8a2b56e83763fd',ramdisk_id='',reservation_id='r-5o83v8o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-712587175',owner_user_name='tempest-TaggedBootDevicesTest_v242-712587175-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:30:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4682d0544d4646099b16e3af92d6cc39',uuid=5aa5adad-599d-424f-bbfc-7d87ead31b57,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2581ab2b-5a7c-4c9a-8f59-f3c5a7228044", "address": "fa:16:3e:cc:9c:eb", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2581ab2b-5a", "ovs_interfaceid": "2581ab2b-5a7c-4c9a-8f59-f3c5a7228044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converting VIF {"id": "2581ab2b-5a7c-4c9a-8f59-f3c5a7228044", "address": "fa:16:3e:cc:9c:eb", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2581ab2b-5a", "ovs_interfaceid": "2581ab2b-5a7c-4c9a-8f59-f3c5a7228044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:9c:eb,bridge_name='br-int',has_traffic_filtering=True,id=2581ab2b-5a7c-4c9a-8f59-f3c5a7228044,network=Network(2b2b1125-d184-44d3-9cfd-0b0808ce15f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2581ab2b-5a') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG os_vif [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:9c:eb,bridge_name='br-int',has_traffic_filtering=True,id=2581ab2b-5a7c-4c9a-8f59-f3c5a7228044,network=Network(2b2b1125-d184-44d3-9cfd-0b0808ce15f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2581ab2b-5a') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2581ab2b-5a, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:19 user nova-compute[72773]: INFO os_vif [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:9c:eb,bridge_name='br-int',has_traffic_filtering=True,id=2581ab2b-5a7c-4c9a-8f59-f3c5a7228044,network=Network(2b2b1125-d184-44d3-9cfd-0b0808ce15f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2581ab2b-5a')
Aug 16 22:32:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:29:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765625997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765625997',id=16,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMScjTcOHYjO3eWRs/Yuo7fSh7MpfYYQLIrHFfw9fG9QqwSK31lTCad/jiuVUnjerxxkGXkhhw4WPLykaRhxGmubPPDDZ3Tm+anQtKHRudc+w9uSIuAED6NyB/kjjLGhNQ==',key_name='tempest-keypair-941332691',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:30:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3a13289351c4eb58e8a2b56e83763fd',ramdisk_id='',reservation_id='r-5o83v8o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-712587175',owner_user_name='tempest-TaggedBootDevicesTest_v242-712587175-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:30:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4682d0544d4646099b16e3af92d6cc39',uuid=5aa5adad-599d-424f-bbfc-7d87ead31b57,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "464fb40c-7053-464f-b788-d285f283fb56", "address": "fa:16:3e:ce:aa:1f", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464fb40c-70", "ovs_interfaceid": "464fb40c-7053-464f-b788-d285f283fb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converting VIF {"id": "464fb40c-7053-464f-b788-d285f283fb56", "address": "fa:16:3e:ce:aa:1f", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464fb40c-70", "ovs_interfaceid": "464fb40c-7053-464f-b788-d285f283fb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:aa:1f,bridge_name='br-int',has_traffic_filtering=True,id=464fb40c-7053-464f-b788-d285f283fb56,network=Network(2b2b1125-d184-44d3-9cfd-0b0808ce15f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap464fb40c-70') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG os_vif [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:aa:1f,bridge_name='br-int',has_traffic_filtering=True,id=464fb40c-7053-464f-b788-d285f283fb56,network=Network(2b2b1125-d184-44d3-9cfd-0b0808ce15f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap464fb40c-70') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap464fb40c-70, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:19 user nova-compute[72773]: INFO os_vif [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:aa:1f,bridge_name='br-int',has_traffic_filtering=True,id=464fb40c-7053-464f-b788-d285f283fb56,network=Network(2b2b1125-d184-44d3-9cfd-0b0808ce15f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap464fb40c-70')
Aug 16 22:32:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:29:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765625997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765625997',id=16,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMScjTcOHYjO3eWRs/Yuo7fSh7MpfYYQLIrHFfw9fG9QqwSK31lTCad/jiuVUnjerxxkGXkhhw4WPLykaRhxGmubPPDDZ3Tm+anQtKHRudc+w9uSIuAED6NyB/kjjLGhNQ==',key_name='tempest-keypair-941332691',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:30:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3a13289351c4eb58e8a2b56e83763fd',ramdisk_id='',reservation_id='r-5o83v8o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-712587175',owner_user_name='tempest-TaggedBootDevicesTest_v242-712587175-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:30:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4682d0544d4646099b16e3af92d6cc39',uuid=5aa5adad-599d-424f-bbfc-7d87ead31b57,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44f58154-ceae-45ef-a169-0681e0e9a3fb", "address": "fa:16:3e:95:7a:63", "network": {"id": "a2682c6d-c949-41e3-8efe-546921aea554", "bridge": "br-int", "label": "tempest-device-tagging-net2-870198650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44f58154-ce", "ovs_interfaceid": "44f58154-ceae-45ef-a169-0681e0e9a3fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converting VIF {"id": "44f58154-ceae-45ef-a169-0681e0e9a3fb", "address": "fa:16:3e:95:7a:63", "network": {"id": "a2682c6d-c949-41e3-8efe-546921aea554", "bridge": "br-int", "label": "tempest-device-tagging-net2-870198650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44f58154-ce", "ovs_interfaceid": "44f58154-ceae-45ef-a169-0681e0e9a3fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:7a:63,bridge_name='br-int',has_traffic_filtering=True,id=44f58154-ceae-45ef-a169-0681e0e9a3fb,network=Network(a2682c6d-c949-41e3-8efe-546921aea554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44f58154-ce') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG os_vif [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:7a:63,bridge_name='br-int',has_traffic_filtering=True,id=44f58154-ceae-45ef-a169-0681e0e9a3fb,network=Network(a2682c6d-c949-41e3-8efe-546921aea554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44f58154-ce') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44f58154-ce, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:19 user nova-compute[72773]: INFO os_vif [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:7a:63,bridge_name='br-int',has_traffic_filtering=True,id=44f58154-ceae-45ef-a169-0681e0e9a3fb,network=Network(a2682c6d-c949-41e3-8efe-546921aea554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44f58154-ce')
Aug 16 22:32:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:29:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1765625997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1765625997',id=16,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMScjTcOHYjO3eWRs/Yuo7fSh7MpfYYQLIrHFfw9fG9QqwSK31lTCad/jiuVUnjerxxkGXkhhw4WPLykaRhxGmubPPDDZ3Tm+anQtKHRudc+w9uSIuAED6NyB/kjjLGhNQ==',key_name='tempest-keypair-941332691',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:30:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3a13289351c4eb58e8a2b56e83763fd',ramdisk_id='',reservation_id='r-5o83v8o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-712587175',owner_user_name='tempest-TaggedBootDevicesTest_v242-712587175-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:30:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4682d0544d4646099b16e3af92d6cc39',uuid=5aa5adad-599d-424f-bbfc-7d87ead31b57,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0230e8bd-c876-4793-96f6-9ccc72deaa73", "address": "fa:16:3e:9d:92:42", "network": {"id": "a2682c6d-c949-41e3-8efe-546921aea554", "bridge": "br-int", "label": "tempest-device-tagging-net2-870198650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0230e8bd-c8", "ovs_interfaceid": "0230e8bd-c876-4793-96f6-9ccc72deaa73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converting VIF {"id": "0230e8bd-c876-4793-96f6-9ccc72deaa73", "address": "fa:16:3e:9d:92:42", "network": {"id": "a2682c6d-c949-41e3-8efe-546921aea554", "bridge": "br-int", "label": "tempest-device-tagging-net2-870198650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0230e8bd-c8", "ovs_interfaceid": "0230e8bd-c876-4793-96f6-9ccc72deaa73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:92:42,bridge_name='br-int',has_traffic_filtering=True,id=0230e8bd-c876-4793-96f6-9ccc72deaa73,network=Network(a2682c6d-c949-41e3-8efe-546921aea554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0230e8bd-c8') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG os_vif [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:92:42,bridge_name='br-int',has_traffic_filtering=True,id=0230e8bd-c876-4793-96f6-9ccc72deaa73,network=Network(a2682c6d-c949-41e3-8efe-546921aea554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0230e8bd-c8') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0230e8bd-c8, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:32:19 user nova-compute[72773]: INFO os_vif [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:92:42,bridge_name='br-int',has_traffic_filtering=True,id=0230e8bd-c876-4793-96f6-9ccc72deaa73,network=Network(a2682c6d-c949-41e3-8efe-546921aea554),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0230e8bd-c8')
Aug 16 22:32:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OaMlzoJg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:32:19 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:32:19 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0097a5-5d59-4027-9ccb-752cd7407f36]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bac7e8d-d391-4095-ab2c-3979d26a7eb9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:32:19 user nova-compute[72773]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 (non-flash)
Aug 16 22:32:19 user nova-compute[72773]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 (non-flash)
Aug 16 22:32:19 user nova-compute[72773]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d (non-flash)
Aug 16 22:32:19 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:32:19 user nova-compute[72773]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 (non-flash)
Aug 16 22:32:19 user nova-compute[72773]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 (non-flash)
Aug 16 22:32:19 user nova-compute[72773]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d (non-flash)
Aug 16 22:32:19 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef8040ac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77'): ({'sdc'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Removing single pathed devices sdc {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c1279f-5a4b-46ef-a570-b0e3a0366f04]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdffba73-ac37-47f1-8a10-7d7c64ecd08e]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Flushing IO for device /dev/sdc {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0628d423-0236-491e-b136-b7c8974c37ae]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa654481-dbb9-473f-a480-89372bac640b]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abae6b6-3534-42d4-8ec2-94c0fa13cac5]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ea7751-1097-4106-9883-d01acc079bbd]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77, portal: 172.16.0.220,3260]
Aug 16 22:32:20 user nova-compute[72773]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77, portal: 172.16.0.220,3260] successful.
Aug 16 22:32:20 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-plugged-4188d812-137b-448e-acb1-42dea2d8eb91 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] Acquiring lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] No waiting events found dispatching network-vif-plugged-4188d812-137b-448e-acb1-42dea2d8eb91 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:32:20 user nova-compute[72773]: WARNING nova.compute.manager [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received unexpected event network-vif-plugged-4188d812-137b-448e-acb1-42dea2d8eb91 for instance with vm_state active and task_state deleting.
Aug 16 22:32:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-unplugged-2dc74ea7-4f01-465f-8e7a-f5b4299ace47 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] Acquiring lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] No waiting events found dispatching network-vif-unplugged-2dc74ea7-4f01-465f-8e7a-f5b4299ace47 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-unplugged-2dc74ea7-4f01-465f-8e7a-f5b4299ace47 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-plugged-2dc74ea7-4f01-465f-8e7a-f5b4299ace47 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] Acquiring lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] No waiting events found dispatching network-vif-plugged-2dc74ea7-4f01-465f-8e7a-f5b4299ace47 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:32:20 user nova-compute[72773]: WARNING nova.compute.manager [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received unexpected event network-vif-plugged-2dc74ea7-4f01-465f-8e7a-f5b4299ace47 for instance with vm_state active and task_state deleting.
Aug 16 22:32:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-unplugged-2581ab2b-5a7c-4c9a-8f59-f3c5a7228044 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] Acquiring lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] No waiting events found dispatching network-vif-unplugged-2581ab2b-5a7c-4c9a-8f59-f3c5a7228044 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-unplugged-2581ab2b-5a7c-4c9a-8f59-f3c5a7228044 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-plugged-2581ab2b-5a7c-4c9a-8f59-f3c5a7228044 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] Acquiring lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] No waiting events found dispatching network-vif-plugged-2581ab2b-5a7c-4c9a-8f59-f3c5a7228044 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:32:20 user nova-compute[72773]: WARNING nova.compute.manager [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received unexpected event network-vif-plugged-2581ab2b-5a7c-4c9a-8f59-f3c5a7228044 for instance with vm_state active and task_state deleting.
Aug 16 22:32:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-unplugged-44f58154-ceae-45ef-a169-0681e0e9a3fb {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] Acquiring lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] No waiting events found dispatching network-vif-unplugged-44f58154-ceae-45ef-a169-0681e0e9a3fb {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-e11f98e2-17b4-4826-b467-915ed5355d8f req-0bf7528c-c181-4a66-b5b5-7164b475127e service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-unplugged-44f58154-ceae-45ef-a169-0681e0e9a3fb for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c7ee644-475f-4522-adf6-704098fbda77 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b7c74e-f9e7-4286-b234-00421052caa3]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] <== disconnect_volume: return (405ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rVmzaLuT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:32:20 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.034s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[570cffab-57e5-4733-bbb4-f9b19432f93b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f316bb-f71b-4ee3-9960-1e19c9563937]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:32:20 user nova-compute[72773]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 (non-flash)
Aug 16 22:32:20 user nova-compute[72773]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d (non-flash)
Aug 16 22:32:20 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:32:20 user nova-compute[72773]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 (non-flash)
Aug 16 22:32:20 user nova-compute[72773]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d (non-flash)
Aug 16 22:32:20 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef933b5d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9'): ({'sdd'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Removing single pathed devices sdd {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e407110-385d-417e-aa16-1e78d866c4a1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-cd96f114-1fed-448b-b6ba-02bfcc2e74a0 req-2530b647-d3bd-431e-8b53-4264193c9c3d service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-plugged-b47506d5-cd81-498a-8f7b-d735d0601f49 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-cd96f114-1fed-448b-b6ba-02bfcc2e74a0 req-2530b647-d3bd-431e-8b53-4264193c9c3d service nova] Acquiring lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-cd96f114-1fed-448b-b6ba-02bfcc2e74a0 req-2530b647-d3bd-431e-8b53-4264193c9c3d service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-cd96f114-1fed-448b-b6ba-02bfcc2e74a0 req-2530b647-d3bd-431e-8b53-4264193c9c3d service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-cd96f114-1fed-448b-b6ba-02bfcc2e74a0 req-2530b647-d3bd-431e-8b53-4264193c9c3d service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] No waiting events found dispatching network-vif-plugged-b47506d5-cd81-498a-8f7b-d735d0601f49 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:32:20 user nova-compute[72773]: WARNING nova.compute.manager [req-cd96f114-1fed-448b-b6ba-02bfcc2e74a0 req-2530b647-d3bd-431e-8b53-4264193c9c3d service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received unexpected event network-vif-plugged-b47506d5-cd81-498a-8f7b-d735d0601f49 for instance with vm_state active and task_state deleting.
Aug 16 22:32:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-cd96f114-1fed-448b-b6ba-02bfcc2e74a0 req-2530b647-d3bd-431e-8b53-4264193c9c3d service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-unplugged-464fb40c-7053-464f-b788-d285f283fb56 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-cd96f114-1fed-448b-b6ba-02bfcc2e74a0 req-2530b647-d3bd-431e-8b53-4264193c9c3d service nova] Acquiring lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-cd96f114-1fed-448b-b6ba-02bfcc2e74a0 req-2530b647-d3bd-431e-8b53-4264193c9c3d service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-cd96f114-1fed-448b-b6ba-02bfcc2e74a0 req-2530b647-d3bd-431e-8b53-4264193c9c3d service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-cd96f114-1fed-448b-b6ba-02bfcc2e74a0 req-2530b647-d3bd-431e-8b53-4264193c9c3d service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] No waiting events found dispatching network-vif-unplugged-464fb40c-7053-464f-b788-d285f283fb56 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-cd96f114-1fed-448b-b6ba-02bfcc2e74a0 req-2530b647-d3bd-431e-8b53-4264193c9c3d service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-unplugged-464fb40c-7053-464f-b788-d285f283fb56 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-cd96f114-1fed-448b-b6ba-02bfcc2e74a0 req-2530b647-d3bd-431e-8b53-4264193c9c3d service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-plugged-464fb40c-7053-464f-b788-d285f283fb56 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-cd96f114-1fed-448b-b6ba-02bfcc2e74a0 req-2530b647-d3bd-431e-8b53-4264193c9c3d service nova] Acquiring lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-cd96f114-1fed-448b-b6ba-02bfcc2e74a0 req-2530b647-d3bd-431e-8b53-4264193c9c3d service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-cd96f114-1fed-448b-b6ba-02bfcc2e74a0 req-2530b647-d3bd-431e-8b53-4264193c9c3d service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-cd96f114-1fed-448b-b6ba-02bfcc2e74a0 req-2530b647-d3bd-431e-8b53-4264193c9c3d service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] No waiting events found dispatching network-vif-plugged-464fb40c-7053-464f-b788-d285f283fb56 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:32:20 user nova-compute[72773]: WARNING nova.compute.manager [req-cd96f114-1fed-448b-b6ba-02bfcc2e74a0 req-2530b647-d3bd-431e-8b53-4264193c9c3d service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received unexpected event network-vif-plugged-464fb40c-7053-464f-b788-d285f283fb56 for instance with vm_state active and task_state deleting.
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc495f43-2f8a-4869-b600-4787409960a2]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Flushing IO for device /dev/sdd {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[91003abc-2b31-4a55-883d-a61c91819d2c]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.088s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[df68a588-e737-47ef-a575-08539f3fad01]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] SCSI volumes sdd have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1424207b-9f9e-4e3d-a22f-f8952a5d0386]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e747e5-5fa5-44cc-a255-15de7b91a3ea]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9, portal: 172.16.0.220,3260]
Aug 16 22:32:20 user nova-compute[72773]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9, portal: 172.16.0.220,3260] successful.
Aug 16 22:32:20 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6b5404f-d2ef-4c34-a1fa-7c617b5f14d9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ac8e48-6ff9-4b54-9346-cddf5634d999]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.413s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] <== disconnect_volume: return (416ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egwoqQcJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:32:20 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[40709df2-8e5d-44a1-b801-5fd84d5e4585]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe582d92-b5c5-4366-963c-67a9cab9b1f5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:32:20 user nova-compute[72773]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d (non-flash)
Aug 16 22:32:20 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:32:20 user nova-compute[72773]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d (non-flash)
Aug 16 22:32:20 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef802fd3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d'): ({'sde'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Removing single pathed devices sde {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa135c1-b5a4-4ed6-a926-ca0b25b02aea]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5fa9db-d00c-4287-854a-a5a1187cd90a]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Flushing IO for device /dev/sde {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6b2b92-ec05-4d26-9ecd-3ad561b9e778]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bd94d2-4c50-406d-96e4-b5c71ac54764]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] SCSI volumes sde have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[128b33a7-adef-4101-b83d-c8f89cb9645f]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:32:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4430f36-6703-4c30-bb85-e6b813e369dd]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d, portal: 172.16.0.220,3260]
Aug 16 22:32:21 user nova-compute[72773]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d, portal: 172.16.0.220,3260] successful.
Aug 16 22:32:21 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:32:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c0936b-a479-498d-bd29-84f5509e841d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5436ef18-1087-4d96-9dbb-e595e0e7f9bc]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:32:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:32:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] <== disconnect_volume: return (337ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:32:21 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:32:21 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Deleting instance files /opt/stack/data/nova/instances/5aa5adad-599d-424f-bbfc-7d87ead31b57_del
Aug 16 22:32:21 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Deletion of /opt/stack/data/nova/instances/5aa5adad-599d-424f-bbfc-7d87ead31b57_del complete
Aug 16 22:32:21 user nova-compute[72773]: INFO nova.compute.manager [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Took 4.00 seconds to destroy the instance on the hypervisor.
Aug 16 22:32:21 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:32:21 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:32:21 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:32:22 user nova-compute[72773]: DEBUG nova.compute.manager [req-17f715e0-7701-490a-8cb9-dc831a0ac16c req-83e14f45-0279-4b3b-91c1-1754aae531c3 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-plugged-44f58154-ceae-45ef-a169-0681e0e9a3fb {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-17f715e0-7701-490a-8cb9-dc831a0ac16c req-83e14f45-0279-4b3b-91c1-1754aae531c3 service nova] Acquiring lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-17f715e0-7701-490a-8cb9-dc831a0ac16c req-83e14f45-0279-4b3b-91c1-1754aae531c3 service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-17f715e0-7701-490a-8cb9-dc831a0ac16c req-83e14f45-0279-4b3b-91c1-1754aae531c3 service nova] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:22 user nova-compute[72773]: DEBUG nova.compute.manager [req-17f715e0-7701-490a-8cb9-dc831a0ac16c req-83e14f45-0279-4b3b-91c1-1754aae531c3 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] No waiting events found dispatching network-vif-plugged-44f58154-ceae-45ef-a169-0681e0e9a3fb {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:32:22 user nova-compute[72773]: WARNING nova.compute.manager [req-17f715e0-7701-490a-8cb9-dc831a0ac16c req-83e14f45-0279-4b3b-91c1-1754aae531c3 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received unexpected event network-vif-plugged-44f58154-ceae-45ef-a169-0681e0e9a3fb for instance with vm_state active and task_state deleting.
Aug 16 22:32:24 user nova-compute[72773]: DEBUG nova.compute.manager [req-28c3d693-e746-41f9-a6e0-a2c2d42bdbcf req-331cc4cb-5d0a-4d79-b52b-2196aa2e88ac service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-deleted-2581ab2b-5a7c-4c9a-8f59-f3c5a7228044 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:24 user nova-compute[72773]: INFO nova.compute.manager [req-28c3d693-e746-41f9-a6e0-a2c2d42bdbcf req-331cc4cb-5d0a-4d79-b52b-2196aa2e88ac service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Neutron deleted interface 2581ab2b-5a7c-4c9a-8f59-f3c5a7228044; detaching it from the instance and deleting it from the info cache
Aug 16 22:32:24 user nova-compute[72773]: DEBUG nova.network.neutron [req-28c3d693-e746-41f9-a6e0-a2c2d42bdbcf req-331cc4cb-5d0a-4d79-b52b-2196aa2e88ac service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Updating instance_info_cache with network_info: [{"id": "b47506d5-cd81-498a-8f7b-d735d0601f49", "address": "fa:16:3e:14:c3:e5", "network": {"id": "8b3d0165-9b35-42e8-bb94-f9cb7d76409d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1320393408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47506d5-cd", "ovs_interfaceid": "b47506d5-cd81-498a-8f7b-d735d0601f49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4188d812-137b-448e-acb1-42dea2d8eb91", "address": "fa:16:3e:0f:fc:e8", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4188d812-13", "ovs_interfaceid": "4188d812-137b-448e-acb1-42dea2d8eb91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2dc74ea7-4f01-465f-8e7a-f5b4299ace47", "address": "fa:16:3e:cc:b0:44", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc74ea7-4f", "ovs_interfaceid": "2dc74ea7-4f01-465f-8e7a-f5b4299ace47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "464fb40c-7053-464f-b788-d285f283fb56", "address": "fa:16:3e:ce:aa:1f", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap464fb40c-70", "ovs_interfaceid": "464fb40c-7053-464f-b788-d285f283fb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44f58154-ceae-45ef-a169-0681e0e9a3fb", "address": "fa:16:3e:95:7a:63", "network": {"id": "a2682c6d-c949-41e3-8efe-546921aea554", "bridge": "br-int", "label": "tempest-device-tagging-net2-870198650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44f58154-ce", "ovs_interfaceid": "44f58154-ceae-45ef-a169-0681e0e9a3fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0230e8bd-c876-4793-96f6-9ccc72deaa73", "address": "fa:16:3e:9d:92:42", "network": {"id": "a2682c6d-c949-41e3-8efe-546921aea554", "bridge": "br-int", "label": "tempest-device-tagging-net2-870198650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0230e8bd-c8", "ovs_interfaceid": "0230e8bd-c876-4793-96f6-9ccc72deaa73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:32:24 user nova-compute[72773]: DEBUG nova.compute.manager [req-28c3d693-e746-41f9-a6e0-a2c2d42bdbcf req-331cc4cb-5d0a-4d79-b52b-2196aa2e88ac service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Detach interface failed, port_id=2581ab2b-5a7c-4c9a-8f59-f3c5a7228044, reason: Instance 5aa5adad-599d-424f-bbfc-7d87ead31b57 could not be found. {{(pid=72773) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 22:32:24 user nova-compute[72773]: DEBUG nova.compute.manager [req-28c3d693-e746-41f9-a6e0-a2c2d42bdbcf req-331cc4cb-5d0a-4d79-b52b-2196aa2e88ac service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-deleted-464fb40c-7053-464f-b788-d285f283fb56 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:24 user nova-compute[72773]: INFO nova.compute.manager [req-28c3d693-e746-41f9-a6e0-a2c2d42bdbcf req-331cc4cb-5d0a-4d79-b52b-2196aa2e88ac service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Neutron deleted interface 464fb40c-7053-464f-b788-d285f283fb56; detaching it from the instance and deleting it from the info cache
Aug 16 22:32:24 user nova-compute[72773]: DEBUG nova.network.neutron [req-28c3d693-e746-41f9-a6e0-a2c2d42bdbcf req-331cc4cb-5d0a-4d79-b52b-2196aa2e88ac service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Updating instance_info_cache with network_info: [{"id": "b47506d5-cd81-498a-8f7b-d735d0601f49", "address": "fa:16:3e:14:c3:e5", "network": {"id": "8b3d0165-9b35-42e8-bb94-f9cb7d76409d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1320393408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47506d5-cd", "ovs_interfaceid": "b47506d5-cd81-498a-8f7b-d735d0601f49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4188d812-137b-448e-acb1-42dea2d8eb91", "address": "fa:16:3e:0f:fc:e8", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4188d812-13", "ovs_interfaceid": "4188d812-137b-448e-acb1-42dea2d8eb91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2dc74ea7-4f01-465f-8e7a-f5b4299ace47", "address": "fa:16:3e:cc:b0:44", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc74ea7-4f", "ovs_interfaceid": "2dc74ea7-4f01-465f-8e7a-f5b4299ace47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "44f58154-ceae-45ef-a169-0681e0e9a3fb", "address": "fa:16:3e:95:7a:63", "network": {"id": "a2682c6d-c949-41e3-8efe-546921aea554", "bridge": "br-int", "label": "tempest-device-tagging-net2-870198650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44f58154-ce", "ovs_interfaceid": "44f58154-ceae-45ef-a169-0681e0e9a3fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0230e8bd-c876-4793-96f6-9ccc72deaa73", "address": "fa:16:3e:9d:92:42", "network": {"id": "a2682c6d-c949-41e3-8efe-546921aea554", "bridge": "br-int", "label": "tempest-device-tagging-net2-870198650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0230e8bd-c8", "ovs_interfaceid": "0230e8bd-c876-4793-96f6-9ccc72deaa73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:32:24 user nova-compute[72773]: DEBUG nova.compute.manager [req-28c3d693-e746-41f9-a6e0-a2c2d42bdbcf req-331cc4cb-5d0a-4d79-b52b-2196aa2e88ac service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Detach interface failed, port_id=464fb40c-7053-464f-b788-d285f283fb56, reason: Instance 5aa5adad-599d-424f-bbfc-7d87ead31b57 could not be found. {{(pid=72773) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 22:32:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pleItBZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:32:25 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:32:25 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:32:25 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:32:25 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:32:25 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bae803-99ca-4cbc-9e67-f749f7d34ffb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:32:25 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b3af5b-29e6-49c3-b2a4-27c786796920]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8] added
Aug 16 22:32:25 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c7686e-314f-43ea-adf3-d7ef04c8edb8]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a226b8-31bd-404b-90ec-5b4856f280d3]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pleItBZC {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pleItBZC" returned: 0 in 0.027s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a221010b-1584-4e49-be7d-05dbf4662e4d]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pleItBZC'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbc5633-583d-4f60-bb3d-38ba27e38294]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b43a705-06cc-4bbf-9b9c-18017fa33371]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:32:25 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:32:25 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[49eb3ab1-f094-4870-93cf-1139233fb50d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8, portal: 172.16.0.220,3260]
Aug 16 22:32:25 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8, portal: 172.16.0.220,3260] successful.
Aug 16 22:32:25 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.057s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b3b75b-80af-4d46-be9e-bc530ed5d959]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5449abc2-ac43-4dba-881b-f21b95852324]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:32:25 user nova-compute[72773]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8 (non-flash)
Aug 16 22:32:25 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:32:25 user nova-compute[72773]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8 (non-flash)
Aug 16 22:32:25 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.030s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b383055-1cd2-4e8f-981a-c1cdc01e8665]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pleItBZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "e9259e07-3d7f-4169-96fc-b080b4b9ce6a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "e9259e07-3d7f-4169-96fc-b080b4b9ce6a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG nova.compute.manager [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:25 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:32:25 user nova-compute[72773]: INFO nova.compute.claims [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Claim successful on node user
Aug 16 22:32:26 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:32:26 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:32:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.528s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:26 user nova-compute[72773]: DEBUG nova.compute.manager [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:32:26 user nova-compute[72773]: DEBUG nova.compute.manager [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:32:26 user nova-compute[72773]: DEBUG nova.network.neutron [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:32:26 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:32:26 user nova-compute[72773]: DEBUG nova.compute.manager [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:32:26 user nova-compute[72773]: DEBUG nova.compute.manager [req-d7351f13-fea9-4f8f-a026-10b769a189d4 req-e54a735b-516e-4451-a545-afe274957c39 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-deleted-b47506d5-cd81-498a-8f7b-d735d0601f49 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:26 user nova-compute[72773]: INFO nova.compute.manager [req-d7351f13-fea9-4f8f-a026-10b769a189d4 req-e54a735b-516e-4451-a545-afe274957c39 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Neutron deleted interface b47506d5-cd81-498a-8f7b-d735d0601f49; detaching it from the instance and deleting it from the info cache
Aug 16 22:32:26 user nova-compute[72773]: DEBUG nova.network.neutron [req-d7351f13-fea9-4f8f-a026-10b769a189d4 req-e54a735b-516e-4451-a545-afe274957c39 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Updating instance_info_cache with network_info: [{"id": "4188d812-137b-448e-acb1-42dea2d8eb91", "address": "fa:16:3e:0f:fc:e8", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4188d812-13", "ovs_interfaceid": "4188d812-137b-448e-acb1-42dea2d8eb91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2dc74ea7-4f01-465f-8e7a-f5b4299ace47", "address": "fa:16:3e:cc:b0:44", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc74ea7-4f", "ovs_interfaceid": "2dc74ea7-4f01-465f-8e7a-f5b4299ace47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "44f58154-ceae-45ef-a169-0681e0e9a3fb", "address": "fa:16:3e:95:7a:63", "network": {"id": "a2682c6d-c949-41e3-8efe-546921aea554", "bridge": "br-int", "label": "tempest-device-tagging-net2-870198650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44f58154-ce", "ovs_interfaceid": "44f58154-ceae-45ef-a169-0681e0e9a3fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0230e8bd-c876-4793-96f6-9ccc72deaa73", "address": "fa:16:3e:9d:92:42", "network": {"id": "a2682c6d-c949-41e3-8efe-546921aea554", "bridge": "br-int", "label": "tempest-device-tagging-net2-870198650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0230e8bd-c8", "ovs_interfaceid": "0230e8bd-c876-4793-96f6-9ccc72deaa73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:32:26 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:32:26 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '26565616231346433', 'path': '/dev/sdc'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:32:26 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565616231346433', 'path': '/dev/sdc'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:32:26 user nova-compute[72773]: DEBUG nova.compute.manager [req-d7351f13-fea9-4f8f-a026-10b769a189d4 req-e54a735b-516e-4451-a545-afe274957c39 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Detach interface failed, port_id=b47506d5-cd81-498a-8f7b-d735d0601f49, reason: Instance 5aa5adad-599d-424f-bbfc-7d87ead31b57 could not be found. {{(pid=72773) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 22:32:26 user nova-compute[72773]: DEBUG nova.compute.manager [req-d7351f13-fea9-4f8f-a026-10b769a189d4 req-e54a735b-516e-4451-a545-afe274957c39 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-deleted-44f58154-ceae-45ef-a169-0681e0e9a3fb {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:26 user nova-compute[72773]: INFO nova.compute.manager [req-d7351f13-fea9-4f8f-a026-10b769a189d4 req-e54a735b-516e-4451-a545-afe274957c39 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Neutron deleted interface 44f58154-ceae-45ef-a169-0681e0e9a3fb; detaching it from the instance and deleting it from the info cache
Aug 16 22:32:26 user nova-compute[72773]: DEBUG nova.network.neutron [req-d7351f13-fea9-4f8f-a026-10b769a189d4 req-e54a735b-516e-4451-a545-afe274957c39 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Updating instance_info_cache with network_info: [{"id": "4188d812-137b-448e-acb1-42dea2d8eb91", "address": "fa:16:3e:0f:fc:e8", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4188d812-13", "ovs_interfaceid": "4188d812-137b-448e-acb1-42dea2d8eb91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2dc74ea7-4f01-465f-8e7a-f5b4299ace47", "address": "fa:16:3e:cc:b0:44", "network": {"id": "2b2b1125-d184-44d3-9cfd-0b0808ce15f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-885887524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc74ea7-4f", "ovs_interfaceid": "2dc74ea7-4f01-465f-8e7a-f5b4299ace47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0230e8bd-c876-4793-96f6-9ccc72deaa73", "address": "fa:16:3e:9d:92:42", "network": {"id": "a2682c6d-c949-41e3-8efe-546921aea554", "bridge": "br-int", "label": "tempest-device-tagging-net2-870198650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3a13289351c4eb58e8a2b56e83763fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0230e8bd-c8", "ovs_interfaceid": "0230e8bd-c876-4793-96f6-9ccc72deaa73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:32:26 user nova-compute[72773]: DEBUG nova.policy [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3b873f599fc4a2686c154d856bd5f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49739a140d40508ea307eedceb9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:32:26 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:32:26 user nova-compute[72773]: DEBUG nova.objects.instance [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lazy-loading 'flavor' on Instance uuid 384d4037-bac4-423f-bc7a-e64fe14d7f77 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:32:26 user nova-compute[72773]: DEBUG nova.compute.manager [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:32:26 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:32:26 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Creating image(s)
Aug 16 22:32:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "/opt/stack/data/nova/instances/e9259e07-3d7f-4169-96fc-b080b4b9ce6a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "/opt/stack/data/nova/instances/e9259e07-3d7f-4169-96fc-b080b4b9ce6a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "/opt/stack/data/nova/instances/e9259e07-3d7f-4169-96fc-b080b4b9ce6a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:26 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Took 5.45 seconds to deallocate network for instance.
Aug 16 22:32:26 user nova-compute[72773]: DEBUG nova.compute.manager [req-d7351f13-fea9-4f8f-a026-10b769a189d4 req-e54a735b-516e-4451-a545-afe274957c39 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Detach interface failed, port_id=44f58154-ceae-45ef-a169-0681e0e9a3fb, reason: Instance 5aa5adad-599d-424f-bbfc-7d87ead31b57 could not be found. {{(pid=72773) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 22:32:26 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 22:32:26 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:32:26 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 22:32:26 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:32:26 user nova-compute[72773]:   <serial>fc503cc7-6ebc-4b0a-ba76-53747ca3ded8</serial>
Aug 16 22:32:26 user nova-compute[72773]: </disk>
Aug 16 22:32:26 user nova-compute[72773]:  {{(pid=72773) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 22:32:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.263s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.193s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/e9259e07-3d7f-4169-96fc-b080b4b9ce6a/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/e9259e07-3d7f-4169-96fc-b080b4b9ce6a/disk 1073741824" returned: 0 in 0.065s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:27 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:32:27 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] No BDM found with device name hda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:32:27 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] No VIF found with MAC fa:16:3e:19:aa:35, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:32:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.290s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:27 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e9259e07-3d7f-4169-96fc-b080b4b9ce6a/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:32:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9259e07-3d7f-4169-96fc-b080b4b9ce6a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8df689b2-5c12-45da-b00f-b3b4876772b5 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lock "384d4037-bac4-423f-bc7a-e64fe14d7f77" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.608s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:27 user nova-compute[72773]: DEBUG nova.network.neutron [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Successfully created port: 3dd11c55-5b19-4376-954d-bb0339a28f07 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:32:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9259e07-3d7f-4169-96fc-b080b4b9ce6a/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:27 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Cannot resize image /opt/stack/data/nova/instances/e9259e07-3d7f-4169-96fc-b080b4b9ce6a/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:32:27 user nova-compute[72773]: DEBUG nova.objects.instance [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lazy-loading 'migration_context' on Instance uuid e9259e07-3d7f-4169-96fc-b080b4b9ce6a {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:32:27 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:32:27 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Ensure instance console log exists: /opt/stack/data/nova/instances/e9259e07-3d7f-4169-96fc-b080b4b9ce6a/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:32:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:28 user nova-compute[72773]: DEBUG nova.network.neutron [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Successfully updated port: 3dd11c55-5b19-4376-954d-bb0339a28f07 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:32:28 user nova-compute[72773]: DEBUG nova.compute.manager [req-64777b07-ba3d-4883-9573-43945cc3b332 req-6e6409a0-cb2c-4493-8b35-8fb93e344ad6 service nova] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Received event network-vif-deleted-0230e8bd-c876-4793-96f6-9ccc72deaa73 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "refresh_cache-e9259e07-3d7f-4169-96fc-b080b4b9ce6a" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:32:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquired lock "refresh_cache-e9259e07-3d7f-4169-96fc-b080b4b9ce6a" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:32:28 user nova-compute[72773]: DEBUG nova.network.neutron [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:32:28 user nova-compute[72773]: DEBUG nova.compute.manager [req-d6c0cdf0-93c4-4ade-b3ce-5f8065b53070 req-34156448-7061-49d3-939c-e5a3966c6bac service nova] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Received event network-changed-3dd11c55-5b19-4376-954d-bb0339a28f07 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:28 user nova-compute[72773]: DEBUG nova.compute.manager [req-d6c0cdf0-93c4-4ade-b3ce-5f8065b53070 req-34156448-7061-49d3-939c-e5a3966c6bac service nova] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Refreshing instance network info cache due to event network-changed-3dd11c55-5b19-4376-954d-bb0339a28f07. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:32:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d6c0cdf0-93c4-4ade-b3ce-5f8065b53070 req-34156448-7061-49d3-939c-e5a3966c6bac service nova] Acquiring lock "refresh_cache-e9259e07-3d7f-4169-96fc-b080b4b9ce6a" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:32:28 user nova-compute[72773]: DEBUG nova.network.neutron [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:32:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "63644e8f-95d4-43a7-a824-8845dd073423" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "63644e8f-95d4-43a7-a824-8845dd073423" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:28 user nova-compute[72773]: DEBUG nova.compute.manager [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:32:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:32:28 user nova-compute[72773]: INFO nova.compute.claims [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Claim successful on node user
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.network.neutron [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Updating instance_info_cache with network_info: [{"id": "3dd11c55-5b19-4376-954d-bb0339a28f07", "address": "fa:16:3e:92:99:c6", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd11c55-5b", "ovs_interfaceid": "3dd11c55-5b19-4376-954d-bb0339a28f07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Releasing lock "refresh_cache-e9259e07-3d7f-4169-96fc-b080b4b9ce6a" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Instance network_info: |[{"id": "3dd11c55-5b19-4376-954d-bb0339a28f07", "address": "fa:16:3e:92:99:c6", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd11c55-5b", "ovs_interfaceid": "3dd11c55-5b19-4376-954d-bb0339a28f07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d6c0cdf0-93c4-4ade-b3ce-5f8065b53070 req-34156448-7061-49d3-939c-e5a3966c6bac service nova] Acquired lock "refresh_cache-e9259e07-3d7f-4169-96fc-b080b4b9ce6a" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.network.neutron [req-d6c0cdf0-93c4-4ade-b3ce-5f8065b53070 req-34156448-7061-49d3-939c-e5a3966c6bac service nova] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Refreshing network info cache for port 3dd11c55-5b19-4376-954d-bb0339a28f07 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Start _get_guest_xml network_info=[{"id": "3dd11c55-5b19-4376-954d-bb0339a28f07", "address": "fa:16:3e:92:99:c6", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd11c55-5b", "ovs_interfaceid": "3dd11c55-5b19-4376-954d-bb0339a28f07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:32:29 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:32:29 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:32:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2076296167',display_name='tempest-AttachVolumeNegativeTest-server-2076296167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2076296167',id=24,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwF1i3r+Je4gjVxmd/yRAVvJnibw7m7REMhsm/9+fW4rz/TG2TRVgLY0243IfvNGQyFthB5HO+2no0OwhZzJYte1TuPJ47cf6J12LJNPVYyv9EeC29eVfkFLPjQKdp2zA==',key_name='tempest-keypair-431434493',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc49739a140d40508ea307eedceb9aaa',ramdisk_id='',reservation_id='r-dbt02mqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-801754299',owner_user_name='tempest-AttachVolumeNegativeTest-801754299-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:32:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3b873f599fc4a2686c154d856bd5f06',uuid=e9259e07-3d7f-4169-96fc-b080b4b9ce6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3dd11c55-5b19-4376-954d-bb0339a28f07", "address": "fa:16:3e:92:99:c6", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd11c55-5b", "ovs_interfaceid": "3dd11c55-5b19-4376-954d-bb0339a28f07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Converting VIF {"id": "3dd11c55-5b19-4376-954d-bb0339a28f07", "address": "fa:16:3e:92:99:c6", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd11c55-5b", "ovs_interfaceid": "3dd11c55-5b19-4376-954d-bb0339a28f07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:99:c6,bridge_name='br-int',has_traffic_filtering=True,id=3dd11c55-5b19-4376-954d-bb0339a28f07,network=Network(e0974c13-ec74-4a35-95b4-afae254c04a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd11c55-5b') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.objects.instance [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lazy-loading 'pci_devices' on Instance uuid e9259e07-3d7f-4169-96fc-b080b4b9ce6a {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:32:29 user nova-compute[72773]:   <uuid>e9259e07-3d7f-4169-96fc-b080b4b9ce6a</uuid>
Aug 16 22:32:29 user nova-compute[72773]:   <name>instance-00000018</name>
Aug 16 22:32:29 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:32:29 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:32:29 user nova-compute[72773]:   <metadata>
Aug 16 22:32:29 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:32:29 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:32:29 user nova-compute[72773]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2076296167</nova:name>
Aug 16 22:32:29 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:32:29</nova:creationTime>
Aug 16 22:32:29 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:32:29 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:32:29 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:32:29 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:32:29 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:32:29 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:32:29 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:32:29 user nova-compute[72773]:       <nova:owner>
Aug 16 22:32:29 user nova-compute[72773]:         <nova:user uuid="d3b873f599fc4a2686c154d856bd5f06">tempest-AttachVolumeNegativeTest-801754299-project-member</nova:user>
Aug 16 22:32:29 user nova-compute[72773]:         <nova:project uuid="dc49739a140d40508ea307eedceb9aaa">tempest-AttachVolumeNegativeTest-801754299</nova:project>
Aug 16 22:32:29 user nova-compute[72773]:       </nova:owner>
Aug 16 22:32:29 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:32:29 user nova-compute[72773]:       <nova:ports>
Aug 16 22:32:29 user nova-compute[72773]:         <nova:port uuid="3dd11c55-5b19-4376-954d-bb0339a28f07">
Aug 16 22:32:29 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 22:32:29 user nova-compute[72773]:         </nova:port>
Aug 16 22:32:29 user nova-compute[72773]:       </nova:ports>
Aug 16 22:32:29 user nova-compute[72773]:     </nova:instance>
Aug 16 22:32:29 user nova-compute[72773]:   </metadata>
Aug 16 22:32:29 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:32:29 user nova-compute[72773]:     <system>
Aug 16 22:32:29 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:32:29 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:32:29 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:32:29 user nova-compute[72773]:       <entry name="serial">e9259e07-3d7f-4169-96fc-b080b4b9ce6a</entry>
Aug 16 22:32:29 user nova-compute[72773]:       <entry name="uuid">e9259e07-3d7f-4169-96fc-b080b4b9ce6a</entry>
Aug 16 22:32:29 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:32:29 user nova-compute[72773]:     </system>
Aug 16 22:32:29 user nova-compute[72773]:   </sysinfo>
Aug 16 22:32:29 user nova-compute[72773]:   <os>
Aug 16 22:32:29 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:32:29 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:32:29 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:32:29 user nova-compute[72773]:   </os>
Aug 16 22:32:29 user nova-compute[72773]:   <features>
Aug 16 22:32:29 user nova-compute[72773]:     <acpi/>
Aug 16 22:32:29 user nova-compute[72773]:     <apic/>
Aug 16 22:32:29 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:32:29 user nova-compute[72773]:   </features>
Aug 16 22:32:29 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:32:29 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:32:29 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:32:29 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:32:29 user nova-compute[72773]:   </clock>
Aug 16 22:32:29 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:32:29 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:32:29 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:32:29 user nova-compute[72773]:   </cpu>
Aug 16 22:32:29 user nova-compute[72773]:   <devices>
Aug 16 22:32:29 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:32:29 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:32:29 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/e9259e07-3d7f-4169-96fc-b080b4b9ce6a/disk"/>
Aug 16 22:32:29 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:32:29 user nova-compute[72773]:     </disk>
Aug 16 22:32:29 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:32:29 user nova-compute[72773]:       <mac address="fa:16:3e:92:99:c6"/>
Aug 16 22:32:29 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:32:29 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:32:29 user nova-compute[72773]:       <target dev="tap3dd11c55-5b"/>
Aug 16 22:32:29 user nova-compute[72773]:     </interface>
Aug 16 22:32:29 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:32:29 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/e9259e07-3d7f-4169-96fc-b080b4b9ce6a/console.log" append="off"/>
Aug 16 22:32:29 user nova-compute[72773]:     </serial>
Aug 16 22:32:29 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:32:29 user nova-compute[72773]:     <video>
Aug 16 22:32:29 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:32:29 user nova-compute[72773]:     </video>
Aug 16 22:32:29 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:32:29 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:32:29 user nova-compute[72773]:     </rng>
Aug 16 22:32:29 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:32:29 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:32:29 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:32:29 user nova-compute[72773]:     </memballoon>
Aug 16 22:32:29 user nova-compute[72773]:   </devices>
Aug 16 22:32:29 user nova-compute[72773]: </domain>
Aug 16 22:32:29 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:32:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2076296167',display_name='tempest-AttachVolumeNegativeTest-server-2076296167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2076296167',id=24,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwF1i3r+Je4gjVxmd/yRAVvJnibw7m7REMhsm/9+fW4rz/TG2TRVgLY0243IfvNGQyFthB5HO+2no0OwhZzJYte1TuPJ47cf6J12LJNPVYyv9EeC29eVfkFLPjQKdp2zA==',key_name='tempest-keypair-431434493',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc49739a140d40508ea307eedceb9aaa',ramdisk_id='',reservation_id='r-dbt02mqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-801754299',owner_user_name='tempest-AttachVolumeNegativeTest-801754299-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:32:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3b873f599fc4a2686c154d856bd5f06',uuid=e9259e07-3d7f-4169-96fc-b080b4b9ce6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3dd11c55-5b19-4376-954d-bb0339a28f07", "address": "fa:16:3e:92:99:c6", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd11c55-5b", "ovs_interfaceid": "3dd11c55-5b19-4376-954d-bb0339a28f07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Converting VIF {"id": "3dd11c55-5b19-4376-954d-bb0339a28f07", "address": "fa:16:3e:92:99:c6", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd11c55-5b", "ovs_interfaceid": "3dd11c55-5b19-4376-954d-bb0339a28f07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:99:c6,bridge_name='br-int',has_traffic_filtering=True,id=3dd11c55-5b19-4376-954d-bb0339a28f07,network=Network(e0974c13-ec74-4a35-95b4-afae254c04a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd11c55-5b') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG os_vif [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:99:c6,bridge_name='br-int',has_traffic_filtering=True,id=3dd11c55-5b19-4376-954d-bb0339a28f07,network=Network(e0974c13-ec74-4a35-95b4-afae254c04a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd11c55-5b') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3dd11c55-5b, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3dd11c55-5b, col_values=(('external_ids', {'iface-id': '3dd11c55-5b19-4376-954d-bb0339a28f07', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:99:c6', 'vm-uuid': 'e9259e07-3d7f-4169-96fc-b080b4b9ce6a'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:29 user nova-compute[72773]: INFO os_vif [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:99:c6,bridge_name='br-int',has_traffic_filtering=True,id=3dd11c55-5b19-4376-954d-bb0339a28f07,network=Network(e0974c13-ec74-4a35-95b4-afae254c04a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd11c55-5b')
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] No VIF found with MAC fa:16:3e:92:99:c6, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-743559f0-f040-4517-88a9-39581c15e81a tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Acquiring lock "384d4037-bac4-423f-bc7a-e64fe14d7f77" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-743559f0-f040-4517-88a9-39581c15e81a tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lock "384d4037-bac4-423f-bc7a-e64fe14d7f77" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:29 user nova-compute[72773]: INFO nova.compute.manager [None req-743559f0-f040-4517-88a9-39581c15e81a tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Detaching volume fc503cc7-6ebc-4b0a-ba76-53747ca3ded8
Aug 16 22:32:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.830s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:32:29 user nova-compute[72773]: INFO nova.compute.manager [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Took 3.10 seconds to detach 3 volumes for instance.
Aug 16 22:32:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:29 user nova-compute[72773]: INFO nova.virt.block_device [None req-743559f0-f040-4517-88a9-39581c15e81a tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Attempting to driver detach volume fc503cc7-6ebc-4b0a-ba76-53747ca3ded8 from mountpoint /dev/vdb
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.network.neutron [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:32:29 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-743559f0-f040-4517-88a9-39581c15e81a tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Attempting to detach device vdb from instance 384d4037-bac4-423f-bc7a-e64fe14d7f77 from the persistent domain config. {{(pid=72773) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-743559f0-f040-4517-88a9-39581c15e81a tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:32:29 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:32:29 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 22:32:29 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:32:29 user nova-compute[72773]:   <serial>fc503cc7-6ebc-4b0a-ba76-53747ca3ded8</serial>
Aug 16 22:32:29 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 22:32:29 user nova-compute[72773]: </disk>
Aug 16 22:32:29 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:32:29 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-743559f0-f040-4517-88a9-39581c15e81a tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Successfully detached device vdb from instance 384d4037-bac4-423f-bc7a-e64fe14d7f77 from the persistent domain config.
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-743559f0-f040-4517-88a9-39581c15e81a tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 384d4037-bac4-423f-bc7a-e64fe14d7f77 from the live domain config. {{(pid=72773) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-743559f0-f040-4517-88a9-39581c15e81a tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:32:29 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:32:29 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 22:32:29 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:32:29 user nova-compute[72773]:   <serial>fc503cc7-6ebc-4b0a-ba76-53747ca3ded8</serial>
Aug 16 22:32:29 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 22:32:29 user nova-compute[72773]: </disk>
Aug 16 22:32:29 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.policy [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '71cd9d1142ec45e792219e8b789cf2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ef6a37d79341d7a94e5b314efddab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:32:29 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Creating image(s)
Aug 16 22:32:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "/opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "/opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "/opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG nova.network.neutron [req-d6c0cdf0-93c4-4ade-b3ce-5f8065b53070 req-34156448-7061-49d3-939c-e5a3966c6bac service nova] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Updated VIF entry in instance network info cache for port 3dd11c55-5b19-4376-954d-bb0339a28f07. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG nova.network.neutron [req-d6c0cdf0-93c4-4ade-b3ce-5f8065b53070 req-34156448-7061-49d3-939c-e5a3966c6bac service nova] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Updating instance_info_cache with network_info: [{"id": "3dd11c55-5b19-4376-954d-bb0339a28f07", "address": "fa:16:3e:92:99:c6", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd11c55-5b", "ovs_interfaceid": "3dd11c55-5b19-4376-954d-bb0339a28f07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.223s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d6c0cdf0-93c4-4ade-b3ce-5f8065b53070 req-34156448-7061-49d3-939c-e5a3966c6bac service nova] Releasing lock "refresh_cache-e9259e07-3d7f-4169-96fc-b080b4b9ce6a" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.173s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.630s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk 1073741824" returned: 0 in 0.054s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:30 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Deleted allocations for instance 5aa5adad-599d-424f-bbfc-7d87ead31b57
Aug 16 22:32:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Received event <DeviceRemovedEvent: 1692225150.578532, 384d4037-bac4-423f-bc7a-e64fe14d7f77 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72773) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-743559f0-f040-4517-88a9-39581c15e81a tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 384d4037-bac4-423f-bc7a-e64fe14d7f77 {{(pid=72773) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 22:32:30 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-743559f0-f040-4517-88a9-39581c15e81a tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Successfully detached device vdb from instance 384d4037-bac4-423f-bc7a-e64fe14d7f77 from the live domain config.
Aug 16 22:32:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-743559f0-f040-4517-88a9-39581c15e81a tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-743559f0-f040-4517-88a9-39581c15e81a tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pleItBZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:32:30 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-743559f0-f040-4517-88a9-39581c15e81a tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:32:30 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-743559f0-f040-4517-88a9-39581c15e81a tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-743559f0-f040-4517-88a9-39581c15e81a tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-743559f0-f040-4517-88a9-39581c15e81a tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1385dc94-d684-44fc-ad20-66a60a96117f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d384bee6-3539-4d1c-b828-0ef3b2979a6c tempest-TaggedBootDevicesTest_v242-712587175 tempest-TaggedBootDevicesTest_v242-712587175-project-member] Lock "5aa5adad-599d-424f-bbfc-7d87ead31b57" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.499s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.187s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Checking if we can resize image /opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd6f701-853b-4393-b799-91973b5a16d1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-743559f0-f040-4517-88a9-39581c15e81a tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:32:30 user nova-compute[72773]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8 (non-flash)
Aug 16 22:32:30 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-743559f0-f040-4517-88a9-39581c15e81a tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:32:30 user nova-compute[72773]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8 (non-flash)
Aug 16 22:32:30 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-743559f0-f040-4517-88a9-39581c15e81a tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef5c4075b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8'): ({'sdc'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-743559f0-f040-4517-88a9-39581c15e81a tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Removing single pathed devices sdc {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG nova.network.neutron [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Successfully created port: eae4e0ec-3105-463d-9c92-0e2f63192bb6 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec649a8-c9a6-4de7-9a04-32103d8900a3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.030s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a8a6e1-4961-40d8-9e56-f228f6aa8fd2]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-743559f0-f040-4517-88a9-39581c15e81a tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Flushing IO for device /dev/sdc {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1f62ad-0df3-47c3-a802-156df9457f28]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-743559f0-f040-4517-88a9-39581c15e81a tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Cannot resize image /opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG nova.objects.instance [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lazy-loading 'migration_context' on Instance uuid 63644e8f-95d4-43a7-a824-8845dd073423 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0d1910-18f1-4796-b806-af5578133289]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Ensure instance console log exists: /opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-743559f0-f040-4517-88a9-39581c15e81a tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-743559f0-f040-4517-88a9-39581c15e81a tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-743559f0-f040-4517-88a9-39581c15e81a tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba4e3d9-ddeb-4153-a08e-000837be4e8c]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-743559f0-f040-4517-88a9-39581c15e81a tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:30 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3d51a7-5456-4020-a76c-072c07f4df0f]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-743559f0-f040-4517-88a9-39581c15e81a tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8, portal: 172.16.0.220,3260]
Aug 16 22:32:31 user nova-compute[72773]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8, portal: 172.16.0.220,3260] successful.
Aug 16 22:32:31 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:32:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc503cc7-6ebc-4b0a-ba76-53747ca3ded8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:31 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec6cbf3-5aae-4c51-a604-eb617659a508]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-743559f0-f040-4517-88a9-39581c15e81a tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:32:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-743559f0-f040-4517-88a9-39581c15e81a tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.440s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:32:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-743559f0-f040-4517-88a9-39581c15e81a tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] <== disconnect_volume: return (442ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:32:31 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-743559f0-f040-4517-88a9-39581c15e81a tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:32:31 user nova-compute[72773]: DEBUG nova.compute.manager [req-84e5e176-e047-4c58-b92e-e048025cf149 req-c6f1061d-c5dd-44b8-9143-f7063422983d service nova] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Received event network-vif-plugged-3dd11c55-5b19-4376-954d-bb0339a28f07 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-84e5e176-e047-4c58-b92e-e048025cf149 req-c6f1061d-c5dd-44b8-9143-f7063422983d service nova] Acquiring lock "e9259e07-3d7f-4169-96fc-b080b4b9ce6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-84e5e176-e047-4c58-b92e-e048025cf149 req-c6f1061d-c5dd-44b8-9143-f7063422983d service nova] Lock "e9259e07-3d7f-4169-96fc-b080b4b9ce6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-84e5e176-e047-4c58-b92e-e048025cf149 req-c6f1061d-c5dd-44b8-9143-f7063422983d service nova] Lock "e9259e07-3d7f-4169-96fc-b080b4b9ce6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:31 user nova-compute[72773]: DEBUG nova.compute.manager [req-84e5e176-e047-4c58-b92e-e048025cf149 req-c6f1061d-c5dd-44b8-9143-f7063422983d service nova] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] No waiting events found dispatching network-vif-plugged-3dd11c55-5b19-4376-954d-bb0339a28f07 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:32:31 user nova-compute[72773]: WARNING nova.compute.manager [req-84e5e176-e047-4c58-b92e-e048025cf149 req-c6f1061d-c5dd-44b8-9143-f7063422983d service nova] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Received unexpected event network-vif-plugged-3dd11c55-5b19-4376-954d-bb0339a28f07 for instance with vm_state building and task_state spawning.
Aug 16 22:32:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:31 user nova-compute[72773]: DEBUG nova.objects.instance [None req-743559f0-f040-4517-88a9-39581c15e81a tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lazy-loading 'flavor' on Instance uuid 384d4037-bac4-423f-bc7a-e64fe14d7f77 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:32:31 user nova-compute[72773]: DEBUG nova.network.neutron [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Successfully updated port: eae4e0ec-3105-463d-9c92-0e2f63192bb6 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:32:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "refresh_cache-63644e8f-95d4-43a7-a824-8845dd073423" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:32:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquired lock "refresh_cache-63644e8f-95d4-43a7-a824-8845dd073423" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:32:31 user nova-compute[72773]: DEBUG nova.network.neutron [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-743559f0-f040-4517-88a9-39581c15e81a tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lock "384d4037-bac4-423f-bc7a-e64fe14d7f77" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.346s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG nova.network.neutron [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG nova.network.neutron [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Updating instance_info_cache with network_info: [{"id": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "address": "fa:16:3e:0b:c6:49", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeae4e0ec-31", "ovs_interfaceid": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Releasing lock "refresh_cache-63644e8f-95d4-43a7-a824-8845dd073423" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG nova.compute.manager [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Instance network_info: |[{"id": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "address": "fa:16:3e:0b:c6:49", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeae4e0ec-31", "ovs_interfaceid": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Start _get_guest_xml network_info=[{"id": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "address": "fa:16:3e:0b:c6:49", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeae4e0ec-31", "ovs_interfaceid": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:32:32 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:32:32 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:32:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-420565271',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-420565271',id=25,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5I2uvRkVSVEy6vMpomgaGv1BP4PwD8mI6gyaqaKNq6pYg6WVSuIAZUhQwYqmeXo8qz9fImN1pgAPS2h8i/SzT9e/Y2ha9ZdnmTjkz+NM4xFhm+OZ2EL14lH7cAaBxfMw==',key_name='tempest-keypair-126270933',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2ef6a37d79341d7a94e5b314efddab4',ramdisk_id='',reservation_id='r-ixfawem0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-488184195',owner_user_name='tempest-AttachVolumeShelveTestJSON-488184195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:32:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71cd9d1142ec45e792219e8b789cf2a0',uuid=63644e8f-95d4-43a7-a824-8845dd073423,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "address": "fa:16:3e:0b:c6:49", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeae4e0ec-31", "ovs_interfaceid": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Converting VIF {"id": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "address": "fa:16:3e:0b:c6:49", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeae4e0ec-31", "ovs_interfaceid": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c6:49,bridge_name='br-int',has_traffic_filtering=True,id=eae4e0ec-3105-463d-9c92-0e2f63192bb6,network=Network(9aa7e6bf-5a47-422d-b638-cff5a8429391),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeae4e0ec-31') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG nova.objects.instance [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lazy-loading 'pci_devices' on Instance uuid 63644e8f-95d4-43a7-a824-8845dd073423 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:32:32 user nova-compute[72773]:   <uuid>63644e8f-95d4-43a7-a824-8845dd073423</uuid>
Aug 16 22:32:32 user nova-compute[72773]:   <name>instance-00000019</name>
Aug 16 22:32:32 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:32:32 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:32:32 user nova-compute[72773]:   <metadata>
Aug 16 22:32:32 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:32:32 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:32:32 user nova-compute[72773]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-420565271</nova:name>
Aug 16 22:32:32 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:32:32</nova:creationTime>
Aug 16 22:32:32 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:32:32 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:32:32 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:32:32 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:32:32 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:32:32 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:32:32 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:32:32 user nova-compute[72773]:       <nova:owner>
Aug 16 22:32:32 user nova-compute[72773]:         <nova:user uuid="71cd9d1142ec45e792219e8b789cf2a0">tempest-AttachVolumeShelveTestJSON-488184195-project-member</nova:user>
Aug 16 22:32:32 user nova-compute[72773]:         <nova:project uuid="a2ef6a37d79341d7a94e5b314efddab4">tempest-AttachVolumeShelveTestJSON-488184195</nova:project>
Aug 16 22:32:32 user nova-compute[72773]:       </nova:owner>
Aug 16 22:32:32 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:32:32 user nova-compute[72773]:       <nova:ports>
Aug 16 22:32:32 user nova-compute[72773]:         <nova:port uuid="eae4e0ec-3105-463d-9c92-0e2f63192bb6">
Aug 16 22:32:32 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 22:32:32 user nova-compute[72773]:         </nova:port>
Aug 16 22:32:32 user nova-compute[72773]:       </nova:ports>
Aug 16 22:32:32 user nova-compute[72773]:     </nova:instance>
Aug 16 22:32:32 user nova-compute[72773]:   </metadata>
Aug 16 22:32:32 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:32:32 user nova-compute[72773]:     <system>
Aug 16 22:32:32 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:32:32 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:32:32 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:32:32 user nova-compute[72773]:       <entry name="serial">63644e8f-95d4-43a7-a824-8845dd073423</entry>
Aug 16 22:32:32 user nova-compute[72773]:       <entry name="uuid">63644e8f-95d4-43a7-a824-8845dd073423</entry>
Aug 16 22:32:32 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:32:32 user nova-compute[72773]:     </system>
Aug 16 22:32:32 user nova-compute[72773]:   </sysinfo>
Aug 16 22:32:32 user nova-compute[72773]:   <os>
Aug 16 22:32:32 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:32:32 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:32:32 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:32:32 user nova-compute[72773]:   </os>
Aug 16 22:32:32 user nova-compute[72773]:   <features>
Aug 16 22:32:32 user nova-compute[72773]:     <acpi/>
Aug 16 22:32:32 user nova-compute[72773]:     <apic/>
Aug 16 22:32:32 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:32:32 user nova-compute[72773]:   </features>
Aug 16 22:32:32 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:32:32 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:32:32 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:32:32 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:32:32 user nova-compute[72773]:   </clock>
Aug 16 22:32:32 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:32:32 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:32:32 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:32:32 user nova-compute[72773]:   </cpu>
Aug 16 22:32:32 user nova-compute[72773]:   <devices>
Aug 16 22:32:32 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:32:32 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:32:32 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk"/>
Aug 16 22:32:32 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:32:32 user nova-compute[72773]:     </disk>
Aug 16 22:32:32 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:32:32 user nova-compute[72773]:       <mac address="fa:16:3e:0b:c6:49"/>
Aug 16 22:32:32 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:32:32 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:32:32 user nova-compute[72773]:       <target dev="tapeae4e0ec-31"/>
Aug 16 22:32:32 user nova-compute[72773]:     </interface>
Aug 16 22:32:32 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:32:32 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/console.log" append="off"/>
Aug 16 22:32:32 user nova-compute[72773]:     </serial>
Aug 16 22:32:32 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:32:32 user nova-compute[72773]:     <video>
Aug 16 22:32:32 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:32:32 user nova-compute[72773]:     </video>
Aug 16 22:32:32 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:32:32 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:32:32 user nova-compute[72773]:     </rng>
Aug 16 22:32:32 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:32:32 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:32:32 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:32:32 user nova-compute[72773]:     </memballoon>
Aug 16 22:32:32 user nova-compute[72773]:   </devices>
Aug 16 22:32:32 user nova-compute[72773]: </domain>
Aug 16 22:32:32 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-420565271',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-420565271',id=25,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5I2uvRkVSVEy6vMpomgaGv1BP4PwD8mI6gyaqaKNq6pYg6WVSuIAZUhQwYqmeXo8qz9fImN1pgAPS2h8i/SzT9e/Y2ha9ZdnmTjkz+NM4xFhm+OZ2EL14lH7cAaBxfMw==',key_name='tempest-keypair-126270933',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2ef6a37d79341d7a94e5b314efddab4',ramdisk_id='',reservation_id='r-ixfawem0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-488184195',owner_user_name='tempest-AttachVolumeShelveTestJSON-488184195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:32:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71cd9d1142ec45e792219e8b789cf2a0',uuid=63644e8f-95d4-43a7-a824-8845dd073423,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "address": "fa:16:3e:0b:c6:49", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeae4e0ec-31", "ovs_interfaceid": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Converting VIF {"id": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "address": "fa:16:3e:0b:c6:49", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeae4e0ec-31", "ovs_interfaceid": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c6:49,bridge_name='br-int',has_traffic_filtering=True,id=eae4e0ec-3105-463d-9c92-0e2f63192bb6,network=Network(9aa7e6bf-5a47-422d-b638-cff5a8429391),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeae4e0ec-31') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG os_vif [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c6:49,bridge_name='br-int',has_traffic_filtering=True,id=eae4e0ec-3105-463d-9c92-0e2f63192bb6,network=Network(9aa7e6bf-5a47-422d-b638-cff5a8429391),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeae4e0ec-31') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeae4e0ec-31, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeae4e0ec-31, col_values=(('external_ids', {'iface-id': 'eae4e0ec-3105-463d-9c92-0e2f63192bb6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:c6:49', 'vm-uuid': '63644e8f-95d4-43a7-a824-8845dd073423'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:32 user nova-compute[72773]: INFO os_vif [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c6:49,bridge_name='br-int',has_traffic_filtering=True,id=eae4e0ec-3105-463d-9c92-0e2f63192bb6,network=Network(9aa7e6bf-5a47-422d-b638-cff5a8429391),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeae4e0ec-31')
Aug 16 22:32:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:32:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] No VIF found with MAC fa:16:3e:0b:c6:49, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-471f7772-2461-4c27-82de-18e44452c782 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Acquiring lock "interface-384d4037-bac4-423f-bc7a-e64fe14d7f77-2be096ff-0d79-453c-b879-0de5692a28be" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-471f7772-2461-4c27-82de-18e44452c782 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lock "interface-384d4037-bac4-423f-bc7a-e64fe14d7f77-2be096ff-0d79-453c-b879-0de5692a28be" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.objects.instance [None req-471f7772-2461-4c27-82de-18e44452c782 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lazy-loading 'flavor' on Instance uuid 384d4037-bac4-423f-bc7a-e64fe14d7f77 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-471f7772-2461-4c27-82de-18e44452c782 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:30:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1108383111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1108383111',id=17,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvb+XXJ07gUgM7WTapGtd5zb0H3iNTtoq/EYxrHakBL6gizVJGYx1kgeqKzUw19L3aJYy8W16uUXKArptPekGSHwpwooFaxqZLsCatgnClHk+8k8Wbl/vcIiJqX7kwpeQ==',key_name='tempest-keypair-382369375',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:30:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf394e6df5cf44698ab7a57554816db8',ramdisk_id='',reservation_id='r-rihg7lgl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-740368644',owner_user_name='tempest-TaggedAttachmentsTest-740368644-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:30:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c282abb16d84eedbf4703c3a68ec3a2',uuid=384d4037-bac4-423f-bc7a-e64fe14d7f77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2be096ff-0d79-453c-b879-0de5692a28be", "address": "fa:16:3e:51:f2:74", "network": {"id": "381f454a-313a-4b90-80e5-92ca6f7a6c1a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-422292203", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cf394e6df5cf44698ab7a57554816db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be096ff-0d", "ovs_interfaceid": "2be096ff-0d79-453c-b879-0de5692a28be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-471f7772-2461-4c27-82de-18e44452c782 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Converting VIF {"id": "2be096ff-0d79-453c-b879-0de5692a28be", "address": "fa:16:3e:51:f2:74", "network": {"id": "381f454a-313a-4b90-80e5-92ca6f7a6c1a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-422292203", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cf394e6df5cf44698ab7a57554816db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be096ff-0d", "ovs_interfaceid": "2be096ff-0d79-453c-b879-0de5692a28be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-471f7772-2461-4c27-82de-18e44452c782 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:f2:74,bridge_name='br-int',has_traffic_filtering=True,id=2be096ff-0d79-453c-b879-0de5692a28be,network=Network(381f454a-313a-4b90-80e5-92ca6f7a6c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2be096ff-0d') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-471f7772-2461-4c27-82de-18e44452c782 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:51:f2:74"/><model type="virtio"/><mtu size="1442"/><target dev="tap2be096ff-0d"/></interface> {{(pid=72773) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-471f7772-2461-4c27-82de-18e44452c782 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:51:f2:74"/><model type="virtio"/><mtu size="1442"/><target dev="tap2be096ff-0d"/></interface> {{(pid=72773) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-471f7772-2461-4c27-82de-18e44452c782 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Attempting to detach device tap2be096ff-0d from instance 384d4037-bac4-423f-bc7a-e64fe14d7f77 from the persistent domain config. {{(pid=72773) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-471f7772-2461-4c27-82de-18e44452c782 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] detach device xml: <interface type="ethernet">
Aug 16 22:32:33 user nova-compute[72773]:   <mac address="fa:16:3e:51:f2:74"/>
Aug 16 22:32:33 user nova-compute[72773]:   <model type="virtio"/>
Aug 16 22:32:33 user nova-compute[72773]:   <mtu size="1442"/>
Aug 16 22:32:33 user nova-compute[72773]:   <target dev="tap2be096ff-0d"/>
Aug 16 22:32:33 user nova-compute[72773]: </interface>
Aug 16 22:32:33 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-471f7772-2461-4c27-82de-18e44452c782 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:51:f2:74"/><model type="virtio"/><mtu size="1442"/><target dev="tap2be096ff-0d"/></interface> {{(pid=72773) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-471f7772-2461-4c27-82de-18e44452c782 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:51:f2:74"/><model type="virtio"/><mtu size="1442"/><target dev="tap2be096ff-0d"/></interface>not found in domain: <domain type='kvm' id='19'>
Aug 16 22:32:33 user nova-compute[72773]:   <name>instance-00000011</name>
Aug 16 22:32:33 user nova-compute[72773]:   <uuid>384d4037-bac4-423f-bc7a-e64fe14d7f77</uuid>
Aug 16 22:32:33 user nova-compute[72773]:   <metadata>
Aug 16 22:32:33 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:32:33 user nova-compute[72773]:   <nova:package version="0.0.0"/>
Aug 16 22:32:33 user nova-compute[72773]:   <nova:name>tempest-device-tagging-server-1108383111</nova:name>
Aug 16 22:32:33 user nova-compute[72773]:   <nova:creationTime>2023-08-16 22:32:09</nova:creationTime>
Aug 16 22:32:33 user nova-compute[72773]:   <nova:flavor name="m1.tiny">
Aug 16 22:32:33 user nova-compute[72773]:     <nova:memory>512</nova:memory>
Aug 16 22:32:33 user nova-compute[72773]:     <nova:disk>1</nova:disk>
Aug 16 22:32:33 user nova-compute[72773]:     <nova:swap>0</nova:swap>
Aug 16 22:32:33 user nova-compute[72773]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:32:33 user nova-compute[72773]:     <nova:vcpus>1</nova:vcpus>
Aug 16 22:32:33 user nova-compute[72773]:   </nova:flavor>
Aug 16 22:32:33 user nova-compute[72773]:   <nova:owner>
Aug 16 22:32:33 user nova-compute[72773]:     <nova:user uuid="1c282abb16d84eedbf4703c3a68ec3a2">tempest-TaggedAttachmentsTest-740368644-project-member</nova:user>
Aug 16 22:32:33 user nova-compute[72773]:     <nova:project uuid="cf394e6df5cf44698ab7a57554816db8">tempest-TaggedAttachmentsTest-740368644</nova:project>
Aug 16 22:32:33 user nova-compute[72773]:   </nova:owner>
Aug 16 22:32:33 user nova-compute[72773]:   <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:32:33 user nova-compute[72773]:   <nova:ports>
Aug 16 22:32:33 user nova-compute[72773]:     <nova:port uuid="1b75dfbd-e31b-435b-9adf-ea722cb75caf">
Aug 16 22:32:33 user nova-compute[72773]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 22:32:33 user nova-compute[72773]:     </nova:port>
Aug 16 22:32:33 user nova-compute[72773]:     <nova:port uuid="2be096ff-0d79-453c-b879-0de5692a28be">
Aug 16 22:32:33 user nova-compute[72773]:       <nova:ip type="fixed" address="10.10.10.101" ipVersion="4"/>
Aug 16 22:32:33 user nova-compute[72773]:     </nova:port>
Aug 16 22:32:33 user nova-compute[72773]:   </nova:ports>
Aug 16 22:32:33 user nova-compute[72773]: </nova:instance>
Aug 16 22:32:33 user nova-compute[72773]:   </metadata>
Aug 16 22:32:33 user nova-compute[72773]:   <memory unit='KiB'>524288</memory>
Aug 16 22:32:33 user nova-compute[72773]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 16 22:32:33 user nova-compute[72773]:   <vcpu placement='static'>1</vcpu>
Aug 16 22:32:33 user nova-compute[72773]:   <resource>
Aug 16 22:32:33 user nova-compute[72773]:     <partition>/machine</partition>
Aug 16 22:32:33 user nova-compute[72773]:   </resource>
Aug 16 22:32:33 user nova-compute[72773]:   <sysinfo type='smbios'>
Aug 16 22:32:33 user nova-compute[72773]:     <system>
Aug 16 22:32:33 user nova-compute[72773]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 16 22:32:33 user nova-compute[72773]:       <entry name='product'>OpenStack Nova</entry>
Aug 16 22:32:33 user nova-compute[72773]:       <entry name='version'>0.0.0</entry>
Aug 16 22:32:33 user nova-compute[72773]:       <entry name='serial'>384d4037-bac4-423f-bc7a-e64fe14d7f77</entry>
Aug 16 22:32:33 user nova-compute[72773]:       <entry name='uuid'>384d4037-bac4-423f-bc7a-e64fe14d7f77</entry>
Aug 16 22:32:33 user nova-compute[72773]:       <entry name='family'>Virtual Machine</entry>
Aug 16 22:32:33 user nova-compute[72773]:     </system>
Aug 16 22:32:33 user nova-compute[72773]:   </sysinfo>
Aug 16 22:32:33 user nova-compute[72773]:   <os>
Aug 16 22:32:33 user nova-compute[72773]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 16 22:32:33 user nova-compute[72773]:     <boot dev='hd'/>
Aug 16 22:32:33 user nova-compute[72773]:     <smbios mode='sysinfo'/>
Aug 16 22:32:33 user nova-compute[72773]:   </os>
Aug 16 22:32:33 user nova-compute[72773]:   <features>
Aug 16 22:32:33 user nova-compute[72773]:     <acpi/>
Aug 16 22:32:33 user nova-compute[72773]:     <apic/>
Aug 16 22:32:33 user nova-compute[72773]:     <vmcoreinfo state='on'/>
Aug 16 22:32:33 user nova-compute[72773]:   </features>
Aug 16 22:32:33 user nova-compute[72773]:   <cpu mode='custom' match='exact' check='full'>
Aug 16 22:32:33 user nova-compute[72773]:     <model fallback='forbid'>Nehalem</model>
Aug 16 22:32:33 user nova-compute[72773]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 16 22:32:33 user nova-compute[72773]:     <feature policy='require' name='vme'/>
Aug 16 22:32:33 user nova-compute[72773]:     <feature policy='require' name='x2apic'/>
Aug 16 22:32:33 user nova-compute[72773]:     <feature policy='require' name='hypervisor'/>
Aug 16 22:32:33 user nova-compute[72773]:   </cpu>
Aug 16 22:32:33 user nova-compute[72773]:   <clock offset='utc'>
Aug 16 22:32:33 user nova-compute[72773]:     <timer name='pit' tickpolicy='delay'/>
Aug 16 22:32:33 user nova-compute[72773]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 16 22:32:33 user nova-compute[72773]:     <timer name='hpet' present='no'/>
Aug 16 22:32:33 user nova-compute[72773]:   </clock>
Aug 16 22:32:33 user nova-compute[72773]:   <on_poweroff>destroy</on_poweroff>
Aug 16 22:32:33 user nova-compute[72773]:   <on_reboot>restart</on_reboot>
Aug 16 22:32:33 user nova-compute[72773]:   <on_crash>destroy</on_crash>
Aug 16 22:32:33 user nova-compute[72773]:   <devices>
Aug 16 22:32:33 user nova-compute[72773]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 22:32:33 user nova-compute[72773]:     <disk type='file' device='disk'>
Aug 16 22:32:33 user nova-compute[72773]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 16 22:32:33 user nova-compute[72773]:       <source file='/opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/disk' index='2'/>
Aug 16 22:32:33 user nova-compute[72773]:       <backingStore type='file' index='3'>
Aug 16 22:32:33 user nova-compute[72773]:         <format type='raw'/>
Aug 16 22:32:33 user nova-compute[72773]:         <source file='/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380'/>
Aug 16 22:32:33 user nova-compute[72773]:         <backingStore/>
Aug 16 22:32:33 user nova-compute[72773]:       </backingStore>
Aug 16 22:32:33 user nova-compute[72773]:       <target dev='vda' bus='virtio'/>
Aug 16 22:32:33 user nova-compute[72773]:       <alias name='virtio-disk0'/>
Aug 16 22:32:33 user nova-compute[72773]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 16 22:32:33 user nova-compute[72773]:     </disk>
Aug 16 22:32:33 user nova-compute[72773]:     <disk type='file' device='cdrom'>
Aug 16 22:32:33 user nova-compute[72773]:       <driver name='qemu' type='raw' cache='none'/>
Aug 16 22:32:33 user nova-compute[72773]:       <source file='/opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/disk.config' index='1'/>
Aug 16 22:32:33 user nova-compute[72773]:       <backingStore/>
Aug 16 22:32:33 user nova-compute[72773]:       <target dev='hda' bus='ide'/>
Aug 16 22:32:33 user nova-compute[72773]:       <readonly/>
Aug 16 22:32:33 user nova-compute[72773]:       <alias name='ide0-0-0'/>
Aug 16 22:32:33 user nova-compute[72773]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 16 22:32:33 user nova-compute[72773]:     </disk>
Aug 16 22:32:33 user nova-compute[72773]:     <controller type='usb' index='0' model='none'>
Aug 16 22:32:33 user nova-compute[72773]:       <alias name='usb'/>
Aug 16 22:32:33 user nova-compute[72773]:     </controller>
Aug 16 22:32:33 user nova-compute[72773]:     <controller type='pci' index='0' model='pci-root'>
Aug 16 22:32:33 user nova-compute[72773]:       <alias name='pci.0'/>
Aug 16 22:32:33 user nova-compute[72773]:     </controller>
Aug 16 22:32:33 user nova-compute[72773]:     <controller type='ide' index='0'>
Aug 16 22:32:33 user nova-compute[72773]:       <alias name='ide'/>
Aug 16 22:32:33 user nova-compute[72773]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 16 22:32:33 user nova-compute[72773]:     </controller>
Aug 16 22:32:33 user nova-compute[72773]:     <interface type='ethernet'>
Aug 16 22:32:33 user nova-compute[72773]:       <mac address='fa:16:3e:19:aa:35'/>
Aug 16 22:32:33 user nova-compute[72773]:       <target dev='tap1b75dfbd-e3'/>
Aug 16 22:32:33 user nova-compute[72773]:       <model type='virtio'/>
Aug 16 22:32:33 user nova-compute[72773]:       <mtu size='1442'/>
Aug 16 22:32:33 user nova-compute[72773]:       <alias name='net0'/>
Aug 16 22:32:33 user nova-compute[72773]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 16 22:32:33 user nova-compute[72773]:     </interface>
Aug 16 22:32:33 user nova-compute[72773]:     <interface type='ethernet'>
Aug 16 22:32:33 user nova-compute[72773]:       <mac address='fa:16:3e:51:f2:74'/>
Aug 16 22:32:33 user nova-compute[72773]:       <target dev='tap2be096ff-0d'/>
Aug 16 22:32:33 user nova-compute[72773]:       <model type='virtio'/>
Aug 16 22:32:33 user nova-compute[72773]:       <mtu size='1442'/>
Aug 16 22:32:33 user nova-compute[72773]:       <alias name='net1'/>
Aug 16 22:32:33 user nova-compute[72773]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 16 22:32:33 user nova-compute[72773]:     </interface>
Aug 16 22:32:33 user nova-compute[72773]:     <serial type='pty'>
Aug 16 22:32:33 user nova-compute[72773]:       <source path='/dev/pts/3'/>
Aug 16 22:32:33 user nova-compute[72773]:       <log file='/opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/console.log' append='off'/>
Aug 16 22:32:33 user nova-compute[72773]:       <target type='isa-serial' port='0'>
Aug 16 22:32:33 user nova-compute[72773]:         <model name='isa-serial'/>
Aug 16 22:32:33 user nova-compute[72773]:       </target>
Aug 16 22:32:33 user nova-compute[72773]:       <alias name='serial0'/>
Aug 16 22:32:33 user nova-compute[72773]:     </serial>
Aug 16 22:32:33 user nova-compute[72773]:     <console type='pty' tty='/dev/pts/3'>
Aug 16 22:32:33 user nova-compute[72773]:       <source path='/dev/pts/3'/>
Aug 16 22:32:33 user nova-compute[72773]:       <log file='/opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/console.log' append='off'/>
Aug 16 22:32:33 user nova-compute[72773]:       <target type='serial' port='0'/>
Aug 16 22:32:33 user nova-compute[72773]:       <alias name='serial0'/>
Aug 16 22:32:33 user nova-compute[72773]:     </console>
Aug 16 22:32:33 user nova-compute[72773]:     <input type='mouse' bus='ps2'>
Aug 16 22:32:33 user nova-compute[72773]:       <alias name='input0'/>
Aug 16 22:32:33 user nova-compute[72773]:     </input>
Aug 16 22:32:33 user nova-compute[72773]:     <input type='keyboard' bus='ps2'>
Aug 16 22:32:33 user nova-compute[72773]:       <alias name='input1'/>
Aug 16 22:32:33 user nova-compute[72773]:     </input>
Aug 16 22:32:33 user nova-compute[72773]:     <graphics type='vnc' port='5902' autoport='yes' listen='0.0.0.0'>
Aug 16 22:32:33 user nova-compute[72773]:       <listen type='address' address='0.0.0.0'/>
Aug 16 22:32:33 user nova-compute[72773]:     </graphics>
Aug 16 22:32:33 user nova-compute[72773]:     <audio id='1' type='none'/>
Aug 16 22:32:33 user nova-compute[72773]:     <video>
Aug 16 22:32:33 user nova-compute[72773]:       <model type='virtio' heads='1' primary='yes'/>
Aug 16 22:32:33 user nova-compute[72773]:       <alias name='video0'/>
Aug 16 22:32:33 user nova-compute[72773]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 16 22:32:33 user nova-compute[72773]:     </video>
Aug 16 22:32:33 user nova-compute[72773]:     <memballoon model='virtio'>
Aug 16 22:32:33 user nova-compute[72773]:       <stats period='10'/>
Aug 16 22:32:33 user nova-compute[72773]:       <alias name='balloon0'/>
Aug 16 22:32:33 user nova-compute[72773]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 16 22:32:33 user nova-compute[72773]:     </memballoon>
Aug 16 22:32:33 user nova-compute[72773]:     <rng model='virtio'>
Aug 16 22:32:33 user nova-compute[72773]:       <backend model='random'>/dev/urandom</backend>
Aug 16 22:32:33 user nova-compute[72773]:       <alias name='rng0'/>
Aug 16 22:32:33 user nova-compute[72773]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 16 22:32:33 user nova-compute[72773]:     </rng>
Aug 16 22:32:33 user nova-compute[72773]:   </devices>
Aug 16 22:32:33 user nova-compute[72773]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 16 22:32:33 user nova-compute[72773]:     <label>libvirt-384d4037-bac4-423f-bc7a-e64fe14d7f77</label>
Aug 16 22:32:33 user nova-compute[72773]:     <imagelabel>libvirt-384d4037-bac4-423f-bc7a-e64fe14d7f77</imagelabel>
Aug 16 22:32:33 user nova-compute[72773]:   </seclabel>
Aug 16 22:32:33 user nova-compute[72773]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 16 22:32:33 user nova-compute[72773]:     <label>+64055:+108</label>
Aug 16 22:32:33 user nova-compute[72773]:     <imagelabel>+64055:+108</imagelabel>
Aug 16 22:32:33 user nova-compute[72773]:   </seclabel>
Aug 16 22:32:33 user nova-compute[72773]: </domain>
Aug 16 22:32:33 user nova-compute[72773]:  {{(pid=72773) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 16 22:32:33 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-471f7772-2461-4c27-82de-18e44452c782 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Successfully detached device tap2be096ff-0d from instance 384d4037-bac4-423f-bc7a-e64fe14d7f77 from the persistent domain config.
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-471f7772-2461-4c27-82de-18e44452c782 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] (1/8): Attempting to detach device tap2be096ff-0d with device alias net1 from instance 384d4037-bac4-423f-bc7a-e64fe14d7f77 from the live domain config. {{(pid=72773) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-471f7772-2461-4c27-82de-18e44452c782 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] detach device xml: <interface type="ethernet">
Aug 16 22:32:33 user nova-compute[72773]:   <mac address="fa:16:3e:51:f2:74"/>
Aug 16 22:32:33 user nova-compute[72773]:   <model type="virtio"/>
Aug 16 22:32:33 user nova-compute[72773]:   <mtu size="1442"/>
Aug 16 22:32:33 user nova-compute[72773]:   <target dev="tap2be096ff-0d"/>
Aug 16 22:32:33 user nova-compute[72773]: </interface>
Aug 16 22:32:33 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225153.4157965, e9259e07-3d7f-4169-96fc-b080b4b9ce6a => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:32:33 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] VM Resumed (Lifecycle Event)
Aug 16 22:32:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.compute.manager [req-ff013e65-e1d4-44f8-8361-7eb4b0e0905c req-de0c47f1-ad07-4b4e-9953-304966ab8c86 service nova] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Received event network-vif-plugged-3dd11c55-5b19-4376-954d-bb0339a28f07 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ff013e65-e1d4-44f8-8361-7eb4b0e0905c req-de0c47f1-ad07-4b4e-9953-304966ab8c86 service nova] Acquiring lock "e9259e07-3d7f-4169-96fc-b080b4b9ce6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ff013e65-e1d4-44f8-8361-7eb4b0e0905c req-de0c47f1-ad07-4b4e-9953-304966ab8c86 service nova] Lock "e9259e07-3d7f-4169-96fc-b080b4b9ce6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ff013e65-e1d4-44f8-8361-7eb4b0e0905c req-de0c47f1-ad07-4b4e-9953-304966ab8c86 service nova] Lock "e9259e07-3d7f-4169-96fc-b080b4b9ce6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.compute.manager [req-ff013e65-e1d4-44f8-8361-7eb4b0e0905c req-de0c47f1-ad07-4b4e-9953-304966ab8c86 service nova] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] No waiting events found dispatching network-vif-plugged-3dd11c55-5b19-4376-954d-bb0339a28f07 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:32:33 user nova-compute[72773]: WARNING nova.compute.manager [req-ff013e65-e1d4-44f8-8361-7eb4b0e0905c req-de0c47f1-ad07-4b4e-9953-304966ab8c86 service nova] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Received unexpected event network-vif-plugged-3dd11c55-5b19-4376-954d-bb0339a28f07 for instance with vm_state building and task_state spawning.
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.compute.manager [req-ff013e65-e1d4-44f8-8361-7eb4b0e0905c req-de0c47f1-ad07-4b4e-9953-304966ab8c86 service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Received event network-changed-eae4e0ec-3105-463d-9c92-0e2f63192bb6 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.compute.manager [req-ff013e65-e1d4-44f8-8361-7eb4b0e0905c req-de0c47f1-ad07-4b4e-9953-304966ab8c86 service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Refreshing instance network info cache due to event network-changed-eae4e0ec-3105-463d-9c92-0e2f63192bb6. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ff013e65-e1d4-44f8-8361-7eb4b0e0905c req-de0c47f1-ad07-4b4e-9953-304966ab8c86 service nova] Acquiring lock "refresh_cache-63644e8f-95d4-43a7-a824-8845dd073423" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ff013e65-e1d4-44f8-8361-7eb4b0e0905c req-de0c47f1-ad07-4b4e-9953-304966ab8c86 service nova] Acquired lock "refresh_cache-63644e8f-95d4-43a7-a824-8845dd073423" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.network.neutron [req-ff013e65-e1d4-44f8-8361-7eb4b0e0905c req-de0c47f1-ad07-4b4e-9953-304966ab8c86 service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Refreshing network info cache for port eae4e0ec-3105-463d-9c92-0e2f63192bb6 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-471f7772-2461-4c27-82de-18e44452c782 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Start waiting for the detach event from libvirt for device tap2be096ff-0d with device alias net1 for instance 384d4037-bac4-423f-bc7a-e64fe14d7f77 {{(pid=72773) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 22:32:33 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Instance spawned successfully.
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:33 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225153.4170702, e9259e07-3d7f-4169-96fc-b080b4b9ce6a => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:32:33 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] VM Started (Lifecycle Event)
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:32:33 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Received event <DeviceRemovedEvent: 1692225153.4339943, 384d4037-bac4-423f-bc7a-e64fe14d7f77 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72773) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-471f7772-2461-4c27-82de-18e44452c782 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:51:f2:74"/><model type="virtio"/><mtu size="1442"/><target dev="tap2be096ff-0d"/></interface> {{(pid=72773) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-471f7772-2461-4c27-82de-18e44452c782 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:51:f2:74"/><model type="virtio"/><mtu size="1442"/><target dev="tap2be096ff-0d"/></interface>not found in domain: <domain type='kvm' id='19'>
Aug 16 22:32:33 user nova-compute[72773]:   <name>instance-00000011</name>
Aug 16 22:32:33 user nova-compute[72773]:   <uuid>384d4037-bac4-423f-bc7a-e64fe14d7f77</uuid>
Aug 16 22:32:33 user nova-compute[72773]:   <metadata>
Aug 16 22:32:33 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:32:33 user nova-compute[72773]:   <nova:package version="0.0.0"/>
Aug 16 22:32:33 user nova-compute[72773]:   <nova:name>tempest-device-tagging-server-1108383111</nova:name>
Aug 16 22:32:33 user nova-compute[72773]:   <nova:creationTime>2023-08-16 22:32:09</nova:creationTime>
Aug 16 22:32:33 user nova-compute[72773]:   <nova:flavor name="m1.tiny">
Aug 16 22:32:33 user nova-compute[72773]:     <nova:memory>512</nova:memory>
Aug 16 22:32:33 user nova-compute[72773]:     <nova:disk>1</nova:disk>
Aug 16 22:32:33 user nova-compute[72773]:     <nova:swap>0</nova:swap>
Aug 16 22:32:33 user nova-compute[72773]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:32:33 user nova-compute[72773]:     <nova:vcpus>1</nova:vcpus>
Aug 16 22:32:33 user nova-compute[72773]:   </nova:flavor>
Aug 16 22:32:33 user nova-compute[72773]:   <nova:owner>
Aug 16 22:32:33 user nova-compute[72773]:     <nova:user uuid="1c282abb16d84eedbf4703c3a68ec3a2">tempest-TaggedAttachmentsTest-740368644-project-member</nova:user>
Aug 16 22:32:33 user nova-compute[72773]:     <nova:project uuid="cf394e6df5cf44698ab7a57554816db8">tempest-TaggedAttachmentsTest-740368644</nova:project>
Aug 16 22:32:33 user nova-compute[72773]:   </nova:owner>
Aug 16 22:32:33 user nova-compute[72773]:   <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:32:33 user nova-compute[72773]:   <nova:ports>
Aug 16 22:32:33 user nova-compute[72773]:     <nova:port uuid="1b75dfbd-e31b-435b-9adf-ea722cb75caf">
Aug 16 22:32:33 user nova-compute[72773]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 22:32:33 user nova-compute[72773]:     </nova:port>
Aug 16 22:32:33 user nova-compute[72773]:     <nova:port uuid="2be096ff-0d79-453c-b879-0de5692a28be">
Aug 16 22:32:33 user nova-compute[72773]:       <nova:ip type="fixed" address="10.10.10.101" ipVersion="4"/>
Aug 16 22:32:33 user nova-compute[72773]:     </nova:port>
Aug 16 22:32:33 user nova-compute[72773]:   </nova:ports>
Aug 16 22:32:33 user nova-compute[72773]: </nova:instance>
Aug 16 22:32:33 user nova-compute[72773]:   </metadata>
Aug 16 22:32:33 user nova-compute[72773]:   <memory unit='KiB'>524288</memory>
Aug 16 22:32:33 user nova-compute[72773]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 16 22:32:33 user nova-compute[72773]:   <vcpu placement='static'>1</vcpu>
Aug 16 22:32:33 user nova-compute[72773]:   <resource>
Aug 16 22:32:33 user nova-compute[72773]:     <partition>/machine</partition>
Aug 16 22:32:33 user nova-compute[72773]:   </resource>
Aug 16 22:32:33 user nova-compute[72773]:   <sysinfo type='smbios'>
Aug 16 22:32:33 user nova-compute[72773]:     <system>
Aug 16 22:32:33 user nova-compute[72773]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 16 22:32:33 user nova-compute[72773]:       <entry name='product'>OpenStack Nova</entry>
Aug 16 22:32:33 user nova-compute[72773]:       <entry name='version'>0.0.0</entry>
Aug 16 22:32:33 user nova-compute[72773]:       <entry name='serial'>384d4037-bac4-423f-bc7a-e64fe14d7f77</entry>
Aug 16 22:32:33 user nova-compute[72773]:       <entry name='uuid'>384d4037-bac4-423f-bc7a-e64fe14d7f77</entry>
Aug 16 22:32:33 user nova-compute[72773]:       <entry name='family'>Virtual Machine</entry>
Aug 16 22:32:33 user nova-compute[72773]:     </system>
Aug 16 22:32:33 user nova-compute[72773]:   </sysinfo>
Aug 16 22:32:33 user nova-compute[72773]:   <os>
Aug 16 22:32:33 user nova-compute[72773]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 16 22:32:33 user nova-compute[72773]:     <boot dev='hd'/>
Aug 16 22:32:33 user nova-compute[72773]:     <smbios mode='sysinfo'/>
Aug 16 22:32:33 user nova-compute[72773]:   </os>
Aug 16 22:32:33 user nova-compute[72773]:   <features>
Aug 16 22:32:33 user nova-compute[72773]:     <acpi/>
Aug 16 22:32:33 user nova-compute[72773]:     <apic/>
Aug 16 22:32:33 user nova-compute[72773]:     <vmcoreinfo state='on'/>
Aug 16 22:32:33 user nova-compute[72773]:   </features>
Aug 16 22:32:33 user nova-compute[72773]:   <cpu mode='custom' match='exact' check='full'>
Aug 16 22:32:33 user nova-compute[72773]:     <model fallback='forbid'>Nehalem</model>
Aug 16 22:32:33 user nova-compute[72773]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 16 22:32:33 user nova-compute[72773]:     <feature policy='require' name='vme'/>
Aug 16 22:32:33 user nova-compute[72773]:     <feature policy='require' name='x2apic'/>
Aug 16 22:32:33 user nova-compute[72773]:     <feature policy='require' name='hypervisor'/>
Aug 16 22:32:33 user nova-compute[72773]:   </cpu>
Aug 16 22:32:33 user nova-compute[72773]:   <clock offset='utc'>
Aug 16 22:32:33 user nova-compute[72773]:     <timer name='pit' tickpolicy='delay'/>
Aug 16 22:32:33 user nova-compute[72773]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 16 22:32:33 user nova-compute[72773]:     <timer name='hpet' present='no'/>
Aug 16 22:32:33 user nova-compute[72773]:   </clock>
Aug 16 22:32:33 user nova-compute[72773]:   <on_poweroff>destroy</on_poweroff>
Aug 16 22:32:33 user nova-compute[72773]:   <on_reboot>restart</on_reboot>
Aug 16 22:32:33 user nova-compute[72773]:   <on_crash>destroy</on_crash>
Aug 16 22:32:33 user nova-compute[72773]:   <devices>
Aug 16 22:32:33 user nova-compute[72773]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 22:32:33 user nova-compute[72773]:     <disk type='file' device='disk'>
Aug 16 22:32:33 user nova-compute[72773]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 16 22:32:33 user nova-compute[72773]:       <source file='/opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/disk' index='2'/>
Aug 16 22:32:33 user nova-compute[72773]:       <backingStore type='file' index='3'>
Aug 16 22:32:33 user nova-compute[72773]:         <format type='raw'/>
Aug 16 22:32:33 user nova-compute[72773]:         <source file='/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380'/>
Aug 16 22:32:33 user nova-compute[72773]:         <backingStore/>
Aug 16 22:32:33 user nova-compute[72773]:       </backingStore>
Aug 16 22:32:33 user nova-compute[72773]:       <target dev='vda' bus='virtio'/>
Aug 16 22:32:33 user nova-compute[72773]:       <alias name='virtio-disk0'/>
Aug 16 22:32:33 user nova-compute[72773]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 16 22:32:33 user nova-compute[72773]:     </disk>
Aug 16 22:32:33 user nova-compute[72773]:     <disk type='file' device='cdrom'>
Aug 16 22:32:33 user nova-compute[72773]:       <driver name='qemu' type='raw' cache='none'/>
Aug 16 22:32:33 user nova-compute[72773]:       <source file='/opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/disk.config' index='1'/>
Aug 16 22:32:33 user nova-compute[72773]:       <backingStore/>
Aug 16 22:32:33 user nova-compute[72773]:       <target dev='hda' bus='ide'/>
Aug 16 22:32:33 user nova-compute[72773]:       <readonly/>
Aug 16 22:32:33 user nova-compute[72773]:       <alias name='ide0-0-0'/>
Aug 16 22:32:33 user nova-compute[72773]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 16 22:32:33 user nova-compute[72773]:     </disk>
Aug 16 22:32:33 user nova-compute[72773]:     <controller type='usb' index='0' model='none'>
Aug 16 22:32:33 user nova-compute[72773]:       <alias name='usb'/>
Aug 16 22:32:33 user nova-compute[72773]:     </controller>
Aug 16 22:32:33 user nova-compute[72773]:     <controller type='pci' index='0' model='pci-root'>
Aug 16 22:32:33 user nova-compute[72773]:       <alias name='pci.0'/>
Aug 16 22:32:33 user nova-compute[72773]:     </controller>
Aug 16 22:32:33 user nova-compute[72773]:     <controller type='ide' index='0'>
Aug 16 22:32:33 user nova-compute[72773]:       <alias name='ide'/>
Aug 16 22:32:33 user nova-compute[72773]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 16 22:32:33 user nova-compute[72773]:     </controller>
Aug 16 22:32:33 user nova-compute[72773]:     <interface type='ethernet'>
Aug 16 22:32:33 user nova-compute[72773]:       <mac address='fa:16:3e:19:aa:35'/>
Aug 16 22:32:33 user nova-compute[72773]:       <target dev='tap1b75dfbd-e3'/>
Aug 16 22:32:33 user nova-compute[72773]:       <model type='virtio'/>
Aug 16 22:32:33 user nova-compute[72773]:       <mtu size='1442'/>
Aug 16 22:32:33 user nova-compute[72773]:       <alias name='net0'/>
Aug 16 22:32:33 user nova-compute[72773]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 16 22:32:33 user nova-compute[72773]:     </interface>
Aug 16 22:32:33 user nova-compute[72773]:     <serial type='pty'>
Aug 16 22:32:33 user nova-compute[72773]:       <source path='/dev/pts/3'/>
Aug 16 22:32:33 user nova-compute[72773]:       <log file='/opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/console.log' append='off'/>
Aug 16 22:32:33 user nova-compute[72773]:       <target type='isa-serial' port='0'>
Aug 16 22:32:33 user nova-compute[72773]:         <model name='isa-serial'/>
Aug 16 22:32:33 user nova-compute[72773]:       </target>
Aug 16 22:32:33 user nova-compute[72773]:       <alias name='serial0'/>
Aug 16 22:32:33 user nova-compute[72773]:     </serial>
Aug 16 22:32:33 user nova-compute[72773]:     <console type='pty' tty='/dev/pts/3'>
Aug 16 22:32:33 user nova-compute[72773]:       <source path='/dev/pts/3'/>
Aug 16 22:32:33 user nova-compute[72773]:       <log file='/opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/console.log' append='off'/>
Aug 16 22:32:33 user nova-compute[72773]:       <target type='serial' port='0'/>
Aug 16 22:32:33 user nova-compute[72773]:       <alias name='serial0'/>
Aug 16 22:32:33 user nova-compute[72773]:     </console>
Aug 16 22:32:33 user nova-compute[72773]:     <input type='mouse' bus='ps2'>
Aug 16 22:32:33 user nova-compute[72773]:       <alias name='input0'/>
Aug 16 22:32:33 user nova-compute[72773]:     </input>
Aug 16 22:32:33 user nova-compute[72773]:     <input type='keyboard' bus='ps2'>
Aug 16 22:32:33 user nova-compute[72773]:       <alias name='input1'/>
Aug 16 22:32:33 user nova-compute[72773]:     </input>
Aug 16 22:32:33 user nova-compute[72773]:     <graphics type='vnc' port='5902' autoport='yes' listen='0.0.0.0'>
Aug 16 22:32:33 user nova-compute[72773]:       <listen type='address' address='0.0.0.0'/>
Aug 16 22:32:33 user nova-compute[72773]:     </graphics>
Aug 16 22:32:33 user nova-compute[72773]:     <audio id='1' type='none'/>
Aug 16 22:32:33 user nova-compute[72773]:     <video>
Aug 16 22:32:33 user nova-compute[72773]:       <model type='virtio' heads='1' primary='yes'/>
Aug 16 22:32:33 user nova-compute[72773]:       <alias name='video0'/>
Aug 16 22:32:33 user nova-compute[72773]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 16 22:32:33 user nova-compute[72773]:     </video>
Aug 16 22:32:33 user nova-compute[72773]:     <memballoon model='virtio'>
Aug 16 22:32:33 user nova-compute[72773]:       <stats period='10'/>
Aug 16 22:32:33 user nova-compute[72773]:       <alias name='balloon0'/>
Aug 16 22:32:33 user nova-compute[72773]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 16 22:32:33 user nova-compute[72773]:     </memballoon>
Aug 16 22:32:33 user nova-compute[72773]:     <rng model='virtio'>
Aug 16 22:32:33 user nova-compute[72773]:       <backend model='random'>/dev/urandom</backend>
Aug 16 22:32:33 user nova-compute[72773]:       <alias name='rng0'/>
Aug 16 22:32:33 user nova-compute[72773]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 16 22:32:33 user nova-compute[72773]:     </rng>
Aug 16 22:32:33 user nova-compute[72773]:   </devices>
Aug 16 22:32:33 user nova-compute[72773]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 16 22:32:33 user nova-compute[72773]:     <label>libvirt-384d4037-bac4-423f-bc7a-e64fe14d7f77</label>
Aug 16 22:32:33 user nova-compute[72773]:     <imagelabel>libvirt-384d4037-bac4-423f-bc7a-e64fe14d7f77</imagelabel>
Aug 16 22:32:33 user nova-compute[72773]:   </seclabel>
Aug 16 22:32:33 user nova-compute[72773]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 16 22:32:33 user nova-compute[72773]:     <label>+64055:+108</label>
Aug 16 22:32:33 user nova-compute[72773]:     <imagelabel>+64055:+108</imagelabel>
Aug 16 22:32:33 user nova-compute[72773]:   </seclabel>
Aug 16 22:32:33 user nova-compute[72773]: </domain>
Aug 16 22:32:33 user nova-compute[72773]:  {{(pid=72773) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 16 22:32:33 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-471f7772-2461-4c27-82de-18e44452c782 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Successfully detached device tap2be096ff-0d from instance 384d4037-bac4-423f-bc7a-e64fe14d7f77 from the live domain config.
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-471f7772-2461-4c27-82de-18e44452c782 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:30:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1108383111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1108383111',id=17,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvb+XXJ07gUgM7WTapGtd5zb0H3iNTtoq/EYxrHakBL6gizVJGYx1kgeqKzUw19L3aJYy8W16uUXKArptPekGSHwpwooFaxqZLsCatgnClHk+8k8Wbl/vcIiJqX7kwpeQ==',key_name='tempest-keypair-382369375',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:30:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf394e6df5cf44698ab7a57554816db8',ramdisk_id='',reservation_id='r-rihg7lgl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-740368644',owner_user_name='tempest-TaggedAttachmentsTest-740368644-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:30:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c282abb16d84eedbf4703c3a68ec3a2',uuid=384d4037-bac4-423f-bc7a-e64fe14d7f77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2be096ff-0d79-453c-b879-0de5692a28be", "address": "fa:16:3e:51:f2:74", "network": {"id": "381f454a-313a-4b90-80e5-92ca6f7a6c1a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-422292203", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cf394e6df5cf44698ab7a57554816db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be096ff-0d", "ovs_interfaceid": "2be096ff-0d79-453c-b879-0de5692a28be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-471f7772-2461-4c27-82de-18e44452c782 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Converting VIF {"id": "2be096ff-0d79-453c-b879-0de5692a28be", "address": "fa:16:3e:51:f2:74", "network": {"id": "381f454a-313a-4b90-80e5-92ca6f7a6c1a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-422292203", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cf394e6df5cf44698ab7a57554816db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be096ff-0d", "ovs_interfaceid": "2be096ff-0d79-453c-b879-0de5692a28be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-471f7772-2461-4c27-82de-18e44452c782 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:f2:74,bridge_name='br-int',has_traffic_filtering=True,id=2be096ff-0d79-453c-b879-0de5692a28be,network=Network(381f454a-313a-4b90-80e5-92ca6f7a6c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2be096ff-0d') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG os_vif [None req-471f7772-2461-4c27-82de-18e44452c782 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:f2:74,bridge_name='br-int',has_traffic_filtering=True,id=2be096ff-0d79-453c-b879-0de5692a28be,network=Network(381f454a-313a-4b90-80e5-92ca6f7a6c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2be096ff-0d') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2be096ff-0d, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:32:33 user nova-compute[72773]: INFO nova.compute.manager [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Took 7.05 seconds to spawn the instance on the hypervisor.
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.compute.manager [req-f22f379e-d3dd-4c48-af62-bdf9c890e3a9 req-f0fb2bd9-9a4c-4023-a277-169fd6bbb7dc service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Received event network-vif-unplugged-2be096ff-0d79-453c-b879-0de5692a28be {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f22f379e-d3dd-4c48-af62-bdf9c890e3a9 req-f0fb2bd9-9a4c-4023-a277-169fd6bbb7dc service nova] Acquiring lock "384d4037-bac4-423f-bc7a-e64fe14d7f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f22f379e-d3dd-4c48-af62-bdf9c890e3a9 req-f0fb2bd9-9a4c-4023-a277-169fd6bbb7dc service nova] Lock "384d4037-bac4-423f-bc7a-e64fe14d7f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f22f379e-d3dd-4c48-af62-bdf9c890e3a9 req-f0fb2bd9-9a4c-4023-a277-169fd6bbb7dc service nova] Lock "384d4037-bac4-423f-bc7a-e64fe14d7f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.compute.manager [req-f22f379e-d3dd-4c48-af62-bdf9c890e3a9 req-f0fb2bd9-9a4c-4023-a277-169fd6bbb7dc service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] No waiting events found dispatching network-vif-unplugged-2be096ff-0d79-453c-b879-0de5692a28be {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:32:33 user nova-compute[72773]: WARNING nova.compute.manager [req-f22f379e-d3dd-4c48-af62-bdf9c890e3a9 req-f0fb2bd9-9a4c-4023-a277-169fd6bbb7dc service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Received unexpected event network-vif-unplugged-2be096ff-0d79-453c-b879-0de5692a28be for instance with vm_state active and task_state None.
Aug 16 22:32:33 user nova-compute[72773]: INFO os_vif [None req-471f7772-2461-4c27-82de-18e44452c782 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:f2:74,bridge_name='br-int',has_traffic_filtering=True,id=2be096ff-0d79-453c-b879-0de5692a28be,network=Network(381f454a-313a-4b90-80e5-92ca6f7a6c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2be096ff-0d')
Aug 16 22:32:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-471f7772-2461-4c27-82de-18e44452c782 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:32:33 user nova-compute[72773]:   <nova:package version="0.0.0"/>
Aug 16 22:32:33 user nova-compute[72773]:   <nova:name>tempest-device-tagging-server-1108383111</nova:name>
Aug 16 22:32:33 user nova-compute[72773]:   <nova:creationTime>2023-08-16 22:32:33</nova:creationTime>
Aug 16 22:32:33 user nova-compute[72773]:   <nova:flavor name="m1.tiny">
Aug 16 22:32:33 user nova-compute[72773]:     <nova:memory>512</nova:memory>
Aug 16 22:32:33 user nova-compute[72773]:     <nova:disk>1</nova:disk>
Aug 16 22:32:33 user nova-compute[72773]:     <nova:swap>0</nova:swap>
Aug 16 22:32:33 user nova-compute[72773]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:32:33 user nova-compute[72773]:     <nova:vcpus>1</nova:vcpus>
Aug 16 22:32:33 user nova-compute[72773]:   </nova:flavor>
Aug 16 22:32:33 user nova-compute[72773]:   <nova:owner>
Aug 16 22:32:33 user nova-compute[72773]:     <nova:user uuid="1c282abb16d84eedbf4703c3a68ec3a2">tempest-TaggedAttachmentsTest-740368644-project-member</nova:user>
Aug 16 22:32:33 user nova-compute[72773]:     <nova:project uuid="cf394e6df5cf44698ab7a57554816db8">tempest-TaggedAttachmentsTest-740368644</nova:project>
Aug 16 22:32:33 user nova-compute[72773]:   </nova:owner>
Aug 16 22:32:33 user nova-compute[72773]:   <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:32:33 user nova-compute[72773]:   <nova:ports>
Aug 16 22:32:33 user nova-compute[72773]:     <nova:port uuid="1b75dfbd-e31b-435b-9adf-ea722cb75caf">
Aug 16 22:32:33 user nova-compute[72773]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 22:32:33 user nova-compute[72773]:     </nova:port>
Aug 16 22:32:33 user nova-compute[72773]:   </nova:ports>
Aug 16 22:32:33 user nova-compute[72773]: </nova:instance>
Aug 16 22:32:33 user nova-compute[72773]:  {{(pid=72773) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 16 22:32:33 user nova-compute[72773]: INFO nova.compute.manager [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Took 8.07 seconds to build instance.
Aug 16 22:32:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-627fda9b-c4a5-4849-afdf-baffb203771d tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "e9259e07-3d7f-4169-96fc-b080b4b9ce6a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.202s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:34 user nova-compute[72773]: DEBUG nova.network.neutron [req-ff013e65-e1d4-44f8-8361-7eb4b0e0905c req-de0c47f1-ad07-4b4e-9953-304966ab8c86 service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Updated VIF entry in instance network info cache for port eae4e0ec-3105-463d-9c92-0e2f63192bb6. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:32:34 user nova-compute[72773]: DEBUG nova.network.neutron [req-ff013e65-e1d4-44f8-8361-7eb4b0e0905c req-de0c47f1-ad07-4b4e-9953-304966ab8c86 service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Updating instance_info_cache with network_info: [{"id": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "address": "fa:16:3e:0b:c6:49", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeae4e0ec-31", "ovs_interfaceid": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:32:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ff013e65-e1d4-44f8-8361-7eb4b0e0905c req-de0c47f1-ad07-4b4e-9953-304966ab8c86 service nova] Releasing lock "refresh_cache-63644e8f-95d4-43a7-a824-8845dd073423" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:32:34 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692225139.3810396, 5aa5adad-599d-424f-bbfc-7d87ead31b57 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:32:34 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] VM Stopped (Lifecycle Event)
Aug 16 22:32:34 user nova-compute[72773]: DEBUG nova.compute.manager [None req-5501e8ab-7fcf-499b-b7fa-115ffaf72398 None None] [instance: 5aa5adad-599d-424f-bbfc-7d87ead31b57] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:32:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-471f7772-2461-4c27-82de-18e44452c782 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Acquiring lock "refresh_cache-384d4037-bac4-423f-bc7a-e64fe14d7f77" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:32:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-471f7772-2461-4c27-82de-18e44452c782 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Acquired lock "refresh_cache-384d4037-bac4-423f-bc7a-e64fe14d7f77" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:32:34 user nova-compute[72773]: DEBUG nova.network.neutron [None req-471f7772-2461-4c27-82de-18e44452c782 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:32:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:35 user nova-compute[72773]: INFO nova.network.neutron [None req-471f7772-2461-4c27-82de-18e44452c782 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Port 2be096ff-0d79-453c-b879-0de5692a28be from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 16 22:32:35 user nova-compute[72773]: DEBUG nova.network.neutron [None req-471f7772-2461-4c27-82de-18e44452c782 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Updating instance_info_cache with network_info: [{"id": "1b75dfbd-e31b-435b-9adf-ea722cb75caf", "address": "fa:16:3e:19:aa:35", "network": {"id": "6713e8d9-0a25-439f-bf23-793daef39f3d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1456160285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf394e6df5cf44698ab7a57554816db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b75dfbd-e3", "ovs_interfaceid": "1b75dfbd-e31b-435b-9adf-ea722cb75caf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:32:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-471f7772-2461-4c27-82de-18e44452c782 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Releasing lock "refresh_cache-384d4037-bac4-423f-bc7a-e64fe14d7f77" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:32:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-471f7772-2461-4c27-82de-18e44452c782 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lock "interface-384d4037-bac4-423f-bc7a-e64fe14d7f77-2be096ff-0d79-453c-b879-0de5692a28be" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.219s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:35 user nova-compute[72773]: DEBUG nova.compute.manager [req-24f35031-8991-4f32-8670-72305836f502 req-1ce3cb90-b49a-4f43-9fe8-64f8de444b2f service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Received event network-vif-plugged-eae4e0ec-3105-463d-9c92-0e2f63192bb6 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-24f35031-8991-4f32-8670-72305836f502 req-1ce3cb90-b49a-4f43-9fe8-64f8de444b2f service nova] Acquiring lock "63644e8f-95d4-43a7-a824-8845dd073423-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-24f35031-8991-4f32-8670-72305836f502 req-1ce3cb90-b49a-4f43-9fe8-64f8de444b2f service nova] Lock "63644e8f-95d4-43a7-a824-8845dd073423-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-24f35031-8991-4f32-8670-72305836f502 req-1ce3cb90-b49a-4f43-9fe8-64f8de444b2f service nova] Lock "63644e8f-95d4-43a7-a824-8845dd073423-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:35 user nova-compute[72773]: DEBUG nova.compute.manager [req-24f35031-8991-4f32-8670-72305836f502 req-1ce3cb90-b49a-4f43-9fe8-64f8de444b2f service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] No waiting events found dispatching network-vif-plugged-eae4e0ec-3105-463d-9c92-0e2f63192bb6 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:32:35 user nova-compute[72773]: WARNING nova.compute.manager [req-24f35031-8991-4f32-8670-72305836f502 req-1ce3cb90-b49a-4f43-9fe8-64f8de444b2f service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Received unexpected event network-vif-plugged-eae4e0ec-3105-463d-9c92-0e2f63192bb6 for instance with vm_state building and task_state spawning.
Aug 16 22:32:35 user nova-compute[72773]: DEBUG nova.compute.manager [req-24f35031-8991-4f32-8670-72305836f502 req-1ce3cb90-b49a-4f43-9fe8-64f8de444b2f service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Received event network-vif-plugged-eae4e0ec-3105-463d-9c92-0e2f63192bb6 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-24f35031-8991-4f32-8670-72305836f502 req-1ce3cb90-b49a-4f43-9fe8-64f8de444b2f service nova] Acquiring lock "63644e8f-95d4-43a7-a824-8845dd073423-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-24f35031-8991-4f32-8670-72305836f502 req-1ce3cb90-b49a-4f43-9fe8-64f8de444b2f service nova] Lock "63644e8f-95d4-43a7-a824-8845dd073423-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-24f35031-8991-4f32-8670-72305836f502 req-1ce3cb90-b49a-4f43-9fe8-64f8de444b2f service nova] Lock "63644e8f-95d4-43a7-a824-8845dd073423-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:35 user nova-compute[72773]: DEBUG nova.compute.manager [req-24f35031-8991-4f32-8670-72305836f502 req-1ce3cb90-b49a-4f43-9fe8-64f8de444b2f service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] No waiting events found dispatching network-vif-plugged-eae4e0ec-3105-463d-9c92-0e2f63192bb6 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:32:35 user nova-compute[72773]: WARNING nova.compute.manager [req-24f35031-8991-4f32-8670-72305836f502 req-1ce3cb90-b49a-4f43-9fe8-64f8de444b2f service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Received unexpected event network-vif-plugged-eae4e0ec-3105-463d-9c92-0e2f63192bb6 for instance with vm_state building and task_state spawning.
Aug 16 22:32:35 user nova-compute[72773]: DEBUG nova.compute.manager [req-a7b99e6a-01a1-4602-8db9-ad8044baec5a req-acf06d9e-0304-4cd8-8346-2cfc9da154f8 service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Received event network-vif-plugged-2be096ff-0d79-453c-b879-0de5692a28be {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a7b99e6a-01a1-4602-8db9-ad8044baec5a req-acf06d9e-0304-4cd8-8346-2cfc9da154f8 service nova] Acquiring lock "384d4037-bac4-423f-bc7a-e64fe14d7f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a7b99e6a-01a1-4602-8db9-ad8044baec5a req-acf06d9e-0304-4cd8-8346-2cfc9da154f8 service nova] Lock "384d4037-bac4-423f-bc7a-e64fe14d7f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a7b99e6a-01a1-4602-8db9-ad8044baec5a req-acf06d9e-0304-4cd8-8346-2cfc9da154f8 service nova] Lock "384d4037-bac4-423f-bc7a-e64fe14d7f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:35 user nova-compute[72773]: DEBUG nova.compute.manager [req-a7b99e6a-01a1-4602-8db9-ad8044baec5a req-acf06d9e-0304-4cd8-8346-2cfc9da154f8 service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] No waiting events found dispatching network-vif-plugged-2be096ff-0d79-453c-b879-0de5692a28be {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:32:35 user nova-compute[72773]: WARNING nova.compute.manager [req-a7b99e6a-01a1-4602-8db9-ad8044baec5a req-acf06d9e-0304-4cd8-8346-2cfc9da154f8 service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Received unexpected event network-vif-plugged-2be096ff-0d79-453c-b879-0de5692a28be for instance with vm_state active and task_state None.
Aug 16 22:32:35 user nova-compute[72773]: DEBUG nova.compute.manager [req-a7b99e6a-01a1-4602-8db9-ad8044baec5a req-acf06d9e-0304-4cd8-8346-2cfc9da154f8 service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Received event network-vif-deleted-2be096ff-0d79-453c-b879-0de5692a28be {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:36 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225156.42863, 63644e8f-95d4-43a7-a824-8845dd073423 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:32:36 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] VM Resumed (Lifecycle Event)
Aug 16 22:32:36 user nova-compute[72773]: DEBUG nova.compute.manager [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:32:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:32:36 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Instance spawned successfully.
Aug 16 22:32:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:32:36 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:32:36 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:32:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:32:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:32:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:32:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:32:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:32:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:32:36 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:32:36 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225156.4317348, 63644e8f-95d4-43a7-a824-8845dd073423 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:32:36 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] VM Started (Lifecycle Event)
Aug 16 22:32:36 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:32:36 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:32:36 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:32:36 user nova-compute[72773]: INFO nova.compute.manager [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Took 6.57 seconds to spawn the instance on the hypervisor.
Aug 16 22:32:36 user nova-compute[72773]: DEBUG nova.compute.manager [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:32:36 user nova-compute[72773]: INFO nova.compute.manager [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Took 7.83 seconds to build instance.
Aug 16 22:32:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-736b78d9-a416-4bf3-a0a6-f53e400a3661 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "63644e8f-95d4-43a7-a824-8845dd073423" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.037s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:41 user nova-compute[72773]: DEBUG nova.compute.manager [req-7f6052b0-1e04-4657-a9a6-8ad901a70465 req-f1b0d4b3-d12e-41a7-b745-3992c73c555f service nova] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Received event network-changed-02825371-2104-4f86-9e25-d56da652ddc5 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:32:41 user nova-compute[72773]: DEBUG nova.compute.manager [req-7f6052b0-1e04-4657-a9a6-8ad901a70465 req-f1b0d4b3-d12e-41a7-b745-3992c73c555f service nova] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Refreshing instance network info cache due to event network-changed-02825371-2104-4f86-9e25-d56da652ddc5. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:32:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-7f6052b0-1e04-4657-a9a6-8ad901a70465 req-f1b0d4b3-d12e-41a7-b745-3992c73c555f service nova] Acquiring lock "refresh_cache-848668c7-4a90-4bb4-8617-3784cd33ed22" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:32:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-7f6052b0-1e04-4657-a9a6-8ad901a70465 req-f1b0d4b3-d12e-41a7-b745-3992c73c555f service nova] Acquired lock "refresh_cache-848668c7-4a90-4bb4-8617-3784cd33ed22" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:32:41 user nova-compute[72773]: DEBUG nova.network.neutron [req-7f6052b0-1e04-4657-a9a6-8ad901a70465 req-f1b0d4b3-d12e-41a7-b745-3992c73c555f service nova] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Refreshing network info cache for port 02825371-2104-4f86-9e25-d56da652ddc5 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:32:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Acquiring lock "848668c7-4a90-4bb4-8617-3784cd33ed22" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "848668c7-4a90-4bb4-8617-3784cd33ed22" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:41 user nova-compute[72773]: DEBUG nova.objects.instance [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lazy-loading 'flavor' on Instance uuid 848668c7-4a90-4bb4-8617-3784cd33ed22 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:32:41 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Ignoring supplied device name: /dev/vdb
Aug 16 22:32:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "848668c7-4a90-4bb4-8617-3784cd33ed22" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:41 user nova-compute[72773]: DEBUG nova.network.neutron [req-7f6052b0-1e04-4657-a9a6-8ad901a70465 req-f1b0d4b3-d12e-41a7-b745-3992c73c555f service nova] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Updated VIF entry in instance network info cache for port 02825371-2104-4f86-9e25-d56da652ddc5. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:32:41 user nova-compute[72773]: DEBUG nova.network.neutron [req-7f6052b0-1e04-4657-a9a6-8ad901a70465 req-f1b0d4b3-d12e-41a7-b745-3992c73c555f service nova] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Updating instance_info_cache with network_info: [{"id": "02825371-2104-4f86-9e25-d56da652ddc5", "address": "fa:16:3e:fd:62:8e", "network": {"id": "6194759c-ac83-4c8f-8604-c30c22e3ce5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-161254247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b8417e50ee41e89fedf55e7134fecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02825371-21", "ovs_interfaceid": "02825371-2104-4f86-9e25-d56da652ddc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:32:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Acquiring lock "848668c7-4a90-4bb4-8617-3784cd33ed22" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "848668c7-4a90-4bb4-8617-3784cd33ed22" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:41 user nova-compute[72773]: INFO nova.compute.manager [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Attaching volume dcc9ad65-02ad-4a8d-945f-f3bd957201eb to /dev/vdb
Aug 16 22:32:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-7f6052b0-1e04-4657-a9a6-8ad901a70465 req-f1b0d4b3-d12e-41a7-b745-3992c73c555f service nova] Releasing lock "refresh_cache-848668c7-4a90-4bb4-8617-3784cd33ed22" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:32:41 user nova-compute[72773]: DEBUG os_brick.utils [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:32:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f00ff5-d1fe-49fa-9ec7-fc3838794758]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5553bf-62ab-49a9-9659-854037007c09]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d325bdb-96d9-4fb1-9c5e-420261a45c99]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9cafa9-283b-481d-85bc-261c89139bb4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:32:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:32:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:32:41 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:32:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f36eaa1-a5cd-4b4b-a2dc-bbfbf860b587]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:32:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:32:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:32:41 user nova-compute[72773]: DEBUG os_brick.utils [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:32:41 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Updating existing volume attachment record: 7ebf32b4-7a53-41d8-b5ea-1ae5c50a65b6 {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:32:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:50 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:32:50 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:32:50 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:32:50 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:32:50 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:32:51 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:32:51 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:32:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-030d076d-5099-4236-ae31-6025017eb51e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:32:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-030d076d-5099-4236-ae31-6025017eb51e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:32:51 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 22:32:52 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Updating instance_info_cache with network_info: [{"id": "bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c", "address": "fa:16:3e:27:b6:2b", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc3b07d-2b", "ovs_interfaceid": "bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:32:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-030d076d-5099-4236-ae31-6025017eb51e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:32:52 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 22:32:52 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RCwqnfaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:32:53 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:32:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:32:53 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:32:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:32:53 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:32:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2ccb6f-ad9a-48cd-9740-e7d110b4d064]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:32:53 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de3a603-82dc-4151-8d5a-ae029537955d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb] added
Aug 16 22:32:53 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1364ec84-1eb5-4cf7-9644-3d8213286a3f]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ce4cf4-14a2-44c2-82a3-48744f12ce36]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RCwqnfaB {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RCwqnfaB" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6047dd-55c0-456b-8561-98f8c0d4c456]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RCwqnfaB'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1a57e5-fcd5-493e-8e16-9d54e2464030]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[110813be-2b32-4c30-bd34-b924cf6d732f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:32:53 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:32:53 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be3a2b0-6a8c-4eb5-801c-3ba0050b07b8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb, portal: 172.16.0.220,3260]
Aug 16 22:32:53 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb, portal: 172.16.0.220,3260] successful.
Aug 16 22:32:53 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f61d7a-e1c3-4a2b-b0a2-ee4b13d7386d]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e75c830-acd4-47d6-883b-956188b1548f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:32:53 user nova-compute[72773]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb (non-flash)
Aug 16 22:32:53 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:32:53 user nova-compute[72773]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb (non-flash)
Aug 16 22:32:53 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9846ae6-d1a1-48d9-a0a4-a1244b7d805e]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RCwqnfaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:32:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:54 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:32:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:54 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:32:54 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:32:54 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23565663739653535', 'path': '/dev/sdc'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:32:54 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565663739653535', 'path': '/dev/sdc'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:32:54 user nova-compute[72773]: DEBUG nova.objects.instance [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lazy-loading 'flavor' on Instance uuid 848668c7-4a90-4bb4-8617-3784cd33ed22 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:32:54 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 22:32:54 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:32:54 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 22:32:54 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:32:54 user nova-compute[72773]:   <serial>dcc9ad65-02ad-4a8d-945f-f3bd957201eb</serial>
Aug 16 22:32:54 user nova-compute[72773]: </disk>
Aug 16 22:32:54 user nova-compute[72773]:  {{(pid=72773) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 22:32:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:54 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:54 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:32:54 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:32:54 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] No VIF found with MAC fa:16:3e:fd:62:8e, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:32:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5b7ad307-a093-4f96-9a81-ce30c8e260f9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "848668c7-4a90-4bb4-8617-3784cd33ed22" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.458s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848668c7-4a90-4bb4-8617-3784cd33ed22/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848668c7-4a90-4bb4-8617-3784cd33ed22/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848668c7-4a90-4bb4-8617-3784cd33ed22/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/848668c7-4a90-4bb4-8617-3784cd33ed22/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:55 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:32:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:56 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:32:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66ff126-5cbb-4e39-8867-9f5c1538cf91/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66ff126-5cbb-4e39-8867-9f5c1538cf91/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66ff126-5cbb-4e39-8867-9f5c1538cf91/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66ff126-5cbb-4e39-8867-9f5c1538cf91/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9259e07-3d7f-4169-96fc-b080b4b9ce6a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9259e07-3d7f-4169-96fc-b080b4b9ce6a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9259e07-3d7f-4169-96fc-b080b4b9ce6a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9259e07-3d7f-4169-96fc-b080b4b9ce6a/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:58 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:58 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:58 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:58 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:32:58 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:32:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:59 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:32:59 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:32:59 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=6985MB free_disk=25.577289581298828GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:32:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:32:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:32:59 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 956d334e-f190-4625-b144-ab44d2f3321a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:32:59 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 030d076d-5099-4236-ae31-6025017eb51e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:32:59 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 384d4037-bac4-423f-bc7a-e64fe14d7f77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:32:59 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 848668c7-4a90-4bb4-8617-3784cd33ed22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:32:59 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 9ea2a759-7a26-4ad6-9902-b8b75931b5f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:32:59 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance ac2b49e4-59bc-46cd-b7d9-67aa68296e4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:32:59 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 391a6006-4fe6-4398-a1e8-ae95b5edbf2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:32:59 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance cf01c401-c424-4b3e-aa5b-439d62b1ae4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:32:59 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance b66ff126-5cbb-4e39-8867-9f5c1538cf91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:32:59 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance e9259e07-3d7f-4169-96fc-b080b4b9ce6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:32:59 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 63644e8f-95d4-43a7-a824-8845dd073423 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:32:59 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:32:59 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:32:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:32:59 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:32:59 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:32:59 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:32:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.651s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:32:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:03 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:33:04 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Acquiring lock "23894101-2fd3-41a4-83a3-8f6869d24d97" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:04 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:04 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:33:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:04 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:33:04 user nova-compute[72773]: INFO nova.compute.claims [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Claim successful on node user
Aug 16 22:33:05 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:33:05 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:33:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:05 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:33:05 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:33:05 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:33:05 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:33:05 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:33:05 user nova-compute[72773]: DEBUG nova.policy [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7cdb4ae56354496ab9e3f71461bd9d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafc1d829ed749c2bfe35f7bc58e331c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:33:05 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:33:05 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:33:05 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Creating image(s)
Aug 16 22:33:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Acquiring lock "/opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "/opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "/opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.169s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.173s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk 1073741824" returned: 0 in 0.050s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.172s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:06 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Checking if we can resize image /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:33:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:06 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Successfully created port: 5725a1df-f51f-4ba4-99f7-777975663b2e {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:33:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:06 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Cannot resize image /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:33:06 user nova-compute[72773]: DEBUG nova.objects.instance [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lazy-loading 'migration_context' on Instance uuid 23894101-2fd3-41a4-83a3-8f6869d24d97 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:33:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:33:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Ensure instance console log exists: /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:33:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Successfully updated port: 5725a1df-f51f-4ba4-99f7-777975663b2e {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Acquiring lock "refresh_cache-23894101-2fd3-41a4-83a3-8f6869d24d97" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Acquired lock "refresh_cache-23894101-2fd3-41a4-83a3-8f6869d24d97" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG nova.compute.manager [req-a6ec9970-df61-48d2-8d29-79255a9df1ae req-9b3b7ce3-b09c-4849-963b-fe76ed4502bd service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Received event network-changed-5725a1df-f51f-4ba4-99f7-777975663b2e {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG nova.compute.manager [req-a6ec9970-df61-48d2-8d29-79255a9df1ae req-9b3b7ce3-b09c-4849-963b-fe76ed4502bd service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Refreshing instance network info cache due to event network-changed-5725a1df-f51f-4ba4-99f7-777975663b2e. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a6ec9970-df61-48d2-8d29-79255a9df1ae req-9b3b7ce3-b09c-4849-963b-fe76ed4502bd service nova] Acquiring lock "refresh_cache-23894101-2fd3-41a4-83a3-8f6869d24d97" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Updating instance_info_cache with network_info: [{"id": "5725a1df-f51f-4ba4-99f7-777975663b2e", "address": "fa:16:3e:98:fa:bf", "network": {"id": "00744c2a-d566-47bc-abeb-8e9bc9ab312d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-384143120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cafc1d829ed749c2bfe35f7bc58e331c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5725a1df-f5", "ovs_interfaceid": "5725a1df-f51f-4ba4-99f7-777975663b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Releasing lock "refresh_cache-23894101-2fd3-41a4-83a3-8f6869d24d97" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Instance network_info: |[{"id": "5725a1df-f51f-4ba4-99f7-777975663b2e", "address": "fa:16:3e:98:fa:bf", "network": {"id": "00744c2a-d566-47bc-abeb-8e9bc9ab312d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-384143120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cafc1d829ed749c2bfe35f7bc58e331c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5725a1df-f5", "ovs_interfaceid": "5725a1df-f51f-4ba4-99f7-777975663b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a6ec9970-df61-48d2-8d29-79255a9df1ae req-9b3b7ce3-b09c-4849-963b-fe76ed4502bd service nova] Acquired lock "refresh_cache-23894101-2fd3-41a4-83a3-8f6869d24d97" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG nova.network.neutron [req-a6ec9970-df61-48d2-8d29-79255a9df1ae req-9b3b7ce3-b09c-4849-963b-fe76ed4502bd service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Refreshing network info cache for port 5725a1df-f51f-4ba4-99f7-777975663b2e {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Start _get_guest_xml network_info=[{"id": "5725a1df-f51f-4ba4-99f7-777975663b2e", "address": "fa:16:3e:98:fa:bf", "network": {"id": "00744c2a-d566-47bc-abeb-8e9bc9ab312d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-384143120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cafc1d829ed749c2bfe35f7bc58e331c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5725a1df-f5", "ovs_interfaceid": "5725a1df-f51f-4ba4-99f7-777975663b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:33:07 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:33:07 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:33:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:33:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2107689448',display_name='tempest-ServerActionsTestOtherB-server-2107689448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2107689448',id=26,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh1GymZbw24IcnH5dONTb6loGV9Z6Plyeb2rJeaUseM4wpzMr4OTPGkSKihakM6H3XgBNMxcd+thJYbV9RDvja0dJb4k7n+wBitov4O9EMqeBt9unfmT2aB8P/P3aCmCA==',key_name='tempest-keypair-1176159006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cafc1d829ed749c2bfe35f7bc58e331c',ramdisk_id='',reservation_id='r-sdzz0nnk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1140735028',owner_user_name='tempest-ServerActionsTestOtherB-1140735028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:33:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cdb4ae56354496ab9e3f71461bd9d6d',uuid=23894101-2fd3-41a4-83a3-8f6869d24d97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5725a1df-f51f-4ba4-99f7-777975663b2e", "address": "fa:16:3e:98:fa:bf", "network": {"id": "00744c2a-d566-47bc-abeb-8e9bc9ab312d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-384143120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cafc1d829ed749c2bfe35f7bc58e331c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5725a1df-f5", "ovs_interfaceid": "5725a1df-f51f-4ba4-99f7-777975663b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Converting VIF {"id": "5725a1df-f51f-4ba4-99f7-777975663b2e", "address": "fa:16:3e:98:fa:bf", "network": {"id": "00744c2a-d566-47bc-abeb-8e9bc9ab312d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-384143120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cafc1d829ed749c2bfe35f7bc58e331c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5725a1df-f5", "ovs_interfaceid": "5725a1df-f51f-4ba4-99f7-777975663b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:fa:bf,bridge_name='br-int',has_traffic_filtering=True,id=5725a1df-f51f-4ba4-99f7-777975663b2e,network=Network(00744c2a-d566-47bc-abeb-8e9bc9ab312d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5725a1df-f5') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG nova.objects.instance [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lazy-loading 'pci_devices' on Instance uuid 23894101-2fd3-41a4-83a3-8f6869d24d97 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:33:07 user nova-compute[72773]:   <uuid>23894101-2fd3-41a4-83a3-8f6869d24d97</uuid>
Aug 16 22:33:07 user nova-compute[72773]:   <name>instance-0000001a</name>
Aug 16 22:33:07 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:33:07 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:33:07 user nova-compute[72773]:   <metadata>
Aug 16 22:33:07 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:33:07 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:33:07 user nova-compute[72773]:       <nova:name>tempest-ServerActionsTestOtherB-server-2107689448</nova:name>
Aug 16 22:33:07 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:33:07</nova:creationTime>
Aug 16 22:33:07 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:33:07 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:33:07 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:33:07 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:33:07 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:33:07 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:33:07 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:33:07 user nova-compute[72773]:       <nova:owner>
Aug 16 22:33:07 user nova-compute[72773]:         <nova:user uuid="7cdb4ae56354496ab9e3f71461bd9d6d">tempest-ServerActionsTestOtherB-1140735028-project-member</nova:user>
Aug 16 22:33:07 user nova-compute[72773]:         <nova:project uuid="cafc1d829ed749c2bfe35f7bc58e331c">tempest-ServerActionsTestOtherB-1140735028</nova:project>
Aug 16 22:33:07 user nova-compute[72773]:       </nova:owner>
Aug 16 22:33:07 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:33:07 user nova-compute[72773]:       <nova:ports>
Aug 16 22:33:07 user nova-compute[72773]:         <nova:port uuid="5725a1df-f51f-4ba4-99f7-777975663b2e">
Aug 16 22:33:07 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 22:33:07 user nova-compute[72773]:         </nova:port>
Aug 16 22:33:07 user nova-compute[72773]:       </nova:ports>
Aug 16 22:33:07 user nova-compute[72773]:     </nova:instance>
Aug 16 22:33:07 user nova-compute[72773]:   </metadata>
Aug 16 22:33:07 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:33:07 user nova-compute[72773]:     <system>
Aug 16 22:33:07 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:33:07 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:33:07 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:33:07 user nova-compute[72773]:       <entry name="serial">23894101-2fd3-41a4-83a3-8f6869d24d97</entry>
Aug 16 22:33:07 user nova-compute[72773]:       <entry name="uuid">23894101-2fd3-41a4-83a3-8f6869d24d97</entry>
Aug 16 22:33:07 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:33:07 user nova-compute[72773]:     </system>
Aug 16 22:33:07 user nova-compute[72773]:   </sysinfo>
Aug 16 22:33:07 user nova-compute[72773]:   <os>
Aug 16 22:33:07 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:33:07 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:33:07 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:33:07 user nova-compute[72773]:   </os>
Aug 16 22:33:07 user nova-compute[72773]:   <features>
Aug 16 22:33:07 user nova-compute[72773]:     <acpi/>
Aug 16 22:33:07 user nova-compute[72773]:     <apic/>
Aug 16 22:33:07 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:33:07 user nova-compute[72773]:   </features>
Aug 16 22:33:07 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:33:07 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:33:07 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:33:07 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:33:07 user nova-compute[72773]:   </clock>
Aug 16 22:33:07 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:33:07 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:33:07 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:33:07 user nova-compute[72773]:   </cpu>
Aug 16 22:33:07 user nova-compute[72773]:   <devices>
Aug 16 22:33:07 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:33:07 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:33:07 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk"/>
Aug 16 22:33:07 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:33:07 user nova-compute[72773]:     </disk>
Aug 16 22:33:07 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:33:07 user nova-compute[72773]:       <mac address="fa:16:3e:98:fa:bf"/>
Aug 16 22:33:07 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:33:07 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:33:07 user nova-compute[72773]:       <target dev="tap5725a1df-f5"/>
Aug 16 22:33:07 user nova-compute[72773]:     </interface>
Aug 16 22:33:07 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:33:07 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/console.log" append="off"/>
Aug 16 22:33:07 user nova-compute[72773]:     </serial>
Aug 16 22:33:07 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:33:07 user nova-compute[72773]:     <video>
Aug 16 22:33:07 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:33:07 user nova-compute[72773]:     </video>
Aug 16 22:33:07 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:33:07 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:33:07 user nova-compute[72773]:     </rng>
Aug 16 22:33:07 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:33:07 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:33:07 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:33:07 user nova-compute[72773]:     </memballoon>
Aug 16 22:33:07 user nova-compute[72773]:   </devices>
Aug 16 22:33:07 user nova-compute[72773]: </domain>
Aug 16 22:33:07 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:33:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2107689448',display_name='tempest-ServerActionsTestOtherB-server-2107689448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2107689448',id=26,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh1GymZbw24IcnH5dONTb6loGV9Z6Plyeb2rJeaUseM4wpzMr4OTPGkSKihakM6H3XgBNMxcd+thJYbV9RDvja0dJb4k7n+wBitov4O9EMqeBt9unfmT2aB8P/P3aCmCA==',key_name='tempest-keypair-1176159006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cafc1d829ed749c2bfe35f7bc58e331c',ramdisk_id='',reservation_id='r-sdzz0nnk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1140735028',owner_user_name='tempest-ServerActionsTestOtherB-1140735028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:33:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cdb4ae56354496ab9e3f71461bd9d6d',uuid=23894101-2fd3-41a4-83a3-8f6869d24d97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5725a1df-f51f-4ba4-99f7-777975663b2e", "address": "fa:16:3e:98:fa:bf", "network": {"id": "00744c2a-d566-47bc-abeb-8e9bc9ab312d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-384143120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cafc1d829ed749c2bfe35f7bc58e331c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5725a1df-f5", "ovs_interfaceid": "5725a1df-f51f-4ba4-99f7-777975663b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Converting VIF {"id": "5725a1df-f51f-4ba4-99f7-777975663b2e", "address": "fa:16:3e:98:fa:bf", "network": {"id": "00744c2a-d566-47bc-abeb-8e9bc9ab312d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-384143120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cafc1d829ed749c2bfe35f7bc58e331c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5725a1df-f5", "ovs_interfaceid": "5725a1df-f51f-4ba4-99f7-777975663b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:fa:bf,bridge_name='br-int',has_traffic_filtering=True,id=5725a1df-f51f-4ba4-99f7-777975663b2e,network=Network(00744c2a-d566-47bc-abeb-8e9bc9ab312d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5725a1df-f5') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG os_vif [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:fa:bf,bridge_name='br-int',has_traffic_filtering=True,id=5725a1df-f51f-4ba4-99f7-777975663b2e,network=Network(00744c2a-d566-47bc-abeb-8e9bc9ab312d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5725a1df-f5') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5725a1df-f5, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5725a1df-f5, col_values=(('external_ids', {'iface-id': '5725a1df-f51f-4ba4-99f7-777975663b2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:fa:bf', 'vm-uuid': '23894101-2fd3-41a4-83a3-8f6869d24d97'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:07 user nova-compute[72773]: INFO os_vif [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:fa:bf,bridge_name='br-int',has_traffic_filtering=True,id=5725a1df-f51f-4ba4-99f7-777975663b2e,network=Network(00744c2a-d566-47bc-abeb-8e9bc9ab312d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5725a1df-f5')
Aug 16 22:33:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:33:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] No VIF found with MAC fa:16:3e:98:fa:bf, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:33:08 user nova-compute[72773]: DEBUG nova.network.neutron [req-a6ec9970-df61-48d2-8d29-79255a9df1ae req-9b3b7ce3-b09c-4849-963b-fe76ed4502bd service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Updated VIF entry in instance network info cache for port 5725a1df-f51f-4ba4-99f7-777975663b2e. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:33:08 user nova-compute[72773]: DEBUG nova.network.neutron [req-a6ec9970-df61-48d2-8d29-79255a9df1ae req-9b3b7ce3-b09c-4849-963b-fe76ed4502bd service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Updating instance_info_cache with network_info: [{"id": "5725a1df-f51f-4ba4-99f7-777975663b2e", "address": "fa:16:3e:98:fa:bf", "network": {"id": "00744c2a-d566-47bc-abeb-8e9bc9ab312d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-384143120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cafc1d829ed749c2bfe35f7bc58e331c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5725a1df-f5", "ovs_interfaceid": "5725a1df-f51f-4ba4-99f7-777975663b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:33:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a6ec9970-df61-48d2-8d29-79255a9df1ae req-9b3b7ce3-b09c-4849-963b-fe76ed4502bd service nova] Releasing lock "refresh_cache-23894101-2fd3-41a4-83a3-8f6869d24d97" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:33:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:09 user nova-compute[72773]: DEBUG nova.compute.manager [req-486579cc-beb8-472f-ae61-b8db395d3754 req-05390f01-c8a8-4973-b57e-3d18ac68aa03 service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Received event network-vif-plugged-5725a1df-f51f-4ba4-99f7-777975663b2e {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:33:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-486579cc-beb8-472f-ae61-b8db395d3754 req-05390f01-c8a8-4973-b57e-3d18ac68aa03 service nova] Acquiring lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-486579cc-beb8-472f-ae61-b8db395d3754 req-05390f01-c8a8-4973-b57e-3d18ac68aa03 service nova] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-486579cc-beb8-472f-ae61-b8db395d3754 req-05390f01-c8a8-4973-b57e-3d18ac68aa03 service nova] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:09 user nova-compute[72773]: DEBUG nova.compute.manager [req-486579cc-beb8-472f-ae61-b8db395d3754 req-05390f01-c8a8-4973-b57e-3d18ac68aa03 service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] No waiting events found dispatching network-vif-plugged-5725a1df-f51f-4ba4-99f7-777975663b2e {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:33:09 user nova-compute[72773]: WARNING nova.compute.manager [req-486579cc-beb8-472f-ae61-b8db395d3754 req-05390f01-c8a8-4973-b57e-3d18ac68aa03 service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Received unexpected event network-vif-plugged-5725a1df-f51f-4ba4-99f7-777975663b2e for instance with vm_state building and task_state spawning.
Aug 16 22:33:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:11 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225191.509756, 23894101-2fd3-41a4-83a3-8f6869d24d97 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:33:11 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] VM Resumed (Lifecycle Event)
Aug 16 22:33:11 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:33:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:33:11 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Instance spawned successfully.
Aug 16 22:33:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:33:11 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:33:11 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:33:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:33:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:33:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:33:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:33:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:33:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:33:11 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:33:11 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225191.5113049, 23894101-2fd3-41a4-83a3-8f6869d24d97 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:33:11 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] VM Started (Lifecycle Event)
Aug 16 22:33:11 user nova-compute[72773]: DEBUG nova.compute.manager [req-d6d8aa47-7d23-4955-9a53-3de556847d78 req-0f857be7-a5b1-45f0-badd-8aea13e0b3ed service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Received event network-vif-plugged-5725a1df-f51f-4ba4-99f7-777975663b2e {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:33:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d6d8aa47-7d23-4955-9a53-3de556847d78 req-0f857be7-a5b1-45f0-badd-8aea13e0b3ed service nova] Acquiring lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d6d8aa47-7d23-4955-9a53-3de556847d78 req-0f857be7-a5b1-45f0-badd-8aea13e0b3ed service nova] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d6d8aa47-7d23-4955-9a53-3de556847d78 req-0f857be7-a5b1-45f0-badd-8aea13e0b3ed service nova] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:11 user nova-compute[72773]: DEBUG nova.compute.manager [req-d6d8aa47-7d23-4955-9a53-3de556847d78 req-0f857be7-a5b1-45f0-badd-8aea13e0b3ed service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] No waiting events found dispatching network-vif-plugged-5725a1df-f51f-4ba4-99f7-777975663b2e {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:33:11 user nova-compute[72773]: WARNING nova.compute.manager [req-d6d8aa47-7d23-4955-9a53-3de556847d78 req-0f857be7-a5b1-45f0-badd-8aea13e0b3ed service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Received unexpected event network-vif-plugged-5725a1df-f51f-4ba4-99f7-777975663b2e for instance with vm_state building and task_state spawning.
Aug 16 22:33:11 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:33:11 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:33:11 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:33:11 user nova-compute[72773]: INFO nova.compute.manager [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Took 6.05 seconds to spawn the instance on the hypervisor.
Aug 16 22:33:11 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:33:11 user nova-compute[72773]: INFO nova.compute.manager [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Took 6.82 seconds to build instance.
Aug 16 22:33:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7ef5c419-b817-4147-9c7d-6a854b8dc83c tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.925s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:21 user nova-compute[72773]: DEBUG nova.compute.manager [req-3061afb6-a15c-43bf-861d-d33a63021ae2 req-606a0da6-80e9-4c74-8269-8b0b3f535e8f service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received event network-changed-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:33:21 user nova-compute[72773]: DEBUG nova.compute.manager [req-3061afb6-a15c-43bf-861d-d33a63021ae2 req-606a0da6-80e9-4c74-8269-8b0b3f535e8f service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Refreshing instance network info cache due to event network-changed-83003593-cfc0-44d3-94c6-4e3fb90573bd. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:33:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3061afb6-a15c-43bf-861d-d33a63021ae2 req-606a0da6-80e9-4c74-8269-8b0b3f535e8f service nova] Acquiring lock "refresh_cache-9ea2a759-7a26-4ad6-9902-b8b75931b5f0" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:33:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3061afb6-a15c-43bf-861d-d33a63021ae2 req-606a0da6-80e9-4c74-8269-8b0b3f535e8f service nova] Acquired lock "refresh_cache-9ea2a759-7a26-4ad6-9902-b8b75931b5f0" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:33:21 user nova-compute[72773]: DEBUG nova.network.neutron [req-3061afb6-a15c-43bf-861d-d33a63021ae2 req-606a0da6-80e9-4c74-8269-8b0b3f535e8f service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Refreshing network info cache for port 83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:33:21 user nova-compute[72773]: DEBUG nova.network.neutron [req-3061afb6-a15c-43bf-861d-d33a63021ae2 req-606a0da6-80e9-4c74-8269-8b0b3f535e8f service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Updated VIF entry in instance network info cache for port 83003593-cfc0-44d3-94c6-4e3fb90573bd. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:33:21 user nova-compute[72773]: DEBUG nova.network.neutron [req-3061afb6-a15c-43bf-861d-d33a63021ae2 req-606a0da6-80e9-4c74-8269-8b0b3f535e8f service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Updating instance_info_cache with network_info: [{"id": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "address": "fa:16:3e:e4:b7:3c", "network": {"id": "a18f2224-ffb0-4406-9c92-5dad954c3a2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1329143363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d68c72b1454d78934269042633293f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83003593-cf", "ovs_interfaceid": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:33:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3061afb6-a15c-43bf-861d-d33a63021ae2 req-606a0da6-80e9-4c74-8269-8b0b3f535e8f service nova] Releasing lock "refresh_cache-9ea2a759-7a26-4ad6-9902-b8b75931b5f0" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:33:22 user nova-compute[72773]: DEBUG nova.compute.manager [None req-51c19726-082d-41f1-a6cb-b6d694fa5f98 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:33:22 user nova-compute[72773]: INFO nova.compute.manager [None req-51c19726-082d-41f1-a6cb-b6d694fa5f98 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] instance snapshotting
Aug 16 22:33:22 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-51c19726-082d-41f1-a6cb-b6d694fa5f98 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Beginning live snapshot process
Aug 16 22:33:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:33:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 22:33:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:33:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:33:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-51c19726-082d-41f1-a6cb-b6d694fa5f98 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk --force-share --output=json -f qcow2 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-51c19726-082d-41f1-a6cb-b6d694fa5f98 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk --force-share --output=json -f qcow2" returned: 0 in 0.197s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-51c19726-082d-41f1-a6cb-b6d694fa5f98 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk --force-share --output=json -f qcow2 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-51c19726-082d-41f1-a6cb-b6d694fa5f98 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-51c19726-082d-41f1-a6cb-b6d694fa5f98 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-51c19726-082d-41f1-a6cb-b6d694fa5f98 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.206s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-51c19726-082d-41f1-a6cb-b6d694fa5f98 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpctz73nvm/1b914a91bd924b33bed3fb38619bf68e.delta 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-51c19726-082d-41f1-a6cb-b6d694fa5f98 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpctz73nvm/1b914a91bd924b33bed3fb38619bf68e.delta 1073741824" returned: 0 in 0.063s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:23 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-51c19726-082d-41f1-a6cb-b6d694fa5f98 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 22:33:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Acquiring lock "9da5bbc3-b0f9-48d1-be93-86e63e4963c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lock "9da5bbc3-b0f9-48d1-be93-86e63e4963c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:23 user nova-compute[72773]: DEBUG nova.compute.manager [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:33:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:23 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:33:23 user nova-compute[72773]: INFO nova.compute.claims [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Claim successful on node user
Aug 16 22:33:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-79aa610a-dfe2-460b-91da-f36cf2af9942 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Acquiring lock "384d4037-bac4-423f-bc7a-e64fe14d7f77" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-79aa610a-dfe2-460b-91da-f36cf2af9942 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lock "384d4037-bac4-423f-bc7a-e64fe14d7f77" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-79aa610a-dfe2-460b-91da-f36cf2af9942 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Acquiring lock "384d4037-bac4-423f-bc7a-e64fe14d7f77-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-79aa610a-dfe2-460b-91da-f36cf2af9942 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lock "384d4037-bac4-423f-bc7a-e64fe14d7f77-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-79aa610a-dfe2-460b-91da-f36cf2af9942 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lock "384d4037-bac4-423f-bc7a-e64fe14d7f77-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:23 user nova-compute[72773]: INFO nova.compute.manager [None req-79aa610a-dfe2-460b-91da-f36cf2af9942 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Terminating instance
Aug 16 22:33:23 user nova-compute[72773]: DEBUG nova.compute.manager [None req-79aa610a-dfe2-460b-91da-f36cf2af9942 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:33:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-51c19726-082d-41f1-a6cb-b6d694fa5f98 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] COPY block job progress, current cursor: 2031616 final cursor: 75563008 {{(pid=72773) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 22:33:24 user nova-compute[72773]: DEBUG nova.compute.manager [req-7fd80e52-2a2d-4656-aa5c-18772384d4a6 req-f05e092e-95d0-4b7b-a6ff-2b3dca0f4bbf service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Received event network-vif-unplugged-1b75dfbd-e31b-435b-9adf-ea722cb75caf {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:33:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-7fd80e52-2a2d-4656-aa5c-18772384d4a6 req-f05e092e-95d0-4b7b-a6ff-2b3dca0f4bbf service nova] Acquiring lock "384d4037-bac4-423f-bc7a-e64fe14d7f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-7fd80e52-2a2d-4656-aa5c-18772384d4a6 req-f05e092e-95d0-4b7b-a6ff-2b3dca0f4bbf service nova] Lock "384d4037-bac4-423f-bc7a-e64fe14d7f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-7fd80e52-2a2d-4656-aa5c-18772384d4a6 req-f05e092e-95d0-4b7b-a6ff-2b3dca0f4bbf service nova] Lock "384d4037-bac4-423f-bc7a-e64fe14d7f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:24 user nova-compute[72773]: DEBUG nova.compute.manager [req-7fd80e52-2a2d-4656-aa5c-18772384d4a6 req-f05e092e-95d0-4b7b-a6ff-2b3dca0f4bbf service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] No waiting events found dispatching network-vif-unplugged-1b75dfbd-e31b-435b-9adf-ea722cb75caf {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:33:24 user nova-compute[72773]: DEBUG nova.compute.manager [req-7fd80e52-2a2d-4656-aa5c-18772384d4a6 req-f05e092e-95d0-4b7b-a6ff-2b3dca0f4bbf service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Received event network-vif-unplugged-1b75dfbd-e31b-435b-9adf-ea722cb75caf for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:33:24 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:33:24 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:33:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.932s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:24 user nova-compute[72773]: DEBUG nova.compute.manager [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:33:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-51c19726-082d-41f1-a6cb-b6d694fa5f98 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72773) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 22:33:24 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-51c19726-082d-41f1-a6cb-b6d694fa5f98 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 22:33:24 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Instance destroyed successfully.
Aug 16 22:33:24 user nova-compute[72773]: DEBUG nova.objects.instance [None req-79aa610a-dfe2-460b-91da-f36cf2af9942 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lazy-loading 'resources' on Instance uuid 384d4037-bac4-423f-bc7a-e64fe14d7f77 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:33:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-79aa610a-dfe2-460b-91da-f36cf2af9942 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T22:30:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1108383111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1108383111',id=17,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvb+XXJ07gUgM7WTapGtd5zb0H3iNTtoq/EYxrHakBL6gizVJGYx1kgeqKzUw19L3aJYy8W16uUXKArptPekGSHwpwooFaxqZLsCatgnClHk+8k8Wbl/vcIiJqX7kwpeQ==',key_name='tempest-keypair-382369375',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:30:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf394e6df5cf44698ab7a57554816db8',ramdisk_id='',reservation_id='r-rihg7lgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-740368644',owner_user_name='tempest-TaggedAttachmentsTest-740368644-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:30:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c282abb16d84eedbf4703c3a68ec3a2',uuid=384d4037-bac4-423f-bc7a-e64fe14d7f77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b75dfbd-e31b-435b-9adf-ea722cb75caf", "address": "fa:16:3e:19:aa:35", "network": {"id": "6713e8d9-0a25-439f-bf23-793daef39f3d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1456160285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf394e6df5cf44698ab7a57554816db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b75dfbd-e3", "ovs_interfaceid": "1b75dfbd-e31b-435b-9adf-ea722cb75caf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:33:24 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-79aa610a-dfe2-460b-91da-f36cf2af9942 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Converting VIF {"id": "1b75dfbd-e31b-435b-9adf-ea722cb75caf", "address": "fa:16:3e:19:aa:35", "network": {"id": "6713e8d9-0a25-439f-bf23-793daef39f3d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1456160285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf394e6df5cf44698ab7a57554816db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b75dfbd-e3", "ovs_interfaceid": "1b75dfbd-e31b-435b-9adf-ea722cb75caf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:33:24 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-79aa610a-dfe2-460b-91da-f36cf2af9942 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:aa:35,bridge_name='br-int',has_traffic_filtering=True,id=1b75dfbd-e31b-435b-9adf-ea722cb75caf,network=Network(6713e8d9-0a25-439f-bf23-793daef39f3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b75dfbd-e3') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:33:24 user nova-compute[72773]: DEBUG os_vif [None req-79aa610a-dfe2-460b-91da-f36cf2af9942 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:aa:35,bridge_name='br-int',has_traffic_filtering=True,id=1b75dfbd-e31b-435b-9adf-ea722cb75caf,network=Network(6713e8d9-0a25-439f-bf23-793daef39f3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b75dfbd-e3') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:33:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b75dfbd-e3, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:33:24 user nova-compute[72773]: DEBUG nova.compute.manager [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:33:24 user nova-compute[72773]: DEBUG nova.network.neutron [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:33:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:33:24 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:33:24 user nova-compute[72773]: INFO os_vif [None req-79aa610a-dfe2-460b-91da-f36cf2af9942 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:aa:35,bridge_name='br-int',has_traffic_filtering=True,id=1b75dfbd-e31b-435b-9adf-ea722cb75caf,network=Network(6713e8d9-0a25-439f-bf23-793daef39f3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b75dfbd-e3')
Aug 16 22:33:24 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-79aa610a-dfe2-460b-91da-f36cf2af9942 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Deleting instance files /opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77_del
Aug 16 22:33:24 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-79aa610a-dfe2-460b-91da-f36cf2af9942 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Deletion of /opt/stack/data/nova/instances/384d4037-bac4-423f-bc7a-e64fe14d7f77_del complete
Aug 16 22:33:25 user nova-compute[72773]: DEBUG nova.compute.manager [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:33:25 user nova-compute[72773]: DEBUG nova.privsep.utils [None req-51c19726-082d-41f1-a6cb-b6d694fa5f98 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72773) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 22:33:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-51c19726-082d-41f1-a6cb-b6d694fa5f98 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpctz73nvm/1b914a91bd924b33bed3fb38619bf68e.delta /opt/stack/data/nova/instances/snapshots/tmpctz73nvm/1b914a91bd924b33bed3fb38619bf68e {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:25 user nova-compute[72773]: DEBUG nova.policy [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0d14c71e4a9d42d886602349c6d568e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a20f7a479ca4dbebe1ef08f466d2e55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:33:25 user nova-compute[72773]: INFO nova.compute.manager [None req-79aa610a-dfe2-460b-91da-f36cf2af9942 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 16 22:33:25 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-79aa610a-dfe2-460b-91da-f36cf2af9942 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:33:25 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:33:25 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:33:25 user nova-compute[72773]: DEBUG nova.compute.manager [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:33:25 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:33:25 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Creating image(s)
Aug 16 22:33:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Acquiring lock "/opt/stack/data/nova/instances/9da5bbc3-b0f9-48d1-be93-86e63e4963c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lock "/opt/stack/data/nova/instances/9da5bbc3-b0f9-48d1-be93-86e63e4963c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lock "/opt/stack/data/nova/instances/9da5bbc3-b0f9-48d1-be93-86e63e4963c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "5ebcd117-6765-44eb-871b-226afd58e4e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "5ebcd117-6765-44eb-871b-226afd58e4e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:25 user nova-compute[72773]: DEBUG nova.compute.manager [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:33:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.239s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-51c19726-082d-41f1-a6cb-b6d694fa5f98 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpctz73nvm/1b914a91bd924b33bed3fb38619bf68e.delta /opt/stack/data/nova/instances/snapshots/tmpctz73nvm/1b914a91bd924b33bed3fb38619bf68e" returned: 0 in 0.503s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:25 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-51c19726-082d-41f1-a6cb-b6d694fa5f98 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Snapshot extracted, beginning image upload
Aug 16 22:33:25 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:33:25 user nova-compute[72773]: INFO nova.compute.claims [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Claim successful on node user
Aug 16 22:33:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.232s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/9da5bbc3-b0f9-48d1-be93-86e63e4963c2/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/9da5bbc3-b0f9-48d1-be93-86e63e4963c2/disk 1073741824" returned: 0 in 0.066s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.312s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.198s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:26 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9da5bbc3-b0f9-48d1-be93-86e63e4963c2/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:33:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da5bbc3-b0f9-48d1-be93-86e63e4963c2/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da5bbc3-b0f9-48d1-be93-86e63e4963c2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:26 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Cannot resize image /opt/stack/data/nova/instances/9da5bbc3-b0f9-48d1-be93-86e63e4963c2/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:33:26 user nova-compute[72773]: DEBUG nova.objects.instance [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lazy-loading 'migration_context' on Instance uuid 9da5bbc3-b0f9-48d1-be93-86e63e4963c2 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:33:26 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:33:26 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Ensure instance console log exists: /opt/stack/data/nova/instances/9da5bbc3-b0f9-48d1-be93-86e63e4963c2/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:33:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:26 user nova-compute[72773]: DEBUG nova.network.neutron [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Successfully created port: d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:33:26 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:33:26 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Took 1.24 seconds to deallocate network for instance.
Aug 16 22:33:26 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:33:26 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:33:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-79aa610a-dfe2-460b-91da-f36cf2af9942 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.897s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:26 user nova-compute[72773]: DEBUG nova.compute.manager [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:33:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-79aa610a-dfe2-460b-91da-f36cf2af9942 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.032s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:26 user nova-compute[72773]: DEBUG nova.compute.manager [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:33:26 user nova-compute[72773]: DEBUG nova.network.neutron [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:33:26 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:33:26 user nova-compute[72773]: DEBUG nova.compute.manager [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:33:26 user nova-compute[72773]: DEBUG nova.compute.manager [req-9f2acc72-1078-47a7-8f8a-bd4842c1b06e req-0ccb1d48-7e54-41d6-b0c3-30557e679231 service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Received event network-vif-plugged-1b75dfbd-e31b-435b-9adf-ea722cb75caf {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:33:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9f2acc72-1078-47a7-8f8a-bd4842c1b06e req-0ccb1d48-7e54-41d6-b0c3-30557e679231 service nova] Acquiring lock "384d4037-bac4-423f-bc7a-e64fe14d7f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9f2acc72-1078-47a7-8f8a-bd4842c1b06e req-0ccb1d48-7e54-41d6-b0c3-30557e679231 service nova] Lock "384d4037-bac4-423f-bc7a-e64fe14d7f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9f2acc72-1078-47a7-8f8a-bd4842c1b06e req-0ccb1d48-7e54-41d6-b0c3-30557e679231 service nova] Lock "384d4037-bac4-423f-bc7a-e64fe14d7f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:26 user nova-compute[72773]: DEBUG nova.compute.manager [req-9f2acc72-1078-47a7-8f8a-bd4842c1b06e req-0ccb1d48-7e54-41d6-b0c3-30557e679231 service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] No waiting events found dispatching network-vif-plugged-1b75dfbd-e31b-435b-9adf-ea722cb75caf {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:33:26 user nova-compute[72773]: WARNING nova.compute.manager [req-9f2acc72-1078-47a7-8f8a-bd4842c1b06e req-0ccb1d48-7e54-41d6-b0c3-30557e679231 service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Received unexpected event network-vif-plugged-1b75dfbd-e31b-435b-9adf-ea722cb75caf for instance with vm_state deleted and task_state None.
Aug 16 22:33:26 user nova-compute[72773]: DEBUG nova.compute.manager [req-9f2acc72-1078-47a7-8f8a-bd4842c1b06e req-0ccb1d48-7e54-41d6-b0c3-30557e679231 service nova] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Received event network-vif-deleted-1b75dfbd-e31b-435b-9adf-ea722cb75caf {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:33:26 user nova-compute[72773]: DEBUG nova.policy [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '42e8c8d0806e45ed9d1126aad24a034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f496354017e467e9b7a537c73248fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:33:26 user nova-compute[72773]: DEBUG nova.compute.manager [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:33:26 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:33:26 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Creating image(s)
Aug 16 22:33:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "/opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "/opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "/opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.204s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-79aa610a-dfe2-460b-91da-f36cf2af9942 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-79aa610a-dfe2-460b-91da-f36cf2af9942 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-79aa610a-dfe2-460b-91da-f36cf2af9942 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.644s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.192s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:27 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-79aa610a-dfe2-460b-91da-f36cf2af9942 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Deleted allocations for instance 384d4037-bac4-423f-bc7a-e64fe14d7f77
Aug 16 22:33:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk 1073741824" returned: 0 in 0.057s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.network.neutron [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Successfully updated port: d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-79aa610a-dfe2-460b-91da-f36cf2af9942 tempest-TaggedAttachmentsTest-740368644 tempest-TaggedAttachmentsTest-740368644-project-member] Lock "384d4037-bac4-423f-bc7a-e64fe14d7f77" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.361s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Acquiring lock "refresh_cache-9da5bbc3-b0f9-48d1-be93-86e63e4963c2" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Acquired lock "refresh_cache-9da5bbc3-b0f9-48d1-be93-86e63e4963c2" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.network.neutron [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.compute.manager [req-69aa99b6-5d49-4637-8d23-b3e4eb7721ee req-68b98bfe-95bd-4362-bb3d-3cfad3536019 service nova] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Received event network-changed-d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.compute.manager [req-69aa99b6-5d49-4637-8d23-b3e4eb7721ee req-68b98bfe-95bd-4362-bb3d-3cfad3536019 service nova] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Refreshing instance network info cache due to event network-changed-d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-69aa99b6-5d49-4637-8d23-b3e4eb7721ee req-68b98bfe-95bd-4362-bb3d-3cfad3536019 service nova] Acquiring lock "refresh_cache-9da5bbc3-b0f9-48d1-be93-86e63e4963c2" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.network.neutron [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Successfully created port: d558ec29-12a3-451b-aa7f-13646e4e9e3d {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.network.neutron [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.254s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Cannot resize image /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.objects.instance [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lazy-loading 'migration_context' on Instance uuid 5ebcd117-6765-44eb-871b-226afd58e4e1 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Ensure instance console log exists: /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.network.neutron [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Updating instance_info_cache with network_info: [{"id": "d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7", "address": "fa:16:3e:1f:3f:d4", "network": {"id": "0567b846-3f19-403c-9ec6-ac2a82af5f4a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-290484898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a20f7a479ca4dbebe1ef08f466d2e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd062f4e3-cb", "ovs_interfaceid": "d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Releasing lock "refresh_cache-9da5bbc3-b0f9-48d1-be93-86e63e4963c2" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.compute.manager [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Instance network_info: |[{"id": "d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7", "address": "fa:16:3e:1f:3f:d4", "network": {"id": "0567b846-3f19-403c-9ec6-ac2a82af5f4a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-290484898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a20f7a479ca4dbebe1ef08f466d2e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd062f4e3-cb", "ovs_interfaceid": "d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-69aa99b6-5d49-4637-8d23-b3e4eb7721ee req-68b98bfe-95bd-4362-bb3d-3cfad3536019 service nova] Acquired lock "refresh_cache-9da5bbc3-b0f9-48d1-be93-86e63e4963c2" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.network.neutron [req-69aa99b6-5d49-4637-8d23-b3e4eb7721ee req-68b98bfe-95bd-4362-bb3d-3cfad3536019 service nova] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Refreshing network info cache for port d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Start _get_guest_xml network_info=[{"id": "d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7", "address": "fa:16:3e:1f:3f:d4", "network": {"id": "0567b846-3f19-403c-9ec6-ac2a82af5f4a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-290484898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a20f7a479ca4dbebe1ef08f466d2e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd062f4e3-cb", "ovs_interfaceid": "d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:33:27 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:33:27 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:33:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-568978705',display_name='tempest-ServersNegativeTestJSON-server-568978705',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-568978705',id=27,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a20f7a479ca4dbebe1ef08f466d2e55',ramdisk_id='',reservation_id='r-h22js5bi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-526921722',owner_user_name='tempest-ServersNegativeTestJSON-526921722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:33:25Z,user_data=None,user_id='0d14c71e4a9d42d886602349c6d568e8',uuid=9da5bbc3-b0f9-48d1-be93-86e63e4963c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7", "address": "fa:16:3e:1f:3f:d4", "network": {"id": "0567b846-3f19-403c-9ec6-ac2a82af5f4a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-290484898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a20f7a479ca4dbebe1ef08f466d2e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd062f4e3-cb", "ovs_interfaceid": "d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Converting VIF {"id": "d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7", "address": "fa:16:3e:1f:3f:d4", "network": {"id": "0567b846-3f19-403c-9ec6-ac2a82af5f4a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-290484898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a20f7a479ca4dbebe1ef08f466d2e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd062f4e3-cb", "ovs_interfaceid": "d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:3f:d4,bridge_name='br-int',has_traffic_filtering=True,id=d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7,network=Network(0567b846-3f19-403c-9ec6-ac2a82af5f4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd062f4e3-cb') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.objects.instance [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lazy-loading 'pci_devices' on Instance uuid 9da5bbc3-b0f9-48d1-be93-86e63e4963c2 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:33:27 user nova-compute[72773]:   <uuid>9da5bbc3-b0f9-48d1-be93-86e63e4963c2</uuid>
Aug 16 22:33:27 user nova-compute[72773]:   <name>instance-0000001b</name>
Aug 16 22:33:27 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:33:27 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:33:27 user nova-compute[72773]:   <metadata>
Aug 16 22:33:27 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:33:27 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:33:27 user nova-compute[72773]:       <nova:name>tempest-ServersNegativeTestJSON-server-568978705</nova:name>
Aug 16 22:33:27 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:33:27</nova:creationTime>
Aug 16 22:33:27 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:33:27 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:33:27 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:33:27 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:33:27 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:33:27 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:33:27 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:33:27 user nova-compute[72773]:       <nova:owner>
Aug 16 22:33:27 user nova-compute[72773]:         <nova:user uuid="0d14c71e4a9d42d886602349c6d568e8">tempest-ServersNegativeTestJSON-526921722-project-member</nova:user>
Aug 16 22:33:27 user nova-compute[72773]:         <nova:project uuid="7a20f7a479ca4dbebe1ef08f466d2e55">tempest-ServersNegativeTestJSON-526921722</nova:project>
Aug 16 22:33:27 user nova-compute[72773]:       </nova:owner>
Aug 16 22:33:27 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:33:27 user nova-compute[72773]:       <nova:ports>
Aug 16 22:33:27 user nova-compute[72773]:         <nova:port uuid="d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7">
Aug 16 22:33:27 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 22:33:27 user nova-compute[72773]:         </nova:port>
Aug 16 22:33:27 user nova-compute[72773]:       </nova:ports>
Aug 16 22:33:27 user nova-compute[72773]:     </nova:instance>
Aug 16 22:33:27 user nova-compute[72773]:   </metadata>
Aug 16 22:33:27 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:33:27 user nova-compute[72773]:     <system>
Aug 16 22:33:27 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:33:27 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:33:27 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:33:27 user nova-compute[72773]:       <entry name="serial">9da5bbc3-b0f9-48d1-be93-86e63e4963c2</entry>
Aug 16 22:33:27 user nova-compute[72773]:       <entry name="uuid">9da5bbc3-b0f9-48d1-be93-86e63e4963c2</entry>
Aug 16 22:33:27 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:33:27 user nova-compute[72773]:     </system>
Aug 16 22:33:27 user nova-compute[72773]:   </sysinfo>
Aug 16 22:33:27 user nova-compute[72773]:   <os>
Aug 16 22:33:27 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:33:27 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:33:27 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:33:27 user nova-compute[72773]:   </os>
Aug 16 22:33:27 user nova-compute[72773]:   <features>
Aug 16 22:33:27 user nova-compute[72773]:     <acpi/>
Aug 16 22:33:27 user nova-compute[72773]:     <apic/>
Aug 16 22:33:27 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:33:27 user nova-compute[72773]:   </features>
Aug 16 22:33:27 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:33:27 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:33:27 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:33:27 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:33:27 user nova-compute[72773]:   </clock>
Aug 16 22:33:27 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:33:27 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:33:27 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:33:27 user nova-compute[72773]:   </cpu>
Aug 16 22:33:27 user nova-compute[72773]:   <devices>
Aug 16 22:33:27 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:33:27 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:33:27 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/9da5bbc3-b0f9-48d1-be93-86e63e4963c2/disk"/>
Aug 16 22:33:27 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:33:27 user nova-compute[72773]:     </disk>
Aug 16 22:33:27 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:33:27 user nova-compute[72773]:       <mac address="fa:16:3e:1f:3f:d4"/>
Aug 16 22:33:27 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:33:27 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:33:27 user nova-compute[72773]:       <target dev="tapd062f4e3-cb"/>
Aug 16 22:33:27 user nova-compute[72773]:     </interface>
Aug 16 22:33:27 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:33:27 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/9da5bbc3-b0f9-48d1-be93-86e63e4963c2/console.log" append="off"/>
Aug 16 22:33:27 user nova-compute[72773]:     </serial>
Aug 16 22:33:27 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:33:27 user nova-compute[72773]:     <video>
Aug 16 22:33:27 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:33:27 user nova-compute[72773]:     </video>
Aug 16 22:33:27 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:33:27 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:33:27 user nova-compute[72773]:     </rng>
Aug 16 22:33:27 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:33:27 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:33:27 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:33:27 user nova-compute[72773]:     </memballoon>
Aug 16 22:33:27 user nova-compute[72773]:   </devices>
Aug 16 22:33:27 user nova-compute[72773]: </domain>
Aug 16 22:33:27 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:33:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-568978705',display_name='tempest-ServersNegativeTestJSON-server-568978705',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-568978705',id=27,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a20f7a479ca4dbebe1ef08f466d2e55',ramdisk_id='',reservation_id='r-h22js5bi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-526921722',owner_user_name='tempest-ServersNegativeTestJSON-526921722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:33:25Z,user_data=None,user_id='0d14c71e4a9d42d886602349c6d568e8',uuid=9da5bbc3-b0f9-48d1-be93-86e63e4963c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7", "address": "fa:16:3e:1f:3f:d4", "network": {"id": "0567b846-3f19-403c-9ec6-ac2a82af5f4a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-290484898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a20f7a479ca4dbebe1ef08f466d2e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd062f4e3-cb", "ovs_interfaceid": "d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Converting VIF {"id": "d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7", "address": "fa:16:3e:1f:3f:d4", "network": {"id": "0567b846-3f19-403c-9ec6-ac2a82af5f4a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-290484898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a20f7a479ca4dbebe1ef08f466d2e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd062f4e3-cb", "ovs_interfaceid": "d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:3f:d4,bridge_name='br-int',has_traffic_filtering=True,id=d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7,network=Network(0567b846-3f19-403c-9ec6-ac2a82af5f4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd062f4e3-cb') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG os_vif [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:3f:d4,bridge_name='br-int',has_traffic_filtering=True,id=d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7,network=Network(0567b846-3f19-403c-9ec6-ac2a82af5f4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd062f4e3-cb') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd062f4e3-cb, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd062f4e3-cb, col_values=(('external_ids', {'iface-id': 'd062f4e3-cbb3-4d4d-b8f9-93663c57cdf7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:3f:d4', 'vm-uuid': '9da5bbc3-b0f9-48d1-be93-86e63e4963c2'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:33:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:27 user nova-compute[72773]: INFO os_vif [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:3f:d4,bridge_name='br-int',has_traffic_filtering=True,id=d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7,network=Network(0567b846-3f19-403c-9ec6-ac2a82af5f4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd062f4e3-cb')
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] No VIF found with MAC fa:16:3e:1f:3f:d4, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.network.neutron [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Successfully updated port: d558ec29-12a3-451b-aa7f-13646e4e9e3d {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "refresh_cache-5ebcd117-6765-44eb-871b-226afd58e4e1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquired lock "refresh_cache-5ebcd117-6765-44eb-871b-226afd58e4e1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.network.neutron [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.network.neutron [req-69aa99b6-5d49-4637-8d23-b3e4eb7721ee req-68b98bfe-95bd-4362-bb3d-3cfad3536019 service nova] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Updated VIF entry in instance network info cache for port d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.network.neutron [req-69aa99b6-5d49-4637-8d23-b3e4eb7721ee req-68b98bfe-95bd-4362-bb3d-3cfad3536019 service nova] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Updating instance_info_cache with network_info: [{"id": "d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7", "address": "fa:16:3e:1f:3f:d4", "network": {"id": "0567b846-3f19-403c-9ec6-ac2a82af5f4a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-290484898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a20f7a479ca4dbebe1ef08f466d2e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd062f4e3-cb", "ovs_interfaceid": "d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.network.neutron [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-69aa99b6-5d49-4637-8d23-b3e4eb7721ee req-68b98bfe-95bd-4362-bb3d-3cfad3536019 service nova] Releasing lock "refresh_cache-9da5bbc3-b0f9-48d1-be93-86e63e4963c2" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.compute.manager [req-6d7cb37f-91b6-4b69-a3b4-cfa11ffcb5b8 req-b289de88-b507-493c-b4f9-f17895a549a6 service nova] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Received event network-changed-d558ec29-12a3-451b-aa7f-13646e4e9e3d {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.compute.manager [req-6d7cb37f-91b6-4b69-a3b4-cfa11ffcb5b8 req-b289de88-b507-493c-b4f9-f17895a549a6 service nova] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Refreshing instance network info cache due to event network-changed-d558ec29-12a3-451b-aa7f-13646e4e9e3d. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6d7cb37f-91b6-4b69-a3b4-cfa11ffcb5b8 req-b289de88-b507-493c-b4f9-f17895a549a6 service nova] Acquiring lock "refresh_cache-5ebcd117-6765-44eb-871b-226afd58e4e1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:33:28 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-51c19726-082d-41f1-a6cb-b6d694fa5f98 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Snapshot image upload complete
Aug 16 22:33:28 user nova-compute[72773]: INFO nova.compute.manager [None req-51c19726-082d-41f1-a6cb-b6d694fa5f98 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Took 6.10 seconds to snapshot the instance on the hypervisor.
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.network.neutron [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Updating instance_info_cache with network_info: [{"id": "d558ec29-12a3-451b-aa7f-13646e4e9e3d", "address": "fa:16:3e:cb:40:f7", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd558ec29-12", "ovs_interfaceid": "d558ec29-12a3-451b-aa7f-13646e4e9e3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Releasing lock "refresh_cache-5ebcd117-6765-44eb-871b-226afd58e4e1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.compute.manager [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Instance network_info: |[{"id": "d558ec29-12a3-451b-aa7f-13646e4e9e3d", "address": "fa:16:3e:cb:40:f7", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd558ec29-12", "ovs_interfaceid": "d558ec29-12a3-451b-aa7f-13646e4e9e3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6d7cb37f-91b6-4b69-a3b4-cfa11ffcb5b8 req-b289de88-b507-493c-b4f9-f17895a549a6 service nova] Acquired lock "refresh_cache-5ebcd117-6765-44eb-871b-226afd58e4e1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.network.neutron [req-6d7cb37f-91b6-4b69-a3b4-cfa11ffcb5b8 req-b289de88-b507-493c-b4f9-f17895a549a6 service nova] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Refreshing network info cache for port d558ec29-12a3-451b-aa7f-13646e4e9e3d {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Start _get_guest_xml network_info=[{"id": "d558ec29-12a3-451b-aa7f-13646e4e9e3d", "address": "fa:16:3e:cb:40:f7", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd558ec29-12", "ovs_interfaceid": "d558ec29-12a3-451b-aa7f-13646e4e9e3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:33:28 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:33:28 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:33:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1398929644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1398929644',id=28,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f496354017e467e9b7a537c73248fe2',ramdisk_id='',reservation_id='r-ty00mxjv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648946443',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:33:27Z,user_data=None,user_id='42e8c8d0806e45ed9d1126aad24a034b',uuid=5ebcd117-6765-44eb-871b-226afd58e4e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d558ec29-12a3-451b-aa7f-13646e4e9e3d", "address": "fa:16:3e:cb:40:f7", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd558ec29-12", "ovs_interfaceid": "d558ec29-12a3-451b-aa7f-13646e4e9e3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Converting VIF {"id": "d558ec29-12a3-451b-aa7f-13646e4e9e3d", "address": "fa:16:3e:cb:40:f7", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd558ec29-12", "ovs_interfaceid": "d558ec29-12a3-451b-aa7f-13646e4e9e3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:40:f7,bridge_name='br-int',has_traffic_filtering=True,id=d558ec29-12a3-451b-aa7f-13646e4e9e3d,network=Network(0a6ec813-28f9-4716-bf41-20722c69fe20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd558ec29-12') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.objects.instance [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ebcd117-6765-44eb-871b-226afd58e4e1 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:33:28 user nova-compute[72773]:   <uuid>5ebcd117-6765-44eb-871b-226afd58e4e1</uuid>
Aug 16 22:33:28 user nova-compute[72773]:   <name>instance-0000001c</name>
Aug 16 22:33:28 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:33:28 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:33:28 user nova-compute[72773]:   <metadata>
Aug 16 22:33:28 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:33:28 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:33:28 user nova-compute[72773]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1398929644</nova:name>
Aug 16 22:33:28 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:33:28</nova:creationTime>
Aug 16 22:33:28 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:33:28 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:33:28 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:33:28 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:33:28 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:33:28 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:33:28 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:33:28 user nova-compute[72773]:       <nova:owner>
Aug 16 22:33:28 user nova-compute[72773]:         <nova:user uuid="42e8c8d0806e45ed9d1126aad24a034b">tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member</nova:user>
Aug 16 22:33:28 user nova-compute[72773]:         <nova:project uuid="4f496354017e467e9b7a537c73248fe2">tempest-ServerBootFromVolumeStableRescueTest-1648946443</nova:project>
Aug 16 22:33:28 user nova-compute[72773]:       </nova:owner>
Aug 16 22:33:28 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:33:28 user nova-compute[72773]:       <nova:ports>
Aug 16 22:33:28 user nova-compute[72773]:         <nova:port uuid="d558ec29-12a3-451b-aa7f-13646e4e9e3d">
Aug 16 22:33:28 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 22:33:28 user nova-compute[72773]:         </nova:port>
Aug 16 22:33:28 user nova-compute[72773]:       </nova:ports>
Aug 16 22:33:28 user nova-compute[72773]:     </nova:instance>
Aug 16 22:33:28 user nova-compute[72773]:   </metadata>
Aug 16 22:33:28 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:33:28 user nova-compute[72773]:     <system>
Aug 16 22:33:28 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:33:28 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:33:28 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:33:28 user nova-compute[72773]:       <entry name="serial">5ebcd117-6765-44eb-871b-226afd58e4e1</entry>
Aug 16 22:33:28 user nova-compute[72773]:       <entry name="uuid">5ebcd117-6765-44eb-871b-226afd58e4e1</entry>
Aug 16 22:33:28 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:33:28 user nova-compute[72773]:     </system>
Aug 16 22:33:28 user nova-compute[72773]:   </sysinfo>
Aug 16 22:33:28 user nova-compute[72773]:   <os>
Aug 16 22:33:28 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:33:28 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:33:28 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:33:28 user nova-compute[72773]:   </os>
Aug 16 22:33:28 user nova-compute[72773]:   <features>
Aug 16 22:33:28 user nova-compute[72773]:     <acpi/>
Aug 16 22:33:28 user nova-compute[72773]:     <apic/>
Aug 16 22:33:28 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:33:28 user nova-compute[72773]:   </features>
Aug 16 22:33:28 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:33:28 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:33:28 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:33:28 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:33:28 user nova-compute[72773]:   </clock>
Aug 16 22:33:28 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:33:28 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:33:28 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:33:28 user nova-compute[72773]:   </cpu>
Aug 16 22:33:28 user nova-compute[72773]:   <devices>
Aug 16 22:33:28 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:33:28 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:33:28 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk"/>
Aug 16 22:33:28 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:33:28 user nova-compute[72773]:     </disk>
Aug 16 22:33:28 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:33:28 user nova-compute[72773]:       <mac address="fa:16:3e:cb:40:f7"/>
Aug 16 22:33:28 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:33:28 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:33:28 user nova-compute[72773]:       <target dev="tapd558ec29-12"/>
Aug 16 22:33:28 user nova-compute[72773]:     </interface>
Aug 16 22:33:28 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:33:28 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/console.log" append="off"/>
Aug 16 22:33:28 user nova-compute[72773]:     </serial>
Aug 16 22:33:28 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:33:28 user nova-compute[72773]:     <video>
Aug 16 22:33:28 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:33:28 user nova-compute[72773]:     </video>
Aug 16 22:33:28 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:33:28 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:33:28 user nova-compute[72773]:     </rng>
Aug 16 22:33:28 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:33:28 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:33:28 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:33:28 user nova-compute[72773]:     </memballoon>
Aug 16 22:33:28 user nova-compute[72773]:   </devices>
Aug 16 22:33:28 user nova-compute[72773]: </domain>
Aug 16 22:33:28 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:33:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1398929644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1398929644',id=28,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f496354017e467e9b7a537c73248fe2',ramdisk_id='',reservation_id='r-ty00mxjv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648946443',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:33:27Z,user_data=None,user_id='42e8c8d0806e45ed9d1126aad24a034b',uuid=5ebcd117-6765-44eb-871b-226afd58e4e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d558ec29-12a3-451b-aa7f-13646e4e9e3d", "address": "fa:16:3e:cb:40:f7", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd558ec29-12", "ovs_interfaceid": "d558ec29-12a3-451b-aa7f-13646e4e9e3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Converting VIF {"id": "d558ec29-12a3-451b-aa7f-13646e4e9e3d", "address": "fa:16:3e:cb:40:f7", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd558ec29-12", "ovs_interfaceid": "d558ec29-12a3-451b-aa7f-13646e4e9e3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:40:f7,bridge_name='br-int',has_traffic_filtering=True,id=d558ec29-12a3-451b-aa7f-13646e4e9e3d,network=Network(0a6ec813-28f9-4716-bf41-20722c69fe20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd558ec29-12') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG os_vif [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:40:f7,bridge_name='br-int',has_traffic_filtering=True,id=d558ec29-12a3-451b-aa7f-13646e4e9e3d,network=Network(0a6ec813-28f9-4716-bf41-20722c69fe20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd558ec29-12') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd558ec29-12, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd558ec29-12, col_values=(('external_ids', {'iface-id': 'd558ec29-12a3-451b-aa7f-13646e4e9e3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:40:f7', 'vm-uuid': '5ebcd117-6765-44eb-871b-226afd58e4e1'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:33:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:28 user nova-compute[72773]: INFO os_vif [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:40:f7,bridge_name='br-int',has_traffic_filtering=True,id=d558ec29-12a3-451b-aa7f-13646e4e9e3d,network=Network(0a6ec813-28f9-4716-bf41-20722c69fe20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd558ec29-12')
Aug 16 22:33:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:33:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] No VIF found with MAC fa:16:3e:cb:40:f7, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:33:29 user nova-compute[72773]: DEBUG nova.network.neutron [req-6d7cb37f-91b6-4b69-a3b4-cfa11ffcb5b8 req-b289de88-b507-493c-b4f9-f17895a549a6 service nova] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Updated VIF entry in instance network info cache for port d558ec29-12a3-451b-aa7f-13646e4e9e3d. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:33:29 user nova-compute[72773]: DEBUG nova.network.neutron [req-6d7cb37f-91b6-4b69-a3b4-cfa11ffcb5b8 req-b289de88-b507-493c-b4f9-f17895a549a6 service nova] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Updating instance_info_cache with network_info: [{"id": "d558ec29-12a3-451b-aa7f-13646e4e9e3d", "address": "fa:16:3e:cb:40:f7", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd558ec29-12", "ovs_interfaceid": "d558ec29-12a3-451b-aa7f-13646e4e9e3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:33:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6d7cb37f-91b6-4b69-a3b4-cfa11ffcb5b8 req-b289de88-b507-493c-b4f9-f17895a549a6 service nova] Releasing lock "refresh_cache-5ebcd117-6765-44eb-871b-226afd58e4e1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:33:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:30 user nova-compute[72773]: DEBUG nova.compute.manager [req-a2195136-da95-4b62-9746-62baec3142c4 req-c8aafdbf-a387-4548-b4ac-50f97978bb7a service nova] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Received event network-vif-plugged-d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:33:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a2195136-da95-4b62-9746-62baec3142c4 req-c8aafdbf-a387-4548-b4ac-50f97978bb7a service nova] Acquiring lock "9da5bbc3-b0f9-48d1-be93-86e63e4963c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a2195136-da95-4b62-9746-62baec3142c4 req-c8aafdbf-a387-4548-b4ac-50f97978bb7a service nova] Lock "9da5bbc3-b0f9-48d1-be93-86e63e4963c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a2195136-da95-4b62-9746-62baec3142c4 req-c8aafdbf-a387-4548-b4ac-50f97978bb7a service nova] Lock "9da5bbc3-b0f9-48d1-be93-86e63e4963c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:30 user nova-compute[72773]: DEBUG nova.compute.manager [req-a2195136-da95-4b62-9746-62baec3142c4 req-c8aafdbf-a387-4548-b4ac-50f97978bb7a service nova] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] No waiting events found dispatching network-vif-plugged-d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:33:30 user nova-compute[72773]: WARNING nova.compute.manager [req-a2195136-da95-4b62-9746-62baec3142c4 req-c8aafdbf-a387-4548-b4ac-50f97978bb7a service nova] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Received unexpected event network-vif-plugged-d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7 for instance with vm_state building and task_state spawning.
Aug 16 22:33:30 user nova-compute[72773]: DEBUG nova.compute.manager [req-a2195136-da95-4b62-9746-62baec3142c4 req-c8aafdbf-a387-4548-b4ac-50f97978bb7a service nova] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Received event network-vif-plugged-d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:33:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a2195136-da95-4b62-9746-62baec3142c4 req-c8aafdbf-a387-4548-b4ac-50f97978bb7a service nova] Acquiring lock "9da5bbc3-b0f9-48d1-be93-86e63e4963c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a2195136-da95-4b62-9746-62baec3142c4 req-c8aafdbf-a387-4548-b4ac-50f97978bb7a service nova] Lock "9da5bbc3-b0f9-48d1-be93-86e63e4963c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a2195136-da95-4b62-9746-62baec3142c4 req-c8aafdbf-a387-4548-b4ac-50f97978bb7a service nova] Lock "9da5bbc3-b0f9-48d1-be93-86e63e4963c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:30 user nova-compute[72773]: DEBUG nova.compute.manager [req-a2195136-da95-4b62-9746-62baec3142c4 req-c8aafdbf-a387-4548-b4ac-50f97978bb7a service nova] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] No waiting events found dispatching network-vif-plugged-d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:33:30 user nova-compute[72773]: WARNING nova.compute.manager [req-a2195136-da95-4b62-9746-62baec3142c4 req-c8aafdbf-a387-4548-b4ac-50f97978bb7a service nova] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Received unexpected event network-vif-plugged-d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7 for instance with vm_state building and task_state spawning.
Aug 16 22:33:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:31 user nova-compute[72773]: DEBUG nova.compute.manager [req-763302a0-9409-4c9a-be41-22b080f3bf01 req-efbff431-f7f7-4325-b6f0-09aed631a337 service nova] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Received event network-vif-plugged-d558ec29-12a3-451b-aa7f-13646e4e9e3d {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:33:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-763302a0-9409-4c9a-be41-22b080f3bf01 req-efbff431-f7f7-4325-b6f0-09aed631a337 service nova] Acquiring lock "5ebcd117-6765-44eb-871b-226afd58e4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-763302a0-9409-4c9a-be41-22b080f3bf01 req-efbff431-f7f7-4325-b6f0-09aed631a337 service nova] Lock "5ebcd117-6765-44eb-871b-226afd58e4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-763302a0-9409-4c9a-be41-22b080f3bf01 req-efbff431-f7f7-4325-b6f0-09aed631a337 service nova] Lock "5ebcd117-6765-44eb-871b-226afd58e4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:31 user nova-compute[72773]: DEBUG nova.compute.manager [req-763302a0-9409-4c9a-be41-22b080f3bf01 req-efbff431-f7f7-4325-b6f0-09aed631a337 service nova] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] No waiting events found dispatching network-vif-plugged-d558ec29-12a3-451b-aa7f-13646e4e9e3d {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:33:31 user nova-compute[72773]: WARNING nova.compute.manager [req-763302a0-9409-4c9a-be41-22b080f3bf01 req-efbff431-f7f7-4325-b6f0-09aed631a337 service nova] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Received unexpected event network-vif-plugged-d558ec29-12a3-451b-aa7f-13646e4e9e3d for instance with vm_state building and task_state spawning.
Aug 16 22:33:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:33 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225213.3991196, 9da5bbc3-b0f9-48d1-be93-86e63e4963c2 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:33:33 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] VM Resumed (Lifecycle Event)
Aug 16 22:33:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:33:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:33:33 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Instance spawned successfully.
Aug 16 22:33:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:33:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:33:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:33:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:33:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:33:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:33:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:33:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:33:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:33:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:33:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:33:33 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:33:33 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225213.4051163, 9da5bbc3-b0f9-48d1-be93-86e63e4963c2 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:33:33 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] VM Started (Lifecycle Event)
Aug 16 22:33:33 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Instance spawned successfully.
Aug 16 22:33:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:33:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:33:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:33:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:33:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:33:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:33:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:33:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:33:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:33:33 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:33:33 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225213.4354794, 5ebcd117-6765-44eb-871b-226afd58e4e1 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:33:33 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] VM Resumed (Lifecycle Event)
Aug 16 22:33:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:33:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:33:33 user nova-compute[72773]: DEBUG nova.compute.manager [req-1b6ea617-8837-4ded-a6a2-cc1d242baa4a req-d0785f67-10ee-4a48-8bf5-eb74f1856be8 service nova] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Received event network-vif-plugged-d558ec29-12a3-451b-aa7f-13646e4e9e3d {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:33:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-1b6ea617-8837-4ded-a6a2-cc1d242baa4a req-d0785f67-10ee-4a48-8bf5-eb74f1856be8 service nova] Acquiring lock "5ebcd117-6765-44eb-871b-226afd58e4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-1b6ea617-8837-4ded-a6a2-cc1d242baa4a req-d0785f67-10ee-4a48-8bf5-eb74f1856be8 service nova] Lock "5ebcd117-6765-44eb-871b-226afd58e4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-1b6ea617-8837-4ded-a6a2-cc1d242baa4a req-d0785f67-10ee-4a48-8bf5-eb74f1856be8 service nova] Lock "5ebcd117-6765-44eb-871b-226afd58e4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:33 user nova-compute[72773]: DEBUG nova.compute.manager [req-1b6ea617-8837-4ded-a6a2-cc1d242baa4a req-d0785f67-10ee-4a48-8bf5-eb74f1856be8 service nova] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] No waiting events found dispatching network-vif-plugged-d558ec29-12a3-451b-aa7f-13646e4e9e3d {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:33:33 user nova-compute[72773]: WARNING nova.compute.manager [req-1b6ea617-8837-4ded-a6a2-cc1d242baa4a req-d0785f67-10ee-4a48-8bf5-eb74f1856be8 service nova] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Received unexpected event network-vif-plugged-d558ec29-12a3-451b-aa7f-13646e4e9e3d for instance with vm_state building and task_state spawning.
Aug 16 22:33:33 user nova-compute[72773]: INFO nova.compute.manager [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Took 8.36 seconds to spawn the instance on the hypervisor.
Aug 16 22:33:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:33:33 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:33:33 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225213.4377885, 5ebcd117-6765-44eb-871b-226afd58e4e1 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:33:33 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] VM Started (Lifecycle Event)
Aug 16 22:33:33 user nova-compute[72773]: INFO nova.compute.manager [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Took 6.90 seconds to spawn the instance on the hypervisor.
Aug 16 22:33:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:33:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:33:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:33:33 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:33:33 user nova-compute[72773]: INFO nova.compute.manager [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Took 9.80 seconds to build instance.
Aug 16 22:33:33 user nova-compute[72773]: INFO nova.compute.manager [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Took 8.25 seconds to build instance.
Aug 16 22:33:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-daf939ca-4e78-4dd5-bec5-132f1cce4fb9 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lock "9da5bbc3-b0f9-48d1-be93-86e63e4963c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.906s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d0cb16bf-0409-49ff-9934-4ae1e4041a31 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "5ebcd117-6765-44eb-871b-226afd58e4e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.371s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:39 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692225204.9181535, 384d4037-bac4-423f-bc7a-e64fe14d7f77 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:33:39 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] VM Stopped (Lifecycle Event)
Aug 16 22:33:39 user nova-compute[72773]: DEBUG nova.compute.manager [None req-91880538-08ec-45b4-95dc-70564b19648e None None] [instance: 384d4037-bac4-423f-bc7a-e64fe14d7f77] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:33:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:46 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:33:48 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:33:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-903ce346-511c-43f4-9a11-2b5901d52afe tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Acquiring lock "848668c7-4a90-4bb4-8617-3784cd33ed22" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-903ce346-511c-43f4-9a11-2b5901d52afe tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "848668c7-4a90-4bb4-8617-3784cd33ed22" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:48 user nova-compute[72773]: INFO nova.compute.manager [None req-903ce346-511c-43f4-9a11-2b5901d52afe tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Detaching volume dcc9ad65-02ad-4a8d-945f-f3bd957201eb
Aug 16 22:33:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:48 user nova-compute[72773]: INFO nova.virt.block_device [None req-903ce346-511c-43f4-9a11-2b5901d52afe tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Attempting to driver detach volume dcc9ad65-02ad-4a8d-945f-f3bd957201eb from mountpoint /dev/vdb
Aug 16 22:33:49 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-903ce346-511c-43f4-9a11-2b5901d52afe tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Attempting to detach device vdb from instance 848668c7-4a90-4bb4-8617-3784cd33ed22 from the persistent domain config. {{(pid=72773) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-903ce346-511c-43f4-9a11-2b5901d52afe tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:33:49 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:33:49 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 22:33:49 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:33:49 user nova-compute[72773]:   <serial>dcc9ad65-02ad-4a8d-945f-f3bd957201eb</serial>
Aug 16 22:33:49 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:33:49 user nova-compute[72773]: </disk>
Aug 16 22:33:49 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:33:49 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-903ce346-511c-43f4-9a11-2b5901d52afe tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Successfully detached device vdb from instance 848668c7-4a90-4bb4-8617-3784cd33ed22 from the persistent domain config.
Aug 16 22:33:49 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-903ce346-511c-43f4-9a11-2b5901d52afe tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 848668c7-4a90-4bb4-8617-3784cd33ed22 from the live domain config. {{(pid=72773) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-903ce346-511c-43f4-9a11-2b5901d52afe tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:33:49 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:33:49 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 22:33:49 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:33:49 user nova-compute[72773]:   <serial>dcc9ad65-02ad-4a8d-945f-f3bd957201eb</serial>
Aug 16 22:33:49 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:33:49 user nova-compute[72773]: </disk>
Aug 16 22:33:49 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Acquiring lock "848668c7-4a90-4bb4-8617-3784cd33ed22" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Received event <DeviceRemovedEvent: 1692225229.6188085, 848668c7-4a90-4bb4-8617-3784cd33ed22 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72773) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-903ce346-511c-43f4-9a11-2b5901d52afe tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 848668c7-4a90-4bb4-8617-3784cd33ed22 {{(pid=72773) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 22:33:49 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-903ce346-511c-43f4-9a11-2b5901d52afe tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Successfully detached device vdb from instance 848668c7-4a90-4bb4-8617-3784cd33ed22 from the live domain config.
Aug 16 22:33:49 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-903ce346-511c-43f4-9a11-2b5901d52afe tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-903ce346-511c-43f4-9a11-2b5901d52afe tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RCwqnfaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:33:49 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-903ce346-511c-43f4-9a11-2b5901d52afe tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:33:49 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-903ce346-511c-43f4-9a11-2b5901d52afe tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-903ce346-511c-43f4-9a11-2b5901d52afe tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-903ce346-511c-43f4-9a11-2b5901d52afe tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c6bd5a-a96e-4156-a3d2-c157dd367e43]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53f5877-2f1d-431e-b44b-3b2f0e8b1e32]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-903ce346-511c-43f4-9a11-2b5901d52afe tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:33:49 user nova-compute[72773]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb (non-flash)
Aug 16 22:33:49 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-903ce346-511c-43f4-9a11-2b5901d52afe tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:33:49 user nova-compute[72773]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb (non-flash)
Aug 16 22:33:49 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-903ce346-511c-43f4-9a11-2b5901d52afe tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef5c586170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb'): ({'sdc'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-903ce346-511c-43f4-9a11-2b5901d52afe tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Removing single pathed devices sdc {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f08419-cd5b-464f-ab80-9b5f843680a9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6149779-7d64-458c-a002-177de2dc79a5]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-903ce346-511c-43f4-9a11-2b5901d52afe tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Flushing IO for device /dev/sdc {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab73eb6d-8572-414e-b4a6-666366198727]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-903ce346-511c-43f4-9a11-2b5901d52afe tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2c74a5-cdb9-4e0a-90ee-109cb767866e]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-903ce346-511c-43f4-9a11-2b5901d52afe tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-903ce346-511c-43f4-9a11-2b5901d52afe tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-903ce346-511c-43f4-9a11-2b5901d52afe tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b964064-0fec-4857-b879-9e71cc1a3aae]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-903ce346-511c-43f4-9a11-2b5901d52afe tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c862c0-c613-45d9-968c-b70beab0932d]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-903ce346-511c-43f4-9a11-2b5901d52afe tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb, portal: 172.16.0.220,3260]
Aug 16 22:33:49 user nova-compute[72773]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb, portal: 172.16.0.220,3260] successful.
Aug 16 22:33:49 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d4a5c4-265c-4c96-b897-b4b512538f78]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-903ce346-511c-43f4-9a11-2b5901d52afe tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-903ce346-511c-43f4-9a11-2b5901d52afe tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-903ce346-511c-43f4-9a11-2b5901d52afe tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] <== disconnect_volume: return (296ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-903ce346-511c-43f4-9a11-2b5901d52afe tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:33:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:50 user nova-compute[72773]: DEBUG nova.objects.instance [None req-903ce346-511c-43f4-9a11-2b5901d52afe tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lazy-loading 'flavor' on Instance uuid 848668c7-4a90-4bb4-8617-3784cd33ed22 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:33:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-903ce346-511c-43f4-9a11-2b5901d52afe tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "848668c7-4a90-4bb4-8617-3784cd33ed22" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.907s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "848668c7-4a90-4bb4-8617-3784cd33ed22" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.638s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Acquiring lock "848668c7-4a90-4bb4-8617-3784cd33ed22-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "848668c7-4a90-4bb4-8617-3784cd33ed22-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "848668c7-4a90-4bb4-8617-3784cd33ed22-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:50 user nova-compute[72773]: INFO nova.compute.manager [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Terminating instance
Aug 16 22:33:50 user nova-compute[72773]: DEBUG nova.compute.manager [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:33:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG nova.compute.manager [req-80433b32-f81e-4394-a17f-453d60e5d51d req-a5df8a66-82c6-4322-94ee-8ce810b8e3a8 service nova] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Received event network-vif-unplugged-02825371-2104-4f86-9e25-d56da652ddc5 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-80433b32-f81e-4394-a17f-453d60e5d51d req-a5df8a66-82c6-4322-94ee-8ce810b8e3a8 service nova] Acquiring lock "848668c7-4a90-4bb4-8617-3784cd33ed22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-80433b32-f81e-4394-a17f-453d60e5d51d req-a5df8a66-82c6-4322-94ee-8ce810b8e3a8 service nova] Lock "848668c7-4a90-4bb4-8617-3784cd33ed22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-80433b32-f81e-4394-a17f-453d60e5d51d req-a5df8a66-82c6-4322-94ee-8ce810b8e3a8 service nova] Lock "848668c7-4a90-4bb4-8617-3784cd33ed22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG nova.compute.manager [req-80433b32-f81e-4394-a17f-453d60e5d51d req-a5df8a66-82c6-4322-94ee-8ce810b8e3a8 service nova] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] No waiting events found dispatching network-vif-unplugged-02825371-2104-4f86-9e25-d56da652ddc5 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG nova.compute.manager [req-80433b32-f81e-4394-a17f-453d60e5d51d req-a5df8a66-82c6-4322-94ee-8ce810b8e3a8 service nova] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Received event network-vif-unplugged-02825371-2104-4f86-9e25-d56da652ddc5 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Skipping network cache update for instance because it is being deleted. {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9891}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-9ea2a759-7a26-4ad6-9902-b8b75931b5f0" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-9ea2a759-7a26-4ad6-9902-b8b75931b5f0" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:51 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Instance destroyed successfully.
Aug 16 22:33:51 user nova-compute[72773]: DEBUG nova.objects.instance [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lazy-loading 'resources' on Instance uuid 848668c7-4a90-4bb4-8617-3784cd33ed22 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:30:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-108106437',display_name='tempest-VolumesSnapshotTestJSON-instance-108106437',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-108106437',id=18,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCb0J5GkPFnTNXNmtF6HjdInmUPZUlJYxYXE4Bav74MXLOmNGaQo9s0y5EPv6v4jVnGTlYL2IE2J+ZyBLhrtzTDyhA5gx+rRV5wUxh5ffyvO4lQQ2TUMPI2ExaZYTAqwBw==',key_name='tempest-keypair-514968804',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:30:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59b8417e50ee41e89fedf55e7134fecd',ramdisk_id='',reservation_id='r-hxtcr3k7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-671770143',owner_user_name='tempest-VolumesSnapshotTestJSON-671770143-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:30:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='432dc5daebf442fba54be7f62f6bb09c',uuid=848668c7-4a90-4bb4-8617-3784cd33ed22,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02825371-2104-4f86-9e25-d56da652ddc5", "address": "fa:16:3e:fd:62:8e", "network": {"id": "6194759c-ac83-4c8f-8604-c30c22e3ce5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-161254247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b8417e50ee41e89fedf55e7134fecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02825371-21", "ovs_interfaceid": "02825371-2104-4f86-9e25-d56da652ddc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Converting VIF {"id": "02825371-2104-4f86-9e25-d56da652ddc5", "address": "fa:16:3e:fd:62:8e", "network": {"id": "6194759c-ac83-4c8f-8604-c30c22e3ce5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-161254247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b8417e50ee41e89fedf55e7134fecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02825371-21", "ovs_interfaceid": "02825371-2104-4f86-9e25-d56da652ddc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:62:8e,bridge_name='br-int',has_traffic_filtering=True,id=02825371-2104-4f86-9e25-d56da652ddc5,network=Network(6194759c-ac83-4c8f-8604-c30c22e3ce5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02825371-21') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG os_vif [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:62:8e,bridge_name='br-int',has_traffic_filtering=True,id=02825371-2104-4f86-9e25-d56da652ddc5,network=Network(6194759c-ac83-4c8f-8604-c30c22e3ce5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02825371-21') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02825371-21, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:33:51 user nova-compute[72773]: INFO os_vif [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:62:8e,bridge_name='br-int',has_traffic_filtering=True,id=02825371-2104-4f86-9e25-d56da652ddc5,network=Network(6194759c-ac83-4c8f-8604-c30c22e3ce5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02825371-21')
Aug 16 22:33:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RCwqnfaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:33:51 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:33:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcc9ad65-02ad-4a8d-945f-f3bd957201eb', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8457347-8a71-482f-a5bf-0a83e8e9588e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d387199-19db-42d2-a555-0f9bbd628194]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:33:51 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:33:51 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef8040bd00>, {}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Disconnecting from: [] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.065s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] <== disconnect_volume: return (66ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:33:51 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Deleting instance files /opt/stack/data/nova/instances/848668c7-4a90-4bb4-8617-3784cd33ed22_del
Aug 16 22:33:51 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Deletion of /opt/stack/data/nova/instances/848668c7-4a90-4bb4-8617-3784cd33ed22_del complete
Aug 16 22:33:51 user nova-compute[72773]: INFO nova.compute.manager [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Took 1.06 seconds to destroy the instance on the hypervisor.
Aug 16 22:33:51 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:33:51 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:33:52 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Updating instance_info_cache with network_info: [{"id": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "address": "fa:16:3e:e4:b7:3c", "network": {"id": "a18f2224-ffb0-4406-9c92-5dad954c3a2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1329143363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d68c72b1454d78934269042633293f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83003593-cf", "ovs_interfaceid": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:33:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-9ea2a759-7a26-4ad6-9902-b8b75931b5f0" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:33:52 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 22:33:52 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:33:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:52 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:33:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:53 user nova-compute[72773]: DEBUG nova.compute.manager [req-7ef071d6-c817-4232-8d4d-8b811c6c369c req-f939cbf0-48a7-47ae-86f0-6aee72386a10 service nova] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Received event network-vif-plugged-02825371-2104-4f86-9e25-d56da652ddc5 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:33:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-7ef071d6-c817-4232-8d4d-8b811c6c369c req-f939cbf0-48a7-47ae-86f0-6aee72386a10 service nova] Acquiring lock "848668c7-4a90-4bb4-8617-3784cd33ed22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-7ef071d6-c817-4232-8d4d-8b811c6c369c req-f939cbf0-48a7-47ae-86f0-6aee72386a10 service nova] Lock "848668c7-4a90-4bb4-8617-3784cd33ed22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-7ef071d6-c817-4232-8d4d-8b811c6c369c req-f939cbf0-48a7-47ae-86f0-6aee72386a10 service nova] Lock "848668c7-4a90-4bb4-8617-3784cd33ed22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:53 user nova-compute[72773]: DEBUG nova.compute.manager [req-7ef071d6-c817-4232-8d4d-8b811c6c369c req-f939cbf0-48a7-47ae-86f0-6aee72386a10 service nova] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] No waiting events found dispatching network-vif-plugged-02825371-2104-4f86-9e25-d56da652ddc5 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:33:53 user nova-compute[72773]: WARNING nova.compute.manager [req-7ef071d6-c817-4232-8d4d-8b811c6c369c req-f939cbf0-48a7-47ae-86f0-6aee72386a10 service nova] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Received unexpected event network-vif-plugged-02825371-2104-4f86-9e25-d56da652ddc5 for instance with vm_state active and task_state deleting.
Aug 16 22:33:53 user nova-compute[72773]: DEBUG nova.compute.manager [req-7ef071d6-c817-4232-8d4d-8b811c6c369c req-f939cbf0-48a7-47ae-86f0-6aee72386a10 service nova] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Received event network-vif-plugged-02825371-2104-4f86-9e25-d56da652ddc5 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:33:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-7ef071d6-c817-4232-8d4d-8b811c6c369c req-f939cbf0-48a7-47ae-86f0-6aee72386a10 service nova] Acquiring lock "848668c7-4a90-4bb4-8617-3784cd33ed22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-7ef071d6-c817-4232-8d4d-8b811c6c369c req-f939cbf0-48a7-47ae-86f0-6aee72386a10 service nova] Lock "848668c7-4a90-4bb4-8617-3784cd33ed22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-7ef071d6-c817-4232-8d4d-8b811c6c369c req-f939cbf0-48a7-47ae-86f0-6aee72386a10 service nova] Lock "848668c7-4a90-4bb4-8617-3784cd33ed22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:53 user nova-compute[72773]: DEBUG nova.compute.manager [req-7ef071d6-c817-4232-8d4d-8b811c6c369c req-f939cbf0-48a7-47ae-86f0-6aee72386a10 service nova] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] No waiting events found dispatching network-vif-plugged-02825371-2104-4f86-9e25-d56da652ddc5 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:33:53 user nova-compute[72773]: WARNING nova.compute.manager [req-7ef071d6-c817-4232-8d4d-8b811c6c369c req-f939cbf0-48a7-47ae-86f0-6aee72386a10 service nova] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Received unexpected event network-vif-plugged-02825371-2104-4f86-9e25-d56da652ddc5 for instance with vm_state active and task_state deleting.
Aug 16 22:33:53 user nova-compute[72773]: DEBUG nova.compute.manager [req-7ef071d6-c817-4232-8d4d-8b811c6c369c req-f939cbf0-48a7-47ae-86f0-6aee72386a10 service nova] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Received event network-vif-plugged-02825371-2104-4f86-9e25-d56da652ddc5 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:33:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-7ef071d6-c817-4232-8d4d-8b811c6c369c req-f939cbf0-48a7-47ae-86f0-6aee72386a10 service nova] Acquiring lock "848668c7-4a90-4bb4-8617-3784cd33ed22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-7ef071d6-c817-4232-8d4d-8b811c6c369c req-f939cbf0-48a7-47ae-86f0-6aee72386a10 service nova] Lock "848668c7-4a90-4bb4-8617-3784cd33ed22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-7ef071d6-c817-4232-8d4d-8b811c6c369c req-f939cbf0-48a7-47ae-86f0-6aee72386a10 service nova] Lock "848668c7-4a90-4bb4-8617-3784cd33ed22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:53 user nova-compute[72773]: DEBUG nova.compute.manager [req-7ef071d6-c817-4232-8d4d-8b811c6c369c req-f939cbf0-48a7-47ae-86f0-6aee72386a10 service nova] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] No waiting events found dispatching network-vif-plugged-02825371-2104-4f86-9e25-d56da652ddc5 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:33:53 user nova-compute[72773]: WARNING nova.compute.manager [req-7ef071d6-c817-4232-8d4d-8b811c6c369c req-f939cbf0-48a7-47ae-86f0-6aee72386a10 service nova] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Received unexpected event network-vif-plugged-02825371-2104-4f86-9e25-d56da652ddc5 for instance with vm_state active and task_state deleting.
Aug 16 22:33:53 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:33:53 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:33:53 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Took 2.09 seconds to deallocate network for instance.
Aug 16 22:33:53 user nova-compute[72773]: WARNING nova.volume.cinder [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Attachment 7ebf32b4-7a53-41d8-b5ea-1ae5c50a65b6 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 7ebf32b4-7a53-41d8-b5ea-1ae5c50a65b6. (HTTP 404) (Request-ID: req-6d370aa8-3725-486e-bd0a-abdec313a4c3)
Aug 16 22:33:53 user nova-compute[72773]: INFO nova.compute.manager [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Took 0.03 seconds to detach 1 volumes for instance.
Aug 16 22:33:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:54 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:33:54 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:33:54 user nova-compute[72773]: INFO nova.compute.manager [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Rescuing
Aug 16 22:33:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "refresh_cache-cf01c401-c424-4b3e-aa5b-439d62b1ae4c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:33:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquired lock "refresh_cache-cf01c401-c424-4b3e-aa5b-439d62b1ae4c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:33:54 user nova-compute[72773]: DEBUG nova.network.neutron [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:33:54 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:33:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.460s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:54 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Deleted allocations for instance 848668c7-4a90-4bb4-8617-3784cd33ed22
Aug 16 22:33:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-90043891-e795-484b-a891-0c46d4c7f9a9 tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "848668c7-4a90-4bb4-8617-3784cd33ed22" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.863s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:54 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:55 user nova-compute[72773]: DEBUG nova.compute.manager [req-73692abd-c688-4172-9503-54333a3e9aed req-d7e95600-3aa4-4fd6-b125-f2df65014c56 service nova] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Received event network-vif-unplugged-02825371-2104-4f86-9e25-d56da652ddc5 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:33:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-73692abd-c688-4172-9503-54333a3e9aed req-d7e95600-3aa4-4fd6-b125-f2df65014c56 service nova] Acquiring lock "848668c7-4a90-4bb4-8617-3784cd33ed22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-73692abd-c688-4172-9503-54333a3e9aed req-d7e95600-3aa4-4fd6-b125-f2df65014c56 service nova] Lock "848668c7-4a90-4bb4-8617-3784cd33ed22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-73692abd-c688-4172-9503-54333a3e9aed req-d7e95600-3aa4-4fd6-b125-f2df65014c56 service nova] Lock "848668c7-4a90-4bb4-8617-3784cd33ed22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:55 user nova-compute[72773]: DEBUG nova.compute.manager [req-73692abd-c688-4172-9503-54333a3e9aed req-d7e95600-3aa4-4fd6-b125-f2df65014c56 service nova] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] No waiting events found dispatching network-vif-unplugged-02825371-2104-4f86-9e25-d56da652ddc5 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:33:55 user nova-compute[72773]: WARNING nova.compute.manager [req-73692abd-c688-4172-9503-54333a3e9aed req-d7e95600-3aa4-4fd6-b125-f2df65014c56 service nova] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Received unexpected event network-vif-unplugged-02825371-2104-4f86-9e25-d56da652ddc5 for instance with vm_state deleted and task_state None.
Aug 16 22:33:55 user nova-compute[72773]: DEBUG nova.compute.manager [req-73692abd-c688-4172-9503-54333a3e9aed req-d7e95600-3aa4-4fd6-b125-f2df65014c56 service nova] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Received event network-vif-plugged-02825371-2104-4f86-9e25-d56da652ddc5 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:33:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-73692abd-c688-4172-9503-54333a3e9aed req-d7e95600-3aa4-4fd6-b125-f2df65014c56 service nova] Acquiring lock "848668c7-4a90-4bb4-8617-3784cd33ed22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-73692abd-c688-4172-9503-54333a3e9aed req-d7e95600-3aa4-4fd6-b125-f2df65014c56 service nova] Lock "848668c7-4a90-4bb4-8617-3784cd33ed22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-73692abd-c688-4172-9503-54333a3e9aed req-d7e95600-3aa4-4fd6-b125-f2df65014c56 service nova] Lock "848668c7-4a90-4bb4-8617-3784cd33ed22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:55 user nova-compute[72773]: DEBUG nova.compute.manager [req-73692abd-c688-4172-9503-54333a3e9aed req-d7e95600-3aa4-4fd6-b125-f2df65014c56 service nova] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] No waiting events found dispatching network-vif-plugged-02825371-2104-4f86-9e25-d56da652ddc5 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:33:55 user nova-compute[72773]: WARNING nova.compute.manager [req-73692abd-c688-4172-9503-54333a3e9aed req-d7e95600-3aa4-4fd6-b125-f2df65014c56 service nova] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Received unexpected event network-vif-plugged-02825371-2104-4f86-9e25-d56da652ddc5 for instance with vm_state deleted and task_state None.
Aug 16 22:33:55 user nova-compute[72773]: DEBUG nova.compute.manager [req-73692abd-c688-4172-9503-54333a3e9aed req-d7e95600-3aa4-4fd6-b125-f2df65014c56 service nova] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Received event network-vif-deleted-02825371-2104-4f86-9e25-d56da652ddc5 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:33:55 user nova-compute[72773]: DEBUG nova.network.neutron [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Updating instance_info_cache with network_info: [{"id": "96243341-8834-4a23-9bf3-964374e14014", "address": "fa:16:3e:c6:b4:53", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96243341-88", "ovs_interfaceid": "96243341-8834-4a23-9bf3-964374e14014", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:33:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Releasing lock "refresh_cache-cf01c401-c424-4b3e-aa5b-439d62b1ae4c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:33:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:55 user nova-compute[72773]: DEBUG nova.compute.manager [req-a9e35a21-0419-4998-88bd-56f6cfedbda0 req-7712d76a-1abf-4b86-8285-d1200c8f6503 service nova] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Received event network-vif-unplugged-96243341-8834-4a23-9bf3-964374e14014 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:33:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a9e35a21-0419-4998-88bd-56f6cfedbda0 req-7712d76a-1abf-4b86-8285-d1200c8f6503 service nova] Acquiring lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a9e35a21-0419-4998-88bd-56f6cfedbda0 req-7712d76a-1abf-4b86-8285-d1200c8f6503 service nova] Lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a9e35a21-0419-4998-88bd-56f6cfedbda0 req-7712d76a-1abf-4b86-8285-d1200c8f6503 service nova] Lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:55 user nova-compute[72773]: DEBUG nova.compute.manager [req-a9e35a21-0419-4998-88bd-56f6cfedbda0 req-7712d76a-1abf-4b86-8285-d1200c8f6503 service nova] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] No waiting events found dispatching network-vif-unplugged-96243341-8834-4a23-9bf3-964374e14014 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:33:55 user nova-compute[72773]: WARNING nova.compute.manager [req-a9e35a21-0419-4998-88bd-56f6cfedbda0 req-7712d76a-1abf-4b86-8285-d1200c8f6503 service nova] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Received unexpected event network-vif-unplugged-96243341-8834-4a23-9bf3-964374e14014 for instance with vm_state active and task_state rescuing.
Aug 16 22:33:55 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Instance destroyed successfully.
Aug 16 22:33:55 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Attempting rescue
Aug 16 22:33:55 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72773) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 22:33:55 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Instance directory exists: not creating {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 22:33:55 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Creating image(s)
Aug 16 22:33:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "/opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "/opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:55 user nova-compute[72773]: DEBUG nova.objects.instance [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lazy-loading 'trusted_certs' on Instance uuid cf01c401-c424-4b3e-aa5b-439d62b1ae4c {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:33:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.189s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue" returned: 0 in 0.078s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG nova.objects.instance [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lazy-loading 'migration_context' on Instance uuid cf01c401-c424-4b3e-aa5b-439d62b1ae4c {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Start _get_guest_xml network_info=[{"id": "96243341-8834-4a23-9bf3-964374e14014", "address": "fa:16:3e:c6:b4:53", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "vif_mac": "fa:16:3e:c6:b4:53"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96243341-88", "ovs_interfaceid": "96243341-8834-4a23-9bf3-964374e14014", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG nova.objects.instance [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lazy-loading 'resources' on Instance uuid cf01c401-c424-4b3e-aa5b-439d62b1ae4c {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG nova.objects.instance [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lazy-loading 'numa_topology' on Instance uuid cf01c401-c424-4b3e-aa5b-439d62b1ae4c {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:33:56 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:33:56 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:33:56 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG nova.objects.instance [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lazy-loading 'vcpu_model' on Instance uuid cf01c401-c424-4b3e-aa5b-439d62b1ae4c {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:32:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1457796534',display_name='tempest-ServerRescueNegativeTestJSON-server-1457796534',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1457796534',id=22,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:32:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f8e068df8094356b16a6480cd231675',ramdisk_id='',reservation_id='r-erb87mkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1754829282',owner_user_name='tempest-ServerRescueNegativeTestJSON-1754829282-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:32:13Z,user_data=None,user_id='62e5b77a149140fd8613d566f41cc23d',uuid=cf01c401-c424-4b3e-aa5b-439d62b1ae4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96243341-8834-4a23-9bf3-964374e14014", "address": "fa:16:3e:c6:b4:53", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "vif_mac": "fa:16:3e:c6:b4:53"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96243341-88", "ovs_interfaceid": "96243341-8834-4a23-9bf3-964374e14014", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Converting VIF {"id": "96243341-8834-4a23-9bf3-964374e14014", "address": "fa:16:3e:c6:b4:53", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "vif_mac": "fa:16:3e:c6:b4:53"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96243341-88", "ovs_interfaceid": "96243341-8834-4a23-9bf3-964374e14014", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:b4:53,bridge_name='br-int',has_traffic_filtering=True,id=96243341-8834-4a23-9bf3-964374e14014,network=Network(8a43bbad-aab2-44c9-a7e4-62696d908234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96243341-88') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG nova.objects.instance [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lazy-loading 'pci_devices' on Instance uuid cf01c401-c424-4b3e-aa5b-439d62b1ae4c {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:33:56 user nova-compute[72773]:   <uuid>cf01c401-c424-4b3e-aa5b-439d62b1ae4c</uuid>
Aug 16 22:33:56 user nova-compute[72773]:   <name>instance-00000016</name>
Aug 16 22:33:56 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:33:56 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:33:56 user nova-compute[72773]:   <metadata>
Aug 16 22:33:56 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:33:56 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:33:56 user nova-compute[72773]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1457796534</nova:name>
Aug 16 22:33:56 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:33:56</nova:creationTime>
Aug 16 22:33:56 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:33:56 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:33:56 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:33:56 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:33:56 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:33:56 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:33:56 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:33:56 user nova-compute[72773]:       <nova:owner>
Aug 16 22:33:56 user nova-compute[72773]:         <nova:user uuid="62e5b77a149140fd8613d566f41cc23d">tempest-ServerRescueNegativeTestJSON-1754829282-project-member</nova:user>
Aug 16 22:33:56 user nova-compute[72773]:         <nova:project uuid="0f8e068df8094356b16a6480cd231675">tempest-ServerRescueNegativeTestJSON-1754829282</nova:project>
Aug 16 22:33:56 user nova-compute[72773]:       </nova:owner>
Aug 16 22:33:56 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:33:56 user nova-compute[72773]:       <nova:ports>
Aug 16 22:33:56 user nova-compute[72773]:         <nova:port uuid="96243341-8834-4a23-9bf3-964374e14014">
Aug 16 22:33:56 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 22:33:56 user nova-compute[72773]:         </nova:port>
Aug 16 22:33:56 user nova-compute[72773]:       </nova:ports>
Aug 16 22:33:56 user nova-compute[72773]:     </nova:instance>
Aug 16 22:33:56 user nova-compute[72773]:   </metadata>
Aug 16 22:33:56 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:33:56 user nova-compute[72773]:     <system>
Aug 16 22:33:56 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:33:56 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:33:56 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:33:56 user nova-compute[72773]:       <entry name="serial">cf01c401-c424-4b3e-aa5b-439d62b1ae4c</entry>
Aug 16 22:33:56 user nova-compute[72773]:       <entry name="uuid">cf01c401-c424-4b3e-aa5b-439d62b1ae4c</entry>
Aug 16 22:33:56 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:33:56 user nova-compute[72773]:     </system>
Aug 16 22:33:56 user nova-compute[72773]:   </sysinfo>
Aug 16 22:33:56 user nova-compute[72773]:   <os>
Aug 16 22:33:56 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:33:56 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:33:56 user nova-compute[72773]:   </os>
Aug 16 22:33:56 user nova-compute[72773]:   <features>
Aug 16 22:33:56 user nova-compute[72773]:     <acpi/>
Aug 16 22:33:56 user nova-compute[72773]:     <apic/>
Aug 16 22:33:56 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:33:56 user nova-compute[72773]:   </features>
Aug 16 22:33:56 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:33:56 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:33:56 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:33:56 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:33:56 user nova-compute[72773]:   </clock>
Aug 16 22:33:56 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:33:56 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:33:56 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:33:56 user nova-compute[72773]:   </cpu>
Aug 16 22:33:56 user nova-compute[72773]:   <devices>
Aug 16 22:33:56 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:33:56 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:33:56 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue"/>
Aug 16 22:33:56 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:33:56 user nova-compute[72773]:     </disk>
Aug 16 22:33:56 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:33:56 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:33:56 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk"/>
Aug 16 22:33:56 user nova-compute[72773]:       <target dev="vdb" bus="virtio"/>
Aug 16 22:33:56 user nova-compute[72773]:     </disk>
Aug 16 22:33:56 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:33:56 user nova-compute[72773]:       <mac address="fa:16:3e:c6:b4:53"/>
Aug 16 22:33:56 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:33:56 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:33:56 user nova-compute[72773]:       <target dev="tap96243341-88"/>
Aug 16 22:33:56 user nova-compute[72773]:     </interface>
Aug 16 22:33:56 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:33:56 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/console.log" append="off"/>
Aug 16 22:33:56 user nova-compute[72773]:     </serial>
Aug 16 22:33:56 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:33:56 user nova-compute[72773]:     <video>
Aug 16 22:33:56 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:33:56 user nova-compute[72773]:     </video>
Aug 16 22:33:56 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:33:56 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:33:56 user nova-compute[72773]:     </rng>
Aug 16 22:33:56 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:33:56 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:33:56 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:33:56 user nova-compute[72773]:     </memballoon>
Aug 16 22:33:56 user nova-compute[72773]:   </devices>
Aug 16 22:33:56 user nova-compute[72773]: </domain>
Aug 16 22:33:56 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:33:56 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Instance destroyed successfully.
Aug 16 22:33:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] No VIF found with MAC fa:16:3e:c6:b4:53, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:33:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:57 user nova-compute[72773]: DEBUG nova.compute.manager [req-faa98f07-bbf9-44d9-b44c-fe64507622f1 req-5a9a09b0-163a-4d26-8908-7553fdedc735 service nova] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Received event network-vif-plugged-96243341-8834-4a23-9bf3-964374e14014 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:33:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-faa98f07-bbf9-44d9-b44c-fe64507622f1 req-5a9a09b0-163a-4d26-8908-7553fdedc735 service nova] Acquiring lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-faa98f07-bbf9-44d9-b44c-fe64507622f1 req-5a9a09b0-163a-4d26-8908-7553fdedc735 service nova] Lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-faa98f07-bbf9-44d9-b44c-fe64507622f1 req-5a9a09b0-163a-4d26-8908-7553fdedc735 service nova] Lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:57 user nova-compute[72773]: DEBUG nova.compute.manager [req-faa98f07-bbf9-44d9-b44c-fe64507622f1 req-5a9a09b0-163a-4d26-8908-7553fdedc735 service nova] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] No waiting events found dispatching network-vif-plugged-96243341-8834-4a23-9bf3-964374e14014 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:33:57 user nova-compute[72773]: WARNING nova.compute.manager [req-faa98f07-bbf9-44d9-b44c-fe64507622f1 req-5a9a09b0-163a-4d26-8908-7553fdedc735 service nova] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Received unexpected event network-vif-plugged-96243341-8834-4a23-9bf3-964374e14014 for instance with vm_state active and task_state rescuing.
Aug 16 22:33:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:33:58 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:58 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:58 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:58 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:58 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json" returned: 0 in 0.237s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:33:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:33:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:33:59 user nova-compute[72773]: DEBUG nova.compute.manager [req-19796001-7ac7-43f4-b37b-1d8fec220e0d req-35044151-65ff-4796-96e0-50c7240e67f7 service nova] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Received event network-vif-plugged-96243341-8834-4a23-9bf3-964374e14014 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:33:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-19796001-7ac7-43f4-b37b-1d8fec220e0d req-35044151-65ff-4796-96e0-50c7240e67f7 service nova] Acquiring lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-19796001-7ac7-43f4-b37b-1d8fec220e0d req-35044151-65ff-4796-96e0-50c7240e67f7 service nova] Lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-19796001-7ac7-43f4-b37b-1d8fec220e0d req-35044151-65ff-4796-96e0-50c7240e67f7 service nova] Lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:59 user nova-compute[72773]: DEBUG nova.compute.manager [req-19796001-7ac7-43f4-b37b-1d8fec220e0d req-35044151-65ff-4796-96e0-50c7240e67f7 service nova] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] No waiting events found dispatching network-vif-plugged-96243341-8834-4a23-9bf3-964374e14014 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:33:59 user nova-compute[72773]: WARNING nova.compute.manager [req-19796001-7ac7-43f4-b37b-1d8fec220e0d req-35044151-65ff-4796-96e0-50c7240e67f7 service nova] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Received unexpected event network-vif-plugged-96243341-8834-4a23-9bf3-964374e14014 for instance with vm_state active and task_state rescuing.
Aug 16 22:33:59 user nova-compute[72773]: DEBUG nova.compute.manager [req-19796001-7ac7-43f4-b37b-1d8fec220e0d req-35044151-65ff-4796-96e0-50c7240e67f7 service nova] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Received event network-vif-plugged-96243341-8834-4a23-9bf3-964374e14014 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:33:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-19796001-7ac7-43f4-b37b-1d8fec220e0d req-35044151-65ff-4796-96e0-50c7240e67f7 service nova] Acquiring lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:33:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-19796001-7ac7-43f4-b37b-1d8fec220e0d req-35044151-65ff-4796-96e0-50c7240e67f7 service nova] Lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:33:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-19796001-7ac7-43f4-b37b-1d8fec220e0d req-35044151-65ff-4796-96e0-50c7240e67f7 service nova] Lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:33:59 user nova-compute[72773]: DEBUG nova.compute.manager [req-19796001-7ac7-43f4-b37b-1d8fec220e0d req-35044151-65ff-4796-96e0-50c7240e67f7 service nova] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] No waiting events found dispatching network-vif-plugged-96243341-8834-4a23-9bf3-964374e14014 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:33:59 user nova-compute[72773]: WARNING nova.compute.manager [req-19796001-7ac7-43f4-b37b-1d8fec220e0d req-35044151-65ff-4796-96e0-50c7240e67f7 service nova] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Received unexpected event network-vif-plugged-96243341-8834-4a23-9bf3-964374e14014 for instance with vm_state active and task_state rescuing.
Aug 16 22:33:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9259e07-3d7f-4169-96fc-b080b4b9ce6a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:00 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Removed pending event for cf01c401-c424-4b3e-aa5b-439d62b1ae4c due to event {{(pid=72773) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 22:34:00 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225240.2585754, cf01c401-c424-4b3e-aa5b-439d62b1ae4c => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:34:00 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] VM Resumed (Lifecycle Event)
Aug 16 22:34:00 user nova-compute[72773]: DEBUG nova.compute.manager [None req-1b76cfcd-2c9b-44ed-83e8-7723bf9053b4 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:34:00 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:34:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9259e07-3d7f-4169-96fc-b080b4b9ce6a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9259e07-3d7f-4169-96fc-b080b4b9ce6a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:00 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:34:00 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 22:34:00 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225240.2598605, cf01c401-c424-4b3e-aa5b-439d62b1ae4c => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:34:00 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] VM Started (Lifecycle Event)
Aug 16 22:34:00 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:34:00 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:34:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9259e07-3d7f-4169-96fc-b080b4b9ce6a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66ff126-5cbb-4e39-8867-9f5c1538cf91/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66ff126-5cbb-4e39-8867-9f5c1538cf91/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66ff126-5cbb-4e39-8867-9f5c1538cf91/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66ff126-5cbb-4e39-8867-9f5c1538cf91/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-40cf04c0-a793-4f85-8683-e15f37f55c30 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Acquiring lock "b66ff126-5cbb-4e39-8867-9f5c1538cf91" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:34:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-40cf04c0-a793-4f85-8683-e15f37f55c30 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lock "b66ff126-5cbb-4e39-8867-9f5c1538cf91" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:34:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-40cf04c0-a793-4f85-8683-e15f37f55c30 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Acquiring lock "b66ff126-5cbb-4e39-8867-9f5c1538cf91-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:34:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-40cf04c0-a793-4f85-8683-e15f37f55c30 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lock "b66ff126-5cbb-4e39-8867-9f5c1538cf91-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:34:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-40cf04c0-a793-4f85-8683-e15f37f55c30 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lock "b66ff126-5cbb-4e39-8867-9f5c1538cf91-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:34:01 user nova-compute[72773]: INFO nova.compute.manager [None req-40cf04c0-a793-4f85-8683-e15f37f55c30 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Terminating instance
Aug 16 22:34:01 user nova-compute[72773]: DEBUG nova.compute.manager [None req-40cf04c0-a793-4f85-8683-e15f37f55c30 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:34:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:02 user nova-compute[72773]: DEBUG nova.compute.manager [req-78852c52-2877-4f0a-adea-af395281adb2 req-2c526c5e-8d5c-4815-bb41-ea5adbffa141 service nova] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Received event network-vif-unplugged-98ad4609-c2b4-4836-ab03-0d3e3b736fce {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:34:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-78852c52-2877-4f0a-adea-af395281adb2 req-2c526c5e-8d5c-4815-bb41-ea5adbffa141 service nova] Acquiring lock "b66ff126-5cbb-4e39-8867-9f5c1538cf91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:34:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-78852c52-2877-4f0a-adea-af395281adb2 req-2c526c5e-8d5c-4815-bb41-ea5adbffa141 service nova] Lock "b66ff126-5cbb-4e39-8867-9f5c1538cf91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:34:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-78852c52-2877-4f0a-adea-af395281adb2 req-2c526c5e-8d5c-4815-bb41-ea5adbffa141 service nova] Lock "b66ff126-5cbb-4e39-8867-9f5c1538cf91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:34:02 user nova-compute[72773]: DEBUG nova.compute.manager [req-78852c52-2877-4f0a-adea-af395281adb2 req-2c526c5e-8d5c-4815-bb41-ea5adbffa141 service nova] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] No waiting events found dispatching network-vif-unplugged-98ad4609-c2b4-4836-ab03-0d3e3b736fce {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:34:02 user nova-compute[72773]: DEBUG nova.compute.manager [req-78852c52-2877-4f0a-adea-af395281adb2 req-2c526c5e-8d5c-4815-bb41-ea5adbffa141 service nova] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Received event network-vif-unplugged-98ad4609-c2b4-4836-ab03-0d3e3b736fce for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:34:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:02 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Instance destroyed successfully.
Aug 16 22:34:02 user nova-compute[72773]: DEBUG nova.objects.instance [None req-40cf04c0-a793-4f85-8683-e15f37f55c30 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lazy-loading 'resources' on Instance uuid b66ff126-5cbb-4e39-8867-9f5c1538cf91 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:34:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-40cf04c0-a793-4f85-8683-e15f37f55c30 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:32:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2117739987',display_name='tempest-VolumesActionsTest-instance-2117739987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2117739987',id=23,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:32:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9fc5a319bbe5472b84c6fa3373d5c6e8',ramdisk_id='',reservation_id='r-hvlmpl40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1300049092',owner_user_name='tempest-VolumesActionsTest-1300049092-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:32:18Z,user_data=None,user_id='72a395fc29094394bbbe0411cbd4ccfc',uuid=b66ff126-5cbb-4e39-8867-9f5c1538cf91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98ad4609-c2b4-4836-ab03-0d3e3b736fce", "address": "fa:16:3e:1e:7d:35", "network": {"id": "5cde2c8a-cc09-442d-b474-eb3cd32efbf1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1685780614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc5a319bbe5472b84c6fa3373d5c6e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ad4609-c2", "ovs_interfaceid": "98ad4609-c2b4-4836-ab03-0d3e3b736fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:34:02 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-40cf04c0-a793-4f85-8683-e15f37f55c30 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Converting VIF {"id": "98ad4609-c2b4-4836-ab03-0d3e3b736fce", "address": "fa:16:3e:1e:7d:35", "network": {"id": "5cde2c8a-cc09-442d-b474-eb3cd32efbf1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1685780614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc5a319bbe5472b84c6fa3373d5c6e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ad4609-c2", "ovs_interfaceid": "98ad4609-c2b4-4836-ab03-0d3e3b736fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:34:02 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-40cf04c0-a793-4f85-8683-e15f37f55c30 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:7d:35,bridge_name='br-int',has_traffic_filtering=True,id=98ad4609-c2b4-4836-ab03-0d3e3b736fce,network=Network(5cde2c8a-cc09-442d-b474-eb3cd32efbf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98ad4609-c2') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:34:02 user nova-compute[72773]: DEBUG os_vif [None req-40cf04c0-a793-4f85-8683-e15f37f55c30 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:7d:35,bridge_name='br-int',has_traffic_filtering=True,id=98ad4609-c2b4-4836-ab03-0d3e3b736fce,network=Network(5cde2c8a-cc09-442d-b474-eb3cd32efbf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98ad4609-c2') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:34:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98ad4609-c2, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:34:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:34:02 user nova-compute[72773]: INFO os_vif [None req-40cf04c0-a793-4f85-8683-e15f37f55c30 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:7d:35,bridge_name='br-int',has_traffic_filtering=True,id=98ad4609-c2b4-4836-ab03-0d3e3b736fce,network=Network(5cde2c8a-cc09-442d-b474-eb3cd32efbf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98ad4609-c2')
Aug 16 22:34:02 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-40cf04c0-a793-4f85-8683-e15f37f55c30 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Deleting instance files /opt/stack/data/nova/instances/b66ff126-5cbb-4e39-8867-9f5c1538cf91_del
Aug 16 22:34:02 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-40cf04c0-a793-4f85-8683-e15f37f55c30 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Deletion of /opt/stack/data/nova/instances/b66ff126-5cbb-4e39-8867-9f5c1538cf91_del complete
Aug 16 22:34:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da5bbc3-b0f9-48d1-be93-86e63e4963c2/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:02 user nova-compute[72773]: INFO nova.compute.manager [None req-40cf04c0-a793-4f85-8683-e15f37f55c30 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Took 1.03 seconds to destroy the instance on the hypervisor.
Aug 16 22:34:02 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-40cf04c0-a793-4f85-8683-e15f37f55c30 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:34:02 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:34:02 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:34:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da5bbc3-b0f9-48d1-be93-86e63e4963c2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da5bbc3-b0f9-48d1-be93-86e63e4963c2/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da5bbc3-b0f9-48d1-be93-86e63e4963c2/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:03 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:34:03 user nova-compute[72773]: DEBUG nova.compute.manager [req-ca09aef9-9ea7-4fd4-8267-fd8f976bf0e8 req-1526d48a-a38b-42ff-80fb-f0af3951df56 service nova] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Received event network-vif-deleted-98ad4609-c2b4-4836-ab03-0d3e3b736fce {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:34:03 user nova-compute[72773]: INFO nova.compute.manager [req-ca09aef9-9ea7-4fd4-8267-fd8f976bf0e8 req-1526d48a-a38b-42ff-80fb-f0af3951df56 service nova] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Neutron deleted interface 98ad4609-c2b4-4836-ab03-0d3e3b736fce; detaching it from the instance and deleting it from the info cache
Aug 16 22:34:03 user nova-compute[72773]: DEBUG nova.network.neutron [req-ca09aef9-9ea7-4fd4-8267-fd8f976bf0e8 req-1526d48a-a38b-42ff-80fb-f0af3951df56 service nova] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:34:03 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Took 0.68 seconds to deallocate network for instance.
Aug 16 22:34:03 user nova-compute[72773]: DEBUG nova.compute.manager [req-ca09aef9-9ea7-4fd4-8267-fd8f976bf0e8 req-1526d48a-a38b-42ff-80fb-f0af3951df56 service nova] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Detach interface failed, port_id=98ad4609-c2b4-4836-ab03-0d3e3b736fce, reason: Instance b66ff126-5cbb-4e39-8867-9f5c1538cf91 could not be found. {{(pid=72773) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 22:34:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-40cf04c0-a793-4f85-8683-e15f37f55c30 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:34:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-40cf04c0-a793-4f85-8683-e15f37f55c30 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:34:03 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:34:03 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:34:03 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=6909MB free_disk=25.484771728515625GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:34:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:34:04 user nova-compute[72773]: DEBUG nova.compute.manager [req-01796313-6008-4cb7-9737-d11ae918c4d9 req-11c32197-48d5-4bde-8573-91206d3d8986 service nova] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Received event network-vif-plugged-98ad4609-c2b4-4836-ab03-0d3e3b736fce {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:34:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-01796313-6008-4cb7-9737-d11ae918c4d9 req-11c32197-48d5-4bde-8573-91206d3d8986 service nova] Acquiring lock "b66ff126-5cbb-4e39-8867-9f5c1538cf91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:34:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-01796313-6008-4cb7-9737-d11ae918c4d9 req-11c32197-48d5-4bde-8573-91206d3d8986 service nova] Lock "b66ff126-5cbb-4e39-8867-9f5c1538cf91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:34:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-01796313-6008-4cb7-9737-d11ae918c4d9 req-11c32197-48d5-4bde-8573-91206d3d8986 service nova] Lock "b66ff126-5cbb-4e39-8867-9f5c1538cf91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:34:04 user nova-compute[72773]: DEBUG nova.compute.manager [req-01796313-6008-4cb7-9737-d11ae918c4d9 req-11c32197-48d5-4bde-8573-91206d3d8986 service nova] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] No waiting events found dispatching network-vif-plugged-98ad4609-c2b4-4836-ab03-0d3e3b736fce {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:34:04 user nova-compute[72773]: WARNING nova.compute.manager [req-01796313-6008-4cb7-9737-d11ae918c4d9 req-11c32197-48d5-4bde-8573-91206d3d8986 service nova] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Received unexpected event network-vif-plugged-98ad4609-c2b4-4836-ab03-0d3e3b736fce for instance with vm_state deleted and task_state None.
Aug 16 22:34:04 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-40cf04c0-a793-4f85-8683-e15f37f55c30 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:34:04 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-40cf04c0-a793-4f85-8683-e15f37f55c30 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:34:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-40cf04c0-a793-4f85-8683-e15f37f55c30 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.892s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:34:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.362s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:34:04 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-40cf04c0-a793-4f85-8683-e15f37f55c30 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Deleted allocations for instance b66ff126-5cbb-4e39-8867-9f5c1538cf91
Aug 16 22:34:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-40cf04c0-a793-4f85-8683-e15f37f55c30 tempest-VolumesActionsTest-1300049092 tempest-VolumesActionsTest-1300049092-project-member] Lock "b66ff126-5cbb-4e39-8867-9f5c1538cf91" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.810s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:34:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 956d334e-f190-4625-b144-ab44d2f3321a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:34:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 030d076d-5099-4236-ae31-6025017eb51e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:34:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 9ea2a759-7a26-4ad6-9902-b8b75931b5f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:34:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance ac2b49e4-59bc-46cd-b7d9-67aa68296e4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:34:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 391a6006-4fe6-4398-a1e8-ae95b5edbf2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:34:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance cf01c401-c424-4b3e-aa5b-439d62b1ae4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:34:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance e9259e07-3d7f-4169-96fc-b080b4b9ce6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:34:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 63644e8f-95d4-43a7-a824-8845dd073423 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:34:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 23894101-2fd3-41a4-83a3-8f6869d24d97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:34:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 9da5bbc3-b0f9-48d1-be93-86e63e4963c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:34:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 5ebcd117-6765-44eb-871b-226afd58e4e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:34:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:34:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:34:04 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:34:04 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:34:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:34:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.626s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:34:04 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:06 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692225231.5955553, 848668c7-4a90-4bb4-8617-3784cd33ed22 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:34:06 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] VM Stopped (Lifecycle Event)
Aug 16 22:34:06 user nova-compute[72773]: DEBUG nova.compute.manager [None req-16e5254d-e096-4b26-8e5c-ac4cfa23e69f None None] [instance: 848668c7-4a90-4bb4-8617-3784cd33ed22] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:34:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:34:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:34:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 22:34:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:34:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:34:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:16 user nova-compute[72773]: DEBUG nova.compute.manager [req-b1ebb4ca-f765-41e8-b825-b53708dec7bd req-cca3748e-1486-4090-ba1e-ca2ec69f0e0c service nova] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Received event network-changed-3dd11c55-5b19-4376-954d-bb0339a28f07 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:34:16 user nova-compute[72773]: DEBUG nova.compute.manager [req-b1ebb4ca-f765-41e8-b825-b53708dec7bd req-cca3748e-1486-4090-ba1e-ca2ec69f0e0c service nova] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Refreshing instance network info cache due to event network-changed-3dd11c55-5b19-4376-954d-bb0339a28f07. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:34:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b1ebb4ca-f765-41e8-b825-b53708dec7bd req-cca3748e-1486-4090-ba1e-ca2ec69f0e0c service nova] Acquiring lock "refresh_cache-e9259e07-3d7f-4169-96fc-b080b4b9ce6a" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:34:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b1ebb4ca-f765-41e8-b825-b53708dec7bd req-cca3748e-1486-4090-ba1e-ca2ec69f0e0c service nova] Acquired lock "refresh_cache-e9259e07-3d7f-4169-96fc-b080b4b9ce6a" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:34:16 user nova-compute[72773]: DEBUG nova.network.neutron [req-b1ebb4ca-f765-41e8-b825-b53708dec7bd req-cca3748e-1486-4090-ba1e-ca2ec69f0e0c service nova] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Refreshing network info cache for port 3dd11c55-5b19-4376-954d-bb0339a28f07 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:34:17 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692225242.4276526, b66ff126-5cbb-4e39-8867-9f5c1538cf91 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:34:17 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] VM Stopped (Lifecycle Event)
Aug 16 22:34:17 user nova-compute[72773]: DEBUG nova.compute.manager [None req-4278edc1-1057-4483-9a03-a32398dbdebb None None] [instance: b66ff126-5cbb-4e39-8867-9f5c1538cf91] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:34:17 user nova-compute[72773]: DEBUG nova.network.neutron [req-b1ebb4ca-f765-41e8-b825-b53708dec7bd req-cca3748e-1486-4090-ba1e-ca2ec69f0e0c service nova] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Updated VIF entry in instance network info cache for port 3dd11c55-5b19-4376-954d-bb0339a28f07. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:34:17 user nova-compute[72773]: DEBUG nova.network.neutron [req-b1ebb4ca-f765-41e8-b825-b53708dec7bd req-cca3748e-1486-4090-ba1e-ca2ec69f0e0c service nova] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Updating instance_info_cache with network_info: [{"id": "3dd11c55-5b19-4376-954d-bb0339a28f07", "address": "fa:16:3e:92:99:c6", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd11c55-5b", "ovs_interfaceid": "3dd11c55-5b19-4376-954d-bb0339a28f07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:34:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b1ebb4ca-f765-41e8-b825-b53708dec7bd req-cca3748e-1486-4090-ba1e-ca2ec69f0e0c service nova] Releasing lock "refresh_cache-e9259e07-3d7f-4169-96fc-b080b4b9ce6a" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:34:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-4b737bd8-16be-445c-abbf-4f95492273a9 req-54cdb46b-7d29-4153-90cf-77f07be7fd5c service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Received event network-changed-eae4e0ec-3105-463d-9c92-0e2f63192bb6 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:34:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-4b737bd8-16be-445c-abbf-4f95492273a9 req-54cdb46b-7d29-4153-90cf-77f07be7fd5c service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Refreshing instance network info cache due to event network-changed-eae4e0ec-3105-463d-9c92-0e2f63192bb6. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:34:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4b737bd8-16be-445c-abbf-4f95492273a9 req-54cdb46b-7d29-4153-90cf-77f07be7fd5c service nova] Acquiring lock "refresh_cache-63644e8f-95d4-43a7-a824-8845dd073423" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:34:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4b737bd8-16be-445c-abbf-4f95492273a9 req-54cdb46b-7d29-4153-90cf-77f07be7fd5c service nova] Acquired lock "refresh_cache-63644e8f-95d4-43a7-a824-8845dd073423" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:34:20 user nova-compute[72773]: DEBUG nova.network.neutron [req-4b737bd8-16be-445c-abbf-4f95492273a9 req-54cdb46b-7d29-4153-90cf-77f07be7fd5c service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Refreshing network info cache for port eae4e0ec-3105-463d-9c92-0e2f63192bb6 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:34:20 user nova-compute[72773]: DEBUG nova.network.neutron [req-4b737bd8-16be-445c-abbf-4f95492273a9 req-54cdb46b-7d29-4153-90cf-77f07be7fd5c service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Updated VIF entry in instance network info cache for port eae4e0ec-3105-463d-9c92-0e2f63192bb6. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:34:20 user nova-compute[72773]: DEBUG nova.network.neutron [req-4b737bd8-16be-445c-abbf-4f95492273a9 req-54cdb46b-7d29-4153-90cf-77f07be7fd5c service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Updating instance_info_cache with network_info: [{"id": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "address": "fa:16:3e:0b:c6:49", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeae4e0ec-31", "ovs_interfaceid": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:34:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4b737bd8-16be-445c-abbf-4f95492273a9 req-54cdb46b-7d29-4153-90cf-77f07be7fd5c service nova] Releasing lock "refresh_cache-63644e8f-95d4-43a7-a824-8845dd073423" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:34:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "e9259e07-3d7f-4169-96fc-b080b4b9ce6a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:34:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "e9259e07-3d7f-4169-96fc-b080b4b9ce6a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:34:21 user nova-compute[72773]: DEBUG nova.objects.instance [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lazy-loading 'flavor' on Instance uuid e9259e07-3d7f-4169-96fc-b080b4b9ce6a {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:34:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "e9259e07-3d7f-4169-96fc-b080b4b9ce6a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:34:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "e9259e07-3d7f-4169-96fc-b080b4b9ce6a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:34:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "e9259e07-3d7f-4169-96fc-b080b4b9ce6a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:34:21 user nova-compute[72773]: INFO nova.compute.manager [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Attaching volume d37a0ddd-fb97-45e6-ab22-4123b912d5a8 to /dev/vdb
Aug 16 22:34:22 user nova-compute[72773]: DEBUG os_brick.utils [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:34:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:22 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22694f6-5c3c-4604-b915-568a17d9262d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:34:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:22 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[16279f11-02a2-49ba-98f0-920a9570bfa8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:34:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:22 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74666f5-4e41-481e-b3b4-443272c72833]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:34:22 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e40a58-6b69-41c6-8dc2-c82fa509bd41]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:34:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:34:22 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:34:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:34:22 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:34:22 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[29113cbf-ab42-4ea8-ba11-67acd48a9c22]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:34:22 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:34:22 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:34:22 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:34:22 user nova-compute[72773]: DEBUG os_brick.utils [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:34:22 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Updating existing volume attachment record: db280297-6e55-490b-bbe4-35b40704dacc {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:34:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-822c5331-3fb0-4492-89a2-a40a154558bd tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "63644e8f-95d4-43a7-a824-8845dd073423" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:34:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-822c5331-3fb0-4492-89a2-a40a154558bd tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "63644e8f-95d4-43a7-a824-8845dd073423" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:34:26 user nova-compute[72773]: INFO nova.compute.manager [None req-822c5331-3fb0-4492-89a2-a40a154558bd tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Shelving
Aug 16 22:34:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:26 user nova-compute[72773]: DEBUG nova.compute.manager [req-eea9fd2f-0426-4228-9038-7c7e5c37180a req-b4e4f127-6937-4861-8867-824e80dc7c12 service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Received event network-vif-unplugged-eae4e0ec-3105-463d-9c92-0e2f63192bb6 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:34:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-eea9fd2f-0426-4228-9038-7c7e5c37180a req-b4e4f127-6937-4861-8867-824e80dc7c12 service nova] Acquiring lock "63644e8f-95d4-43a7-a824-8845dd073423-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:34:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-eea9fd2f-0426-4228-9038-7c7e5c37180a req-b4e4f127-6937-4861-8867-824e80dc7c12 service nova] Lock "63644e8f-95d4-43a7-a824-8845dd073423-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:34:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-eea9fd2f-0426-4228-9038-7c7e5c37180a req-b4e4f127-6937-4861-8867-824e80dc7c12 service nova] Lock "63644e8f-95d4-43a7-a824-8845dd073423-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:34:26 user nova-compute[72773]: DEBUG nova.compute.manager [req-eea9fd2f-0426-4228-9038-7c7e5c37180a req-b4e4f127-6937-4861-8867-824e80dc7c12 service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] No waiting events found dispatching network-vif-unplugged-eae4e0ec-3105-463d-9c92-0e2f63192bb6 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:34:26 user nova-compute[72773]: WARNING nova.compute.manager [req-eea9fd2f-0426-4228-9038-7c7e5c37180a req-b4e4f127-6937-4861-8867-824e80dc7c12 service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Received unexpected event network-vif-unplugged-eae4e0ec-3105-463d-9c92-0e2f63192bb6 for instance with vm_state active and task_state shelving.
Aug 16 22:34:26 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Instance destroyed successfully.
Aug 16 22:34:26 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-822c5331-3fb0-4492-89a2-a40a154558bd tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Beginning cold snapshot process
Aug 16 22:34:27 user nova-compute[72773]: DEBUG nova.privsep.utils [None req-822c5331-3fb0-4492-89a2-a40a154558bd tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72773) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 22:34:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-822c5331-3fb0-4492-89a2-a40a154558bd tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk /opt/stack/data/nova/instances/snapshots/tmpkrl003gw/d6db394efca8402bbcf5a18e02be8a99 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-822c5331-3fb0-4492-89a2-a40a154558bd tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk /opt/stack/data/nova/instances/snapshots/tmpkrl003gw/d6db394efca8402bbcf5a18e02be8a99" returned: 0 in 0.453s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:27 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-822c5331-3fb0-4492-89a2-a40a154558bd tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Snapshot extracted, beginning image upload
Aug 16 22:34:28 user nova-compute[72773]: DEBUG nova.compute.manager [req-46f2eb23-7ebb-4ae3-8d65-db13481103bb req-c3c3d2c6-39b2-462a-b6a7-ddef0b4e0e65 service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Received event network-vif-plugged-eae4e0ec-3105-463d-9c92-0e2f63192bb6 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:34:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-46f2eb23-7ebb-4ae3-8d65-db13481103bb req-c3c3d2c6-39b2-462a-b6a7-ddef0b4e0e65 service nova] Acquiring lock "63644e8f-95d4-43a7-a824-8845dd073423-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:34:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-46f2eb23-7ebb-4ae3-8d65-db13481103bb req-c3c3d2c6-39b2-462a-b6a7-ddef0b4e0e65 service nova] Lock "63644e8f-95d4-43a7-a824-8845dd073423-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:34:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-46f2eb23-7ebb-4ae3-8d65-db13481103bb req-c3c3d2c6-39b2-462a-b6a7-ddef0b4e0e65 service nova] Lock "63644e8f-95d4-43a7-a824-8845dd073423-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:34:28 user nova-compute[72773]: DEBUG nova.compute.manager [req-46f2eb23-7ebb-4ae3-8d65-db13481103bb req-c3c3d2c6-39b2-462a-b6a7-ddef0b4e0e65 service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] No waiting events found dispatching network-vif-plugged-eae4e0ec-3105-463d-9c92-0e2f63192bb6 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:34:28 user nova-compute[72773]: WARNING nova.compute.manager [req-46f2eb23-7ebb-4ae3-8d65-db13481103bb req-c3c3d2c6-39b2-462a-b6a7-ddef0b4e0e65 service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Received unexpected event network-vif-plugged-eae4e0ec-3105-463d-9c92-0e2f63192bb6 for instance with vm_state active and task_state shelving_image_uploading.
Aug 16 22:34:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:30 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-822c5331-3fb0-4492-89a2-a40a154558bd tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Snapshot image upload complete
Aug 16 22:34:30 user nova-compute[72773]: DEBUG nova.compute.manager [None req-822c5331-3fb0-4492-89a2-a40a154558bd tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:34:30 user nova-compute[72773]: INFO nova.compute.manager [None req-822c5331-3fb0-4492-89a2-a40a154558bd tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Shelve offloading
Aug 16 22:34:30 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Instance destroyed successfully.
Aug 16 22:34:30 user nova-compute[72773]: DEBUG nova.compute.manager [None req-822c5331-3fb0-4492-89a2-a40a154558bd tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:34:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-822c5331-3fb0-4492-89a2-a40a154558bd tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "refresh_cache-63644e8f-95d4-43a7-a824-8845dd073423" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:34:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-822c5331-3fb0-4492-89a2-a40a154558bd tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquired lock "refresh_cache-63644e8f-95d4-43a7-a824-8845dd073423" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:34:30 user nova-compute[72773]: DEBUG nova.network.neutron [None req-822c5331-3fb0-4492-89a2-a40a154558bd tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:34:30 user nova-compute[72773]: DEBUG nova.network.neutron [None req-822c5331-3fb0-4492-89a2-a40a154558bd tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Updating instance_info_cache with network_info: [{"id": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "address": "fa:16:3e:0b:c6:49", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeae4e0ec-31", "ovs_interfaceid": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:34:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-822c5331-3fb0-4492-89a2-a40a154558bd tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Releasing lock "refresh_cache-63644e8f-95d4-43a7-a824-8845dd073423" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:34:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:32 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Instance destroyed successfully.
Aug 16 22:34:32 user nova-compute[72773]: DEBUG nova.objects.instance [None req-822c5331-3fb0-4492-89a2-a40a154558bd tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lazy-loading 'resources' on Instance uuid 63644e8f-95d4-43a7-a824-8845dd073423 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:34:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-822c5331-3fb0-4492-89a2-a40a154558bd tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-420565271',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-420565271',id=25,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5I2uvRkVSVEy6vMpomgaGv1BP4PwD8mI6gyaqaKNq6pYg6WVSuIAZUhQwYqmeXo8qz9fImN1pgAPS2h8i/SzT9e/Y2ha9ZdnmTjkz+NM4xFhm+OZ2EL14lH7cAaBxfMw==',key_name='tempest-keypair-126270933',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:32:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a2ef6a37d79341d7a94e5b314efddab4',ramdisk_id='',reservation_id='r-ixfawem0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-488184195',owner_user_name='tempest-AttachVolumeShelveTestJSON-488184195-project-member',shelved_at='2023-08-16T22:34:30.272723',shelved_host='user',shelved_image_id='9ad4ea58-516d-47f5-8361-ed8a066e1975'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:34:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71cd9d1142ec45e792219e8b789cf2a0',uuid=63644e8f-95d4-43a7-a824-8845dd073423,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "address": "fa:16:3e:0b:c6:49", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeae4e0ec-31", "ovs_interfaceid": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:34:32 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-822c5331-3fb0-4492-89a2-a40a154558bd tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Converting VIF {"id": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "address": "fa:16:3e:0b:c6:49", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeae4e0ec-31", "ovs_interfaceid": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:34:32 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-822c5331-3fb0-4492-89a2-a40a154558bd tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c6:49,bridge_name='br-int',has_traffic_filtering=True,id=eae4e0ec-3105-463d-9c92-0e2f63192bb6,network=Network(9aa7e6bf-5a47-422d-b638-cff5a8429391),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeae4e0ec-31') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:34:32 user nova-compute[72773]: DEBUG os_vif [None req-822c5331-3fb0-4492-89a2-a40a154558bd tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c6:49,bridge_name='br-int',has_traffic_filtering=True,id=eae4e0ec-3105-463d-9c92-0e2f63192bb6,network=Network(9aa7e6bf-5a47-422d-b638-cff5a8429391),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeae4e0ec-31') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:34:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeae4e0ec-31, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:34:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:34:32 user nova-compute[72773]: INFO os_vif [None req-822c5331-3fb0-4492-89a2-a40a154558bd tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c6:49,bridge_name='br-int',has_traffic_filtering=True,id=eae4e0ec-3105-463d-9c92-0e2f63192bb6,network=Network(9aa7e6bf-5a47-422d-b638-cff5a8429391),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeae4e0ec-31')
Aug 16 22:34:32 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-822c5331-3fb0-4492-89a2-a40a154558bd tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Deleting instance files /opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423_del
Aug 16 22:34:32 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-822c5331-3fb0-4492-89a2-a40a154558bd tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Deletion of /opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423_del complete
Aug 16 22:34:32 user nova-compute[72773]: DEBUG nova.compute.manager [req-cf1e08c5-766d-4a58-95aa-84af3aafa663 req-b312ea7d-6bf5-4b87-a7d0-25275e1a0da7 service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Received event network-changed-eae4e0ec-3105-463d-9c92-0e2f63192bb6 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:34:32 user nova-compute[72773]: DEBUG nova.compute.manager [req-cf1e08c5-766d-4a58-95aa-84af3aafa663 req-b312ea7d-6bf5-4b87-a7d0-25275e1a0da7 service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Refreshing instance network info cache due to event network-changed-eae4e0ec-3105-463d-9c92-0e2f63192bb6. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:34:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-cf1e08c5-766d-4a58-95aa-84af3aafa663 req-b312ea7d-6bf5-4b87-a7d0-25275e1a0da7 service nova] Acquiring lock "refresh_cache-63644e8f-95d4-43a7-a824-8845dd073423" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:34:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-cf1e08c5-766d-4a58-95aa-84af3aafa663 req-b312ea7d-6bf5-4b87-a7d0-25275e1a0da7 service nova] Acquired lock "refresh_cache-63644e8f-95d4-43a7-a824-8845dd073423" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:34:32 user nova-compute[72773]: DEBUG nova.network.neutron [req-cf1e08c5-766d-4a58-95aa-84af3aafa663 req-b312ea7d-6bf5-4b87-a7d0-25275e1a0da7 service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Refreshing network info cache for port eae4e0ec-3105-463d-9c92-0e2f63192bb6 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:34:32 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-822c5331-3fb0-4492-89a2-a40a154558bd tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Deleted allocations for instance 63644e8f-95d4-43a7-a824-8845dd073423
Aug 16 22:34:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-822c5331-3fb0-4492-89a2-a40a154558bd tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:34:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-822c5331-3fb0-4492-89a2-a40a154558bd tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:34:32 user nova-compute[72773]: DEBUG nova.objects.instance [None req-822c5331-3fb0-4492-89a2-a40a154558bd tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lazy-loading 'numa_topology' on Instance uuid 63644e8f-95d4-43a7-a824-8845dd073423 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:34:32 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-822c5331-3fb0-4492-89a2-a40a154558bd tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:34:32 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-822c5331-3fb0-4492-89a2-a40a154558bd tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:34:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-822c5331-3fb0-4492-89a2-a40a154558bd tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:34:32 user nova-compute[72773]: DEBUG nova.network.neutron [req-cf1e08c5-766d-4a58-95aa-84af3aafa663 req-b312ea7d-6bf5-4b87-a7d0-25275e1a0da7 service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Updated VIF entry in instance network info cache for port eae4e0ec-3105-463d-9c92-0e2f63192bb6. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:34:32 user nova-compute[72773]: DEBUG nova.network.neutron [req-cf1e08c5-766d-4a58-95aa-84af3aafa663 req-b312ea7d-6bf5-4b87-a7d0-25275e1a0da7 service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Updating instance_info_cache with network_info: [{"id": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "address": "fa:16:3e:0b:c6:49", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapeae4e0ec-31", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:34:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-cf1e08c5-766d-4a58-95aa-84af3aafa663 req-b312ea7d-6bf5-4b87-a7d0-25275e1a0da7 service nova] Releasing lock "refresh_cache-63644e8f-95d4-43a7-a824-8845dd073423" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:34:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-822c5331-3fb0-4492-89a2-a40a154558bd tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "63644e8f-95d4-43a7-a824-8845dd073423" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.534s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:34:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:34:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIFaiKcY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:34:33 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:34:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:34:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:34:33 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:34:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:34:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:34:33 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:34:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fc6627-ea0d-4926-bce8-b8ff75fd049e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:34:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:34:33 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:34:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a6264f-22dc-459c-b4e4-3a4af2bd4d17]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:34:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8] added
Aug 16 22:34:33 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:34:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8debbf79-d69f-4ea3-99f8-735d023757cd]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:34:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:34:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4e349e-5c01-4e8b-a1af-0edcefda94bc]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:34:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:34:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rIFaiKcY {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rIFaiKcY" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c913403-b14a-4622-9419-0daff523d2d3]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:34:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rIFaiKcY'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:34:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f697ea3-49f4-407f-81b3-7acfc3482bfa]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:34:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:34:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe711ecd-028e-4379-b5f6-8cff59e1b73e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a04d2fb3-1739-4cc4-9316-e53c6ea5caa3 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:34:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:34:34 user nova-compute[72773]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a04d2fb3-1739-4cc4-9316-e53c6ea5caa3 (non-flash)
Aug 16 22:34:34 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:34:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:34:34 user nova-compute[72773]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a04d2fb3-1739-4cc4-9316-e53c6ea5caa3 (non-flash)
Aug 16 22:34:34 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:34:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e07775b-6afe-41ba-902b-e942b9facc9f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:34:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8, portal: 172.16.0.220,3260]
Aug 16 22:34:34 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8, portal: 172.16.0.220,3260] successful.
Aug 16 22:34:34 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:34:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1dc87a6-b376-4440-8b6f-3b87cde96f06]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:34:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:34:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8761a9f2-7bd0-42c5-be91-6d3ddcbacddc]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a04d2fb3-1739-4cc4-9316-e53c6ea5caa3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:34:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:34:34 user nova-compute[72773]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a04d2fb3-1739-4cc4-9316-e53c6ea5caa3 (non-flash)
Aug 16 22:34:34 user nova-compute[72773]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8 (non-flash)
Aug 16 22:34:34 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:34:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:34:34 user nova-compute[72773]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a04d2fb3-1739-4cc4-9316-e53c6ea5caa3 (non-flash)
Aug 16 22:34:34 user nova-compute[72773]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8 (non-flash)
Aug 16 22:34:34 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:34:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:34:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:34:34 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:34:34 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:34:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf8ad24-87ba-4cce-adc2-c4ec67bb8119]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:34:34 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:34:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIFaiKcY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:34:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:34:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23266613861626664', 'path': '/dev/sdd'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:34:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266613861626664', 'path': '/dev/sdd'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:34:35 user nova-compute[72773]: DEBUG nova.objects.instance [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lazy-loading 'flavor' on Instance uuid e9259e07-3d7f-4169-96fc-b080b4b9ce6a {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:34:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 22:34:35 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:34:35 user nova-compute[72773]:   <source dev="/dev/sdd"/>
Aug 16 22:34:35 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:34:35 user nova-compute[72773]:   <serial>d37a0ddd-fb97-45e6-ab22-4123b912d5a8</serial>
Aug 16 22:34:35 user nova-compute[72773]: </disk>
Aug 16 22:34:35 user nova-compute[72773]:  {{(pid=72773) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 22:34:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:34:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:34:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] No VIF found with MAC fa:16:3e:92:99:c6, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:34:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f2e95978-0934-4e07-89bf-4f82f4d57e77 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "e9259e07-3d7f-4169-96fc-b080b4b9ce6a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.838s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:34:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-360db53d-96fc-4d75-869d-c6e89ce56a60 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "e9259e07-3d7f-4169-96fc-b080b4b9ce6a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:34:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-360db53d-96fc-4d75-869d-c6e89ce56a60 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "e9259e07-3d7f-4169-96fc-b080b4b9ce6a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:34:36 user nova-compute[72773]: INFO nova.compute.manager [None req-360db53d-96fc-4d75-869d-c6e89ce56a60 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Detaching volume d37a0ddd-fb97-45e6-ab22-4123b912d5a8
Aug 16 22:34:36 user nova-compute[72773]: INFO nova.virt.block_device [None req-360db53d-96fc-4d75-869d-c6e89ce56a60 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Attempting to driver detach volume d37a0ddd-fb97-45e6-ab22-4123b912d5a8 from mountpoint /dev/vdb
Aug 16 22:34:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-360db53d-96fc-4d75-869d-c6e89ce56a60 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Attempting to detach device vdb from instance e9259e07-3d7f-4169-96fc-b080b4b9ce6a from the persistent domain config. {{(pid=72773) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 22:34:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-360db53d-96fc-4d75-869d-c6e89ce56a60 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:34:36 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:34:36 user nova-compute[72773]:   <source dev="/dev/sdd"/>
Aug 16 22:34:36 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:34:36 user nova-compute[72773]:   <serial>d37a0ddd-fb97-45e6-ab22-4123b912d5a8</serial>
Aug 16 22:34:36 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:34:36 user nova-compute[72773]: </disk>
Aug 16 22:34:36 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:34:36 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-360db53d-96fc-4d75-869d-c6e89ce56a60 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Successfully detached device vdb from instance e9259e07-3d7f-4169-96fc-b080b4b9ce6a from the persistent domain config.
Aug 16 22:34:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-360db53d-96fc-4d75-869d-c6e89ce56a60 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e9259e07-3d7f-4169-96fc-b080b4b9ce6a from the live domain config. {{(pid=72773) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 22:34:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-360db53d-96fc-4d75-869d-c6e89ce56a60 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:34:36 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:34:36 user nova-compute[72773]:   <source dev="/dev/sdd"/>
Aug 16 22:34:36 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:34:36 user nova-compute[72773]:   <serial>d37a0ddd-fb97-45e6-ab22-4123b912d5a8</serial>
Aug 16 22:34:36 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:34:36 user nova-compute[72773]: </disk>
Aug 16 22:34:36 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:34:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Received event <DeviceRemovedEvent: 1692225276.8444211, e9259e07-3d7f-4169-96fc-b080b4b9ce6a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72773) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 22:34:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-360db53d-96fc-4d75-869d-c6e89ce56a60 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e9259e07-3d7f-4169-96fc-b080b4b9ce6a {{(pid=72773) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 22:34:36 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-360db53d-96fc-4d75-869d-c6e89ce56a60 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Successfully detached device vdb from instance e9259e07-3d7f-4169-96fc-b080b4b9ce6a from the live domain config.
Aug 16 22:34:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-360db53d-96fc-4d75-869d-c6e89ce56a60 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:34:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-360db53d-96fc-4d75-869d-c6e89ce56a60 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIFaiKcY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:34:36 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-360db53d-96fc-4d75-869d-c6e89ce56a60 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:34:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-360db53d-96fc-4d75-869d-c6e89ce56a60 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:34:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-360db53d-96fc-4d75-869d-c6e89ce56a60 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:34:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-360db53d-96fc-4d75-869d-c6e89ce56a60 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:34:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:36 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7e5d6e-9907-4153-ba20-381246cd8ac3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a04d2fb3-1739-4cc4-9316-e53c6ea5caa3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:34:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:36 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e4f94b-bc86-4511-a8f1-7a9efb4fc7e8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a04d2fb3-1739-4cc4-9316-e53c6ea5caa3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:34:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-360db53d-96fc-4d75-869d-c6e89ce56a60 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:34:36 user nova-compute[72773]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a04d2fb3-1739-4cc4-9316-e53c6ea5caa3 (non-flash)
Aug 16 22:34:36 user nova-compute[72773]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8 (non-flash)
Aug 16 22:34:36 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:34:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-360db53d-96fc-4d75-869d-c6e89ce56a60 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:34:36 user nova-compute[72773]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a04d2fb3-1739-4cc4-9316-e53c6ea5caa3 (non-flash)
Aug 16 22:34:36 user nova-compute[72773]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8 (non-flash)
Aug 16 22:34:36 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:34:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-360db53d-96fc-4d75-869d-c6e89ce56a60 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef8020bbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8'): ({'sdd'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:34:36 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-360db53d-96fc-4d75-869d-c6e89ce56a60 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Removing single pathed devices sdd {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:34:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:36 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7193f4f6-0d1d-46be-86f3-3f584f8ed55d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:34:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:36 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a2ddb9-b839-40be-b222-d328caea9155]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:34:36 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-360db53d-96fc-4d75-869d-c6e89ce56a60 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Flushing IO for device /dev/sdd {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:34:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:36 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0d8d89-504e-47c1-a631-488033d4dd4b]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:34:36 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-360db53d-96fc-4d75-869d-c6e89ce56a60 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:34:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[421c1b08-7331-4191-a944-379780511735]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:34:37 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-360db53d-96fc-4d75-869d-c6e89ce56a60 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:34:37 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-360db53d-96fc-4d75-869d-c6e89ce56a60 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] SCSI volumes sdd have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:34:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-360db53d-96fc-4d75-869d-c6e89ce56a60 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:34:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fef82f4-c391-45d9-8b75-6e1f7468b6ae]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:34:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-360db53d-96fc-4d75-869d-c6e89ce56a60 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:34:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[793e837d-c639-4fbe-8b9a-c4914a900b3b]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:34:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-360db53d-96fc-4d75-869d-c6e89ce56a60 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8, portal: 172.16.0.220,3260]
Aug 16 22:34:37 user nova-compute[72773]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8, portal: 172.16.0.220,3260] successful.
Aug 16 22:34:37 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:34:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d37a0ddd-fb97-45e6-ab22-4123b912d5a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a382c3-d58d-4a0e-82e5-525915c37154]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:34:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-360db53d-96fc-4d75-869d-c6e89ce56a60 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:34:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-360db53d-96fc-4d75-869d-c6e89ce56a60 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:34:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-360db53d-96fc-4d75-869d-c6e89ce56a60 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] <== disconnect_volume: return (303ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:34:37 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-360db53d-96fc-4d75-869d-c6e89ce56a60 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:34:38 user nova-compute[72773]: DEBUG nova.objects.instance [None req-360db53d-96fc-4d75-869d-c6e89ce56a60 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lazy-loading 'flavor' on Instance uuid e9259e07-3d7f-4169-96fc-b080b4b9ce6a {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:34:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-360db53d-96fc-4d75-869d-c6e89ce56a60 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "e9259e07-3d7f-4169-96fc-b080b4b9ce6a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.736s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:34:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:41 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692225266.862119, 63644e8f-95d4-43a7-a824-8845dd073423 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:34:41 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] VM Stopped (Lifecycle Event)
Aug 16 22:34:41 user nova-compute[72773]: DEBUG nova.compute.manager [None req-f068c77e-0474-4e1a-91cf-62bfb6dbf38c None None] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:34:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:54 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:34:54 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:34:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-ac2b49e4-59bc-46cd-b7d9-67aa68296e4e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:34:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-ac2b49e4-59bc-46cd-b7d9-67aa68296e4e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:34:55 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 22:34:55 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Updating instance_info_cache with network_info: [{"id": "aa173151-ed37-4416-97d6-4bb197ad7396", "address": "fa:16:3e:f3:88:89", "network": {"id": "0567b846-3f19-403c-9ec6-ac2a82af5f4a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-290484898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a20f7a479ca4dbebe1ef08f466d2e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa173151-ed", "ovs_interfaceid": "aa173151-ed37-4416-97d6-4bb197ad7396", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:34:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-ac2b49e4-59bc-46cd-b7d9-67aa68296e4e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:34:55 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 22:34:55 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:34:55 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:34:55 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:34:55 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:34:55 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:34:55 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:34:55 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:34:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "f4210738-d01e-4408-a15c-aeccada6dd23" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:34:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "f4210738-d01e-4408-a15c-aeccada6dd23" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:34:56 user nova-compute[72773]: DEBUG nova.compute.manager [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:34:56 user nova-compute[72773]: DEBUG nova.compute.manager [req-a70741ee-a756-4618-ab42-535945a30086 req-a19a15ad-6a69-4c45-9093-8bbacf0e1091 service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Received event network-changed-5725a1df-f51f-4ba4-99f7-777975663b2e {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:34:56 user nova-compute[72773]: DEBUG nova.compute.manager [req-a70741ee-a756-4618-ab42-535945a30086 req-a19a15ad-6a69-4c45-9093-8bbacf0e1091 service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Refreshing instance network info cache due to event network-changed-5725a1df-f51f-4ba4-99f7-777975663b2e. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:34:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a70741ee-a756-4618-ab42-535945a30086 req-a19a15ad-6a69-4c45-9093-8bbacf0e1091 service nova] Acquiring lock "refresh_cache-23894101-2fd3-41a4-83a3-8f6869d24d97" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:34:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a70741ee-a756-4618-ab42-535945a30086 req-a19a15ad-6a69-4c45-9093-8bbacf0e1091 service nova] Acquired lock "refresh_cache-23894101-2fd3-41a4-83a3-8f6869d24d97" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:34:56 user nova-compute[72773]: DEBUG nova.network.neutron [req-a70741ee-a756-4618-ab42-535945a30086 req-a19a15ad-6a69-4c45-9093-8bbacf0e1091 service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Refreshing network info cache for port 5725a1df-f51f-4ba4-99f7-777975663b2e {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:34:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:34:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:34:56 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:34:56 user nova-compute[72773]: INFO nova.compute.claims [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Claim successful on node user
Aug 16 22:34:56 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:34:56 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:34:56 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:34:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.549s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:34:57 user nova-compute[72773]: DEBUG nova.compute.manager [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:34:57 user nova-compute[72773]: DEBUG nova.compute.manager [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:34:57 user nova-compute[72773]: DEBUG nova.network.neutron [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:34:57 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:34:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:57 user nova-compute[72773]: DEBUG nova.compute.manager [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:34:57 user nova-compute[72773]: DEBUG nova.policy [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '02982f15d1a640a5bc77069a906f3e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3dc03400ff4448682ebba991a7e8af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:34:57 user nova-compute[72773]: DEBUG nova.compute.manager [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:34:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:34:57 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Creating image(s)
Aug 16 22:34:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:34:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "/opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:34:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "/opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:34:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:57 user nova-compute[72773]: DEBUG nova.network.neutron [req-a70741ee-a756-4618-ab42-535945a30086 req-a19a15ad-6a69-4c45-9093-8bbacf0e1091 service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Updated VIF entry in instance network info cache for port 5725a1df-f51f-4ba4-99f7-777975663b2e. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:34:57 user nova-compute[72773]: DEBUG nova.network.neutron [req-a70741ee-a756-4618-ab42-535945a30086 req-a19a15ad-6a69-4c45-9093-8bbacf0e1091 service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Updating instance_info_cache with network_info: [{"id": "5725a1df-f51f-4ba4-99f7-777975663b2e", "address": "fa:16:3e:98:fa:bf", "network": {"id": "00744c2a-d566-47bc-abeb-8e9bc9ab312d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-384143120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cafc1d829ed749c2bfe35f7bc58e331c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5725a1df-f5", "ovs_interfaceid": "5725a1df-f51f-4ba4-99f7-777975663b2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:34:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a70741ee-a756-4618-ab42-535945a30086 req-a19a15ad-6a69-4c45-9093-8bbacf0e1091 service nova] Releasing lock "refresh_cache-23894101-2fd3-41a4-83a3-8f6869d24d97" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:34:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.214s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:34:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:34:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.183s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk 1073741824" returned: 0 in 0.053s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:34:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:57 user nova-compute[72773]: DEBUG nova.network.neutron [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Successfully created port: bb573e79-a106-40c5-8c53-ab73eb6ba240 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:34:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.190s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:57 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:34:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:58 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:58 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Cannot resize image /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:34:58 user nova-compute[72773]: DEBUG nova.objects.instance [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lazy-loading 'migration_context' on Instance uuid f4210738-d01e-4408-a15c-aeccada6dd23 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:34:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:34:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Ensure instance console log exists: /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:34:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:34:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:34:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:34:58 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:34:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:34:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:34:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:34:58 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:34:58 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:58 user nova-compute[72773]: DEBUG nova.network.neutron [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Successfully updated port: bb573e79-a106-40c5-8c53-ab73eb6ba240 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:34:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "refresh_cache-f4210738-d01e-4408-a15c-aeccada6dd23" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:34:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquired lock "refresh_cache-f4210738-d01e-4408-a15c-aeccada6dd23" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:34:58 user nova-compute[72773]: DEBUG nova.network.neutron [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:34:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-b2804403-6158-4e9f-8fe3-0cdd79b615fc req-07814e5d-2f97-4b3a-9b05-6e847cfd1e26 service nova] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Received event network-changed-bb573e79-a106-40c5-8c53-ab73eb6ba240 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:34:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-b2804403-6158-4e9f-8fe3-0cdd79b615fc req-07814e5d-2f97-4b3a-9b05-6e847cfd1e26 service nova] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Refreshing instance network info cache due to event network-changed-bb573e79-a106-40c5-8c53-ab73eb6ba240. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:34:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b2804403-6158-4e9f-8fe3-0cdd79b615fc req-07814e5d-2f97-4b3a-9b05-6e847cfd1e26 service nova] Acquiring lock "refresh_cache-f4210738-d01e-4408-a15c-aeccada6dd23" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:34:58 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:58 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:58 user nova-compute[72773]: DEBUG nova.network.neutron [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG nova.network.neutron [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Updating instance_info_cache with network_info: [{"id": "bb573e79-a106-40c5-8c53-ab73eb6ba240", "address": "fa:16:3e:1e:80:9b", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb573e79-a1", "ovs_interfaceid": "bb573e79-a106-40c5-8c53-ab73eb6ba240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Releasing lock "refresh_cache-f4210738-d01e-4408-a15c-aeccada6dd23" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG nova.compute.manager [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Instance network_info: |[{"id": "bb573e79-a106-40c5-8c53-ab73eb6ba240", "address": "fa:16:3e:1e:80:9b", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb573e79-a1", "ovs_interfaceid": "bb573e79-a106-40c5-8c53-ab73eb6ba240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b2804403-6158-4e9f-8fe3-0cdd79b615fc req-07814e5d-2f97-4b3a-9b05-6e847cfd1e26 service nova] Acquired lock "refresh_cache-f4210738-d01e-4408-a15c-aeccada6dd23" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG nova.network.neutron [req-b2804403-6158-4e9f-8fe3-0cdd79b615fc req-07814e5d-2f97-4b3a-9b05-6e847cfd1e26 service nova] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Refreshing network info cache for port bb573e79-a106-40c5-8c53-ab73eb6ba240 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Start _get_guest_xml network_info=[{"id": "bb573e79-a106-40c5-8c53-ab73eb6ba240", "address": "fa:16:3e:1e:80:9b", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb573e79-a1", "ovs_interfaceid": "bb573e79-a106-40c5-8c53-ab73eb6ba240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:34:59 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:34:59 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:34:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1821628640',display_name='tempest-ServerActionsTestOtherA-server-1821628640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1821628640',id=29,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8jX+pTxaeDXA5y4Lt3+HYLzwoWoj7w8Q+TaAP2Om+ZW/RXrMR/7moMcaLV8Y+iO6BXYhMxPummGFIv4FNE2LpZt+HlA5XAu1WYM2d9vz6WjOr3TWc3giU1qDh4/LEA9A==',key_name='tempest-keypair-283817410',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3dc03400ff4448682ebba991a7e8af6',ramdisk_id='',reservation_id='r-izyj3zjs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1807466388',owner_user_name='tempest-ServerActionsTestOtherA-1807466388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:34:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02982f15d1a640a5bc77069a906f3e9a',uuid=f4210738-d01e-4408-a15c-aeccada6dd23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb573e79-a106-40c5-8c53-ab73eb6ba240", "address": "fa:16:3e:1e:80:9b", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb573e79-a1", "ovs_interfaceid": "bb573e79-a106-40c5-8c53-ab73eb6ba240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Converting VIF {"id": "bb573e79-a106-40c5-8c53-ab73eb6ba240", "address": "fa:16:3e:1e:80:9b", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb573e79-a1", "ovs_interfaceid": "bb573e79-a106-40c5-8c53-ab73eb6ba240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:80:9b,bridge_name='br-int',has_traffic_filtering=True,id=bb573e79-a106-40c5-8c53-ab73eb6ba240,network=Network(1a1a40b0-631c-4f41-9ece-17cd713adfd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb573e79-a1') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG nova.objects.instance [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lazy-loading 'pci_devices' on Instance uuid f4210738-d01e-4408-a15c-aeccada6dd23 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:34:59 user nova-compute[72773]:   <uuid>f4210738-d01e-4408-a15c-aeccada6dd23</uuid>
Aug 16 22:34:59 user nova-compute[72773]:   <name>instance-0000001d</name>
Aug 16 22:34:59 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:34:59 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:34:59 user nova-compute[72773]:   <metadata>
Aug 16 22:34:59 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:34:59 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:34:59 user nova-compute[72773]:       <nova:name>tempest-ServerActionsTestOtherA-server-1821628640</nova:name>
Aug 16 22:34:59 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:34:59</nova:creationTime>
Aug 16 22:34:59 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:34:59 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:34:59 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:34:59 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:34:59 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:34:59 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:34:59 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:34:59 user nova-compute[72773]:       <nova:owner>
Aug 16 22:34:59 user nova-compute[72773]:         <nova:user uuid="02982f15d1a640a5bc77069a906f3e9a">tempest-ServerActionsTestOtherA-1807466388-project-member</nova:user>
Aug 16 22:34:59 user nova-compute[72773]:         <nova:project uuid="e3dc03400ff4448682ebba991a7e8af6">tempest-ServerActionsTestOtherA-1807466388</nova:project>
Aug 16 22:34:59 user nova-compute[72773]:       </nova:owner>
Aug 16 22:34:59 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:34:59 user nova-compute[72773]:       <nova:ports>
Aug 16 22:34:59 user nova-compute[72773]:         <nova:port uuid="bb573e79-a106-40c5-8c53-ab73eb6ba240">
Aug 16 22:34:59 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 22:34:59 user nova-compute[72773]:         </nova:port>
Aug 16 22:34:59 user nova-compute[72773]:       </nova:ports>
Aug 16 22:34:59 user nova-compute[72773]:     </nova:instance>
Aug 16 22:34:59 user nova-compute[72773]:   </metadata>
Aug 16 22:34:59 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:34:59 user nova-compute[72773]:     <system>
Aug 16 22:34:59 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:34:59 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:34:59 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:34:59 user nova-compute[72773]:       <entry name="serial">f4210738-d01e-4408-a15c-aeccada6dd23</entry>
Aug 16 22:34:59 user nova-compute[72773]:       <entry name="uuid">f4210738-d01e-4408-a15c-aeccada6dd23</entry>
Aug 16 22:34:59 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:34:59 user nova-compute[72773]:     </system>
Aug 16 22:34:59 user nova-compute[72773]:   </sysinfo>
Aug 16 22:34:59 user nova-compute[72773]:   <os>
Aug 16 22:34:59 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:34:59 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:34:59 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:34:59 user nova-compute[72773]:   </os>
Aug 16 22:34:59 user nova-compute[72773]:   <features>
Aug 16 22:34:59 user nova-compute[72773]:     <acpi/>
Aug 16 22:34:59 user nova-compute[72773]:     <apic/>
Aug 16 22:34:59 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:34:59 user nova-compute[72773]:   </features>
Aug 16 22:34:59 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:34:59 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:34:59 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:34:59 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:34:59 user nova-compute[72773]:   </clock>
Aug 16 22:34:59 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:34:59 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:34:59 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:34:59 user nova-compute[72773]:   </cpu>
Aug 16 22:34:59 user nova-compute[72773]:   <devices>
Aug 16 22:34:59 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:34:59 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:34:59 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk"/>
Aug 16 22:34:59 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:34:59 user nova-compute[72773]:     </disk>
Aug 16 22:34:59 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:34:59 user nova-compute[72773]:       <mac address="fa:16:3e:1e:80:9b"/>
Aug 16 22:34:59 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:34:59 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:34:59 user nova-compute[72773]:       <target dev="tapbb573e79-a1"/>
Aug 16 22:34:59 user nova-compute[72773]:     </interface>
Aug 16 22:34:59 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:34:59 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/console.log" append="off"/>
Aug 16 22:34:59 user nova-compute[72773]:     </serial>
Aug 16 22:34:59 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:34:59 user nova-compute[72773]:     <video>
Aug 16 22:34:59 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:34:59 user nova-compute[72773]:     </video>
Aug 16 22:34:59 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:34:59 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:34:59 user nova-compute[72773]:     </rng>
Aug 16 22:34:59 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:34:59 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:34:59 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:34:59 user nova-compute[72773]:     </memballoon>
Aug 16 22:34:59 user nova-compute[72773]:   </devices>
Aug 16 22:34:59 user nova-compute[72773]: </domain>
Aug 16 22:34:59 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1821628640',display_name='tempest-ServerActionsTestOtherA-server-1821628640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1821628640',id=29,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8jX+pTxaeDXA5y4Lt3+HYLzwoWoj7w8Q+TaAP2Om+ZW/RXrMR/7moMcaLV8Y+iO6BXYhMxPummGFIv4FNE2LpZt+HlA5XAu1WYM2d9vz6WjOr3TWc3giU1qDh4/LEA9A==',key_name='tempest-keypair-283817410',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3dc03400ff4448682ebba991a7e8af6',ramdisk_id='',reservation_id='r-izyj3zjs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1807466388',owner_user_name='tempest-ServerActionsTestOtherA-1807466388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:34:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02982f15d1a640a5bc77069a906f3e9a',uuid=f4210738-d01e-4408-a15c-aeccada6dd23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb573e79-a106-40c5-8c53-ab73eb6ba240", "address": "fa:16:3e:1e:80:9b", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb573e79-a1", "ovs_interfaceid": "bb573e79-a106-40c5-8c53-ab73eb6ba240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Converting VIF {"id": "bb573e79-a106-40c5-8c53-ab73eb6ba240", "address": "fa:16:3e:1e:80:9b", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb573e79-a1", "ovs_interfaceid": "bb573e79-a106-40c5-8c53-ab73eb6ba240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:80:9b,bridge_name='br-int',has_traffic_filtering=True,id=bb573e79-a106-40c5-8c53-ab73eb6ba240,network=Network(1a1a40b0-631c-4f41-9ece-17cd713adfd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb573e79-a1') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG os_vif [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:80:9b,bridge_name='br-int',has_traffic_filtering=True,id=bb573e79-a106-40c5-8c53-ab73eb6ba240,network=Network(1a1a40b0-631c-4f41-9ece-17cd713adfd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb573e79-a1') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb573e79-a1, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbb573e79-a1, col_values=(('external_ids', {'iface-id': 'bb573e79-a106-40c5-8c53-ab73eb6ba240', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:80:9b', 'vm-uuid': 'f4210738-d01e-4408-a15c-aeccada6dd23'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:34:59 user nova-compute[72773]: INFO os_vif [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:80:9b,bridge_name='br-int',has_traffic_filtering=True,id=bb573e79-a106-40c5-8c53-ab73eb6ba240,network=Network(1a1a40b0-631c-4f41-9ece-17cd713adfd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb573e79-a1')
Aug 16 22:34:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] No VIF found with MAC fa:16:3e:1e:80:9b, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG nova.network.neutron [req-b2804403-6158-4e9f-8fe3-0cdd79b615fc req-07814e5d-2f97-4b3a-9b05-6e847cfd1e26 service nova] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Updated VIF entry in instance network info cache for port bb573e79-a106-40c5-8c53-ab73eb6ba240. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:34:59 user nova-compute[72773]: DEBUG nova.network.neutron [req-b2804403-6158-4e9f-8fe3-0cdd79b615fc req-07814e5d-2f97-4b3a-9b05-6e847cfd1e26 service nova] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Updating instance_info_cache with network_info: [{"id": "bb573e79-a106-40c5-8c53-ab73eb6ba240", "address": "fa:16:3e:1e:80:9b", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb573e79-a1", "ovs_interfaceid": "bb573e79-a106-40c5-8c53-ab73eb6ba240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:35:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b2804403-6158-4e9f-8fe3-0cdd79b615fc req-07814e5d-2f97-4b3a-9b05-6e847cfd1e26 service nova] Releasing lock "refresh_cache-f4210738-d01e-4408-a15c-aeccada6dd23" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:35:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9259e07-3d7f-4169-96fc-b080b4b9ce6a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9259e07-3d7f-4169-96fc-b080b4b9ce6a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9259e07-3d7f-4169-96fc-b080b4b9ce6a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9259e07-3d7f-4169-96fc-b080b4b9ce6a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:01 user nova-compute[72773]: DEBUG nova.compute.manager [req-cacce980-6c1f-4d93-aed5-6d20e16c88e5 req-d8b6cccc-fab0-4029-ae1c-858635b98e5c service nova] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Received event network-vif-plugged-bb573e79-a106-40c5-8c53-ab73eb6ba240 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:35:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-cacce980-6c1f-4d93-aed5-6d20e16c88e5 req-d8b6cccc-fab0-4029-ae1c-858635b98e5c service nova] Acquiring lock "f4210738-d01e-4408-a15c-aeccada6dd23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:35:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-cacce980-6c1f-4d93-aed5-6d20e16c88e5 req-d8b6cccc-fab0-4029-ae1c-858635b98e5c service nova] Lock "f4210738-d01e-4408-a15c-aeccada6dd23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:35:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-cacce980-6c1f-4d93-aed5-6d20e16c88e5 req-d8b6cccc-fab0-4029-ae1c-858635b98e5c service nova] Lock "f4210738-d01e-4408-a15c-aeccada6dd23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:35:01 user nova-compute[72773]: DEBUG nova.compute.manager [req-cacce980-6c1f-4d93-aed5-6d20e16c88e5 req-d8b6cccc-fab0-4029-ae1c-858635b98e5c service nova] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] No waiting events found dispatching network-vif-plugged-bb573e79-a106-40c5-8c53-ab73eb6ba240 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:35:01 user nova-compute[72773]: WARNING nova.compute.manager [req-cacce980-6c1f-4d93-aed5-6d20e16c88e5 req-d8b6cccc-fab0-4029-ae1c-858635b98e5c service nova] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Received unexpected event network-vif-plugged-bb573e79-a106-40c5-8c53-ab73eb6ba240 for instance with vm_state building and task_state spawning.
Aug 16 22:35:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da5bbc3-b0f9-48d1-be93-86e63e4963c2/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da5bbc3-b0f9-48d1-be93-86e63e4963c2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da5bbc3-b0f9-48d1-be93-86e63e4963c2/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9da5bbc3-b0f9-48d1-be93-86e63e4963c2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:03 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225303.2626889, f4210738-d01e-4408-a15c-aeccada6dd23 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:35:03 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] VM Resumed (Lifecycle Event)
Aug 16 22:35:03 user nova-compute[72773]: DEBUG nova.compute.manager [req-31cc63fc-fd79-44f3-9e80-255c2527de82 req-3ae82766-5f09-4471-9414-e697ed38907e service nova] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Received event network-vif-plugged-bb573e79-a106-40c5-8c53-ab73eb6ba240 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:35:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-31cc63fc-fd79-44f3-9e80-255c2527de82 req-3ae82766-5f09-4471-9414-e697ed38907e service nova] Acquiring lock "f4210738-d01e-4408-a15c-aeccada6dd23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:35:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-31cc63fc-fd79-44f3-9e80-255c2527de82 req-3ae82766-5f09-4471-9414-e697ed38907e service nova] Lock "f4210738-d01e-4408-a15c-aeccada6dd23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:35:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-31cc63fc-fd79-44f3-9e80-255c2527de82 req-3ae82766-5f09-4471-9414-e697ed38907e service nova] Lock "f4210738-d01e-4408-a15c-aeccada6dd23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:35:03 user nova-compute[72773]: DEBUG nova.compute.manager [req-31cc63fc-fd79-44f3-9e80-255c2527de82 req-3ae82766-5f09-4471-9414-e697ed38907e service nova] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] No waiting events found dispatching network-vif-plugged-bb573e79-a106-40c5-8c53-ab73eb6ba240 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:35:03 user nova-compute[72773]: WARNING nova.compute.manager [req-31cc63fc-fd79-44f3-9e80-255c2527de82 req-3ae82766-5f09-4471-9414-e697ed38907e service nova] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Received unexpected event network-vif-plugged-bb573e79-a106-40c5-8c53-ab73eb6ba240 for instance with vm_state building and task_state spawning.
Aug 16 22:35:03 user nova-compute[72773]: DEBUG nova.compute.manager [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:35:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:35:03 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:35:03 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:35:03 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=7302MB free_disk=25.466773986816406GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:35:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:35:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:35:03 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Instance spawned successfully.
Aug 16 22:35:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:35:03 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:35:03 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:35:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:35:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:35:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:35:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:35:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:35:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:35:03 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:35:03 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225303.2629704, f4210738-d01e-4408-a15c-aeccada6dd23 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:35:03 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] VM Started (Lifecycle Event)
Aug 16 22:35:03 user nova-compute[72773]: INFO nova.compute.manager [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Took 6.70 seconds to spawn the instance on the hypervisor.
Aug 16 22:35:03 user nova-compute[72773]: DEBUG nova.compute.manager [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:35:03 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:35:03 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:35:03 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:35:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 956d334e-f190-4625-b144-ab44d2f3321a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:35:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 030d076d-5099-4236-ae31-6025017eb51e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:35:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 9ea2a759-7a26-4ad6-9902-b8b75931b5f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:35:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance ac2b49e4-59bc-46cd-b7d9-67aa68296e4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:35:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 391a6006-4fe6-4398-a1e8-ae95b5edbf2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:35:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance cf01c401-c424-4b3e-aa5b-439d62b1ae4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:35:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance e9259e07-3d7f-4169-96fc-b080b4b9ce6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:35:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 23894101-2fd3-41a4-83a3-8f6869d24d97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:35:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 9da5bbc3-b0f9-48d1-be93-86e63e4963c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:35:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 5ebcd117-6765-44eb-871b-226afd58e4e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:35:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance f4210738-d01e-4408-a15c-aeccada6dd23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:35:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:35:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:35:04 user nova-compute[72773]: INFO nova.compute.manager [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Took 7.68 seconds to build instance.
Aug 16 22:35:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f8472da7-7d20-440f-ae67-cfc152d928b1 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "f4210738-d01e-4408-a15c-aeccada6dd23" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.842s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:35:04 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:35:04 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:35:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:35:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.627s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:35:04 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:08 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:35:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5ce2be5d-e8f4-4a33-927e-d92050bb7761 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Acquiring lock "9da5bbc3-b0f9-48d1-be93-86e63e4963c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:35:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5ce2be5d-e8f4-4a33-927e-d92050bb7761 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lock "9da5bbc3-b0f9-48d1-be93-86e63e4963c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:35:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5ce2be5d-e8f4-4a33-927e-d92050bb7761 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Acquiring lock "9da5bbc3-b0f9-48d1-be93-86e63e4963c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:35:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5ce2be5d-e8f4-4a33-927e-d92050bb7761 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lock "9da5bbc3-b0f9-48d1-be93-86e63e4963c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:35:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5ce2be5d-e8f4-4a33-927e-d92050bb7761 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lock "9da5bbc3-b0f9-48d1-be93-86e63e4963c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:35:13 user nova-compute[72773]: INFO nova.compute.manager [None req-5ce2be5d-e8f4-4a33-927e-d92050bb7761 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Terminating instance
Aug 16 22:35:13 user nova-compute[72773]: DEBUG nova.compute.manager [None req-5ce2be5d-e8f4-4a33-927e-d92050bb7761 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:35:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Acquiring lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:35:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:35:14 user nova-compute[72773]: DEBUG nova.objects.instance [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lazy-loading 'flavor' on Instance uuid 9ea2a759-7a26-4ad6-9902-b8b75931b5f0 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:35:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:35:14 user nova-compute[72773]: DEBUG nova.compute.manager [req-db6c8168-461f-4c46-be06-017d28055a4a req-05407bfa-2f3a-43a3-93ae-5ca6ac6b49e5 service nova] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Received event network-vif-unplugged-d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:35:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-db6c8168-461f-4c46-be06-017d28055a4a req-05407bfa-2f3a-43a3-93ae-5ca6ac6b49e5 service nova] Acquiring lock "9da5bbc3-b0f9-48d1-be93-86e63e4963c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:35:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-db6c8168-461f-4c46-be06-017d28055a4a req-05407bfa-2f3a-43a3-93ae-5ca6ac6b49e5 service nova] Lock "9da5bbc3-b0f9-48d1-be93-86e63e4963c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:35:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-db6c8168-461f-4c46-be06-017d28055a4a req-05407bfa-2f3a-43a3-93ae-5ca6ac6b49e5 service nova] Lock "9da5bbc3-b0f9-48d1-be93-86e63e4963c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:35:14 user nova-compute[72773]: DEBUG nova.compute.manager [req-db6c8168-461f-4c46-be06-017d28055a4a req-05407bfa-2f3a-43a3-93ae-5ca6ac6b49e5 service nova] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] No waiting events found dispatching network-vif-unplugged-d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:35:14 user nova-compute[72773]: DEBUG nova.compute.manager [req-db6c8168-461f-4c46-be06-017d28055a4a req-05407bfa-2f3a-43a3-93ae-5ca6ac6b49e5 service nova] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Received event network-vif-unplugged-d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:35:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Acquiring lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:35:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:35:14 user nova-compute[72773]: INFO nova.compute.manager [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Attaching volume a4fed383-3540-45ca-9d2f-82daa2d66ad4 to /dev/vdb
Aug 16 22:35:14 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Instance destroyed successfully.
Aug 16 22:35:14 user nova-compute[72773]: DEBUG nova.objects.instance [None req-5ce2be5d-e8f4-4a33-927e-d92050bb7761 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lazy-loading 'resources' on Instance uuid 9da5bbc3-b0f9-48d1-be93-86e63e4963c2 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:35:14 user nova-compute[72773]: DEBUG os_brick.utils [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:35:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-5ce2be5d-e8f4-4a33-927e-d92050bb7761 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:33:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-568978705',display_name='tempest-ServersNegativeTestJSON-server-568978705',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-568978705',id=27,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:33:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a20f7a479ca4dbebe1ef08f466d2e55',ramdisk_id='',reservation_id='r-h22js5bi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-526921722',owner_user_name='tempest-ServersNegativeTestJSON-526921722-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:33:34Z,user_data=None,user_id='0d14c71e4a9d42d886602349c6d568e8',uuid=9da5bbc3-b0f9-48d1-be93-86e63e4963c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7", "address": "fa:16:3e:1f:3f:d4", "network": {"id": "0567b846-3f19-403c-9ec6-ac2a82af5f4a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-290484898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a20f7a479ca4dbebe1ef08f466d2e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd062f4e3-cb", "ovs_interfaceid": "d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:35:14 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-5ce2be5d-e8f4-4a33-927e-d92050bb7761 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Converting VIF {"id": "d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7", "address": "fa:16:3e:1f:3f:d4", "network": {"id": "0567b846-3f19-403c-9ec6-ac2a82af5f4a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-290484898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a20f7a479ca4dbebe1ef08f466d2e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd062f4e3-cb", "ovs_interfaceid": "d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:35:14 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-5ce2be5d-e8f4-4a33-927e-d92050bb7761 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:3f:d4,bridge_name='br-int',has_traffic_filtering=True,id=d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7,network=Network(0567b846-3f19-403c-9ec6-ac2a82af5f4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd062f4e3-cb') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:35:14 user nova-compute[72773]: DEBUG os_vif [None req-5ce2be5d-e8f4-4a33-927e-d92050bb7761 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:3f:d4,bridge_name='br-int',has_traffic_filtering=True,id=d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7,network=Network(0567b846-3f19-403c-9ec6-ac2a82af5f4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd062f4e3-cb') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:35:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd062f4e3-cb, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:35:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:14 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[82243ef0-118b-41ef-a753-b72e7fcbb33d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:35:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:15 user nova-compute[72773]: INFO os_vif [None req-5ce2be5d-e8f4-4a33-927e-d92050bb7761 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:3f:d4,bridge_name='br-int',has_traffic_filtering=True,id=d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7,network=Network(0567b846-3f19-403c-9ec6-ac2a82af5f4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd062f4e3-cb')
Aug 16 22:35:15 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-5ce2be5d-e8f4-4a33-927e-d92050bb7761 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Deleting instance files /opt/stack/data/nova/instances/9da5bbc3-b0f9-48d1-be93-86e63e4963c2_del
Aug 16 22:35:15 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-5ce2be5d-e8f4-4a33-927e-d92050bb7761 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Deletion of /opt/stack/data/nova/instances/9da5bbc3-b0f9-48d1-be93-86e63e4963c2_del complete
Aug 16 22:35:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:15 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[718f3b6f-c8ab-4974-997d-c9adb3b2b5af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:35:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:15 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9c5315-b2f2-4959-b566-c0f98fc5dd76]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:35:15 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0979a0b5-3728-40f7-99d0-726b7ae64e68]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:35:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:35:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:35:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:35:15 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:35:15 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[934c8b4b-5a42-4612-ab70-6cce6b4343e5]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:35:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:35:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:35:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:35:15 user nova-compute[72773]: DEBUG os_brick.utils [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:35:15 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Updating existing volume attachment record: 6bb78ba6-6597-487a-9038-344b2c9ba7b6 {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:35:15 user nova-compute[72773]: INFO nova.compute.manager [None req-5ce2be5d-e8f4-4a33-927e-d92050bb7761 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 16 22:35:15 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-5ce2be5d-e8f4-4a33-927e-d92050bb7761 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:35:15 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:35:15 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:35:16 user nova-compute[72773]: DEBUG nova.compute.manager [req-c9807e03-d5cc-43d7-b500-bd222628b88a req-dc1e5963-8900-44e7-a035-8e4035685368 service nova] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Received event network-vif-plugged-d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:35:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c9807e03-d5cc-43d7-b500-bd222628b88a req-dc1e5963-8900-44e7-a035-8e4035685368 service nova] Acquiring lock "9da5bbc3-b0f9-48d1-be93-86e63e4963c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:35:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c9807e03-d5cc-43d7-b500-bd222628b88a req-dc1e5963-8900-44e7-a035-8e4035685368 service nova] Lock "9da5bbc3-b0f9-48d1-be93-86e63e4963c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:35:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c9807e03-d5cc-43d7-b500-bd222628b88a req-dc1e5963-8900-44e7-a035-8e4035685368 service nova] Lock "9da5bbc3-b0f9-48d1-be93-86e63e4963c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:35:16 user nova-compute[72773]: DEBUG nova.compute.manager [req-c9807e03-d5cc-43d7-b500-bd222628b88a req-dc1e5963-8900-44e7-a035-8e4035685368 service nova] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] No waiting events found dispatching network-vif-plugged-d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:35:16 user nova-compute[72773]: WARNING nova.compute.manager [req-c9807e03-d5cc-43d7-b500-bd222628b88a req-dc1e5963-8900-44e7-a035-8e4035685368 service nova] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Received unexpected event network-vif-plugged-d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7 for instance with vm_state active and task_state deleting.
Aug 16 22:35:17 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:35:18 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Took 2.88 seconds to deallocate network for instance.
Aug 16 22:35:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5ce2be5d-e8f4-4a33-927e-d92050bb7761 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:35:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5ce2be5d-e8f4-4a33-927e-d92050bb7761 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:35:18 user nova-compute[72773]: DEBUG nova.compute.manager [req-1e15f7a5-c254-4de2-960f-4bc0f5c8f8cd req-cd3727b5-c6b1-464b-a6f9-2f15b51b5974 service nova] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Received event network-vif-deleted-d062f4e3-cbb3-4d4d-b8f9-93663c57cdf7 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:35:18 user nova-compute[72773]: DEBUG nova.compute.manager [None req-575eb2da-c7d4-47b7-adad-7f218e183aa6 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:35:18 user nova-compute[72773]: INFO nova.compute.manager [None req-575eb2da-c7d4-47b7-adad-7f218e183aa6 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] instance snapshotting
Aug 16 22:35:19 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-575eb2da-c7d4-47b7-adad-7f218e183aa6 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Beginning live snapshot process
Aug 16 22:35:19 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-5ce2be5d-e8f4-4a33-927e-d92050bb7761 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:35:19 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-5ce2be5d-e8f4-4a33-927e-d92050bb7761 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:35:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5ce2be5d-e8f4-4a33-927e-d92050bb7761 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.765s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:35:19 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-5ce2be5d-e8f4-4a33-927e-d92050bb7761 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Deleted allocations for instance 9da5bbc3-b0f9-48d1-be93-86e63e4963c2
Aug 16 22:35:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-575eb2da-c7d4-47b7-adad-7f218e183aa6 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json -f qcow2 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5ce2be5d-e8f4-4a33-927e-d92050bb7761 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lock "9da5bbc3-b0f9-48d1-be93-86e63e4963c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.562s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:35:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-575eb2da-c7d4-47b7-adad-7f218e183aa6 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json -f qcow2" returned: 0 in 0.236s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-575eb2da-c7d4-47b7-adad-7f218e183aa6 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json -f qcow2 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-575eb2da-c7d4-47b7-adad-7f218e183aa6 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json -f qcow2" returned: 0 in 0.194s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-575eb2da-c7d4-47b7-adad-7f218e183aa6 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-575eb2da-c7d4-47b7-adad-7f218e183aa6 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.221s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-575eb2da-c7d4-47b7-adad-7f218e183aa6 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp32fqqobm/47ce924bea2a4686869caf985e76d3f4.delta 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-575eb2da-c7d4-47b7-adad-7f218e183aa6 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp32fqqobm/47ce924bea2a4686869caf985e76d3f4.delta 1073741824" returned: 0 in 0.063s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:20 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-575eb2da-c7d4-47b7-adad-7f218e183aa6 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 22:35:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Acquiring lock "6f0f7d89-62d2-44cb-9dfc-f4e8d9285394" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:35:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "6f0f7d89-62d2-44cb-9dfc-f4e8d9285394" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:35:20 user nova-compute[72773]: DEBUG nova.compute.manager [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:35:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:35:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:35:21 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:35:21 user nova-compute[72773]: INFO nova.compute.claims [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Claim successful on node user
Aug 16 22:35:21 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-575eb2da-c7d4-47b7-adad-7f218e183aa6 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72773) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 22:35:21 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-575eb2da-c7d4-47b7-adad-7f218e183aa6 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72773) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 22:35:21 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-575eb2da-c7d4-47b7-adad-7f218e183aa6 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 22:35:21 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:35:21 user nova-compute[72773]: DEBUG nova.privsep.utils [None req-575eb2da-c7d4-47b7-adad-7f218e183aa6 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72773) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 22:35:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-575eb2da-c7d4-47b7-adad-7f218e183aa6 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp32fqqobm/47ce924bea2a4686869caf985e76d3f4.delta /opt/stack/data/nova/instances/snapshots/tmp32fqqobm/47ce924bea2a4686869caf985e76d3f4 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:21 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:35:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.769s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:35:21 user nova-compute[72773]: DEBUG nova.compute.manager [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:35:21 user nova-compute[72773]: DEBUG nova.compute.manager [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:35:21 user nova-compute[72773]: DEBUG nova.network.neutron [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:35:21 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:35:22 user nova-compute[72773]: DEBUG nova.compute.manager [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:35:22 user nova-compute[72773]: DEBUG nova.policy [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '432dc5daebf442fba54be7f62f6bb09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b8417e50ee41e89fedf55e7134fecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:35:22 user nova-compute[72773]: DEBUG nova.compute.manager [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:35:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:35:22 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Creating image(s)
Aug 16 22:35:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f0f7d89-62d2-44cb-9dfc-f4e8d9285394/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:35:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "/opt/stack/data/nova/instances/6f0f7d89-62d2-44cb-9dfc-f4e8d9285394/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:35:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "/opt/stack/data/nova/instances/6f0f7d89-62d2-44cb-9dfc-f4e8d9285394/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:35:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-575eb2da-c7d4-47b7-adad-7f218e183aa6 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp32fqqobm/47ce924bea2a4686869caf985e76d3f4.delta /opt/stack/data/nova/instances/snapshots/tmp32fqqobm/47ce924bea2a4686869caf985e76d3f4" returned: 0 in 0.640s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:22 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-575eb2da-c7d4-47b7-adad-7f218e183aa6 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Snapshot extracted, beginning image upload
Aug 16 22:35:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.205s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:35:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:35:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.251s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/6f0f7d89-62d2-44cb-9dfc-f4e8d9285394/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/6f0f7d89-62d2-44cb-9dfc-f4e8d9285394/disk 1073741824" returned: 0 in 0.070s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.329s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:35:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.194s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:23 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f0f7d89-62d2-44cb-9dfc-f4e8d9285394/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:35:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0f7d89-62d2-44cb-9dfc-f4e8d9285394/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:23 user nova-compute[72773]: DEBUG nova.network.neutron [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Successfully created port: 41910b89-24df-459d-8f24-0a012a999f1a {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:35:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0f7d89-62d2-44cb-9dfc-f4e8d9285394/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:23 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Cannot resize image /opt/stack/data/nova/instances/6f0f7d89-62d2-44cb-9dfc-f4e8d9285394/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:35:23 user nova-compute[72773]: DEBUG nova.objects.instance [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lazy-loading 'migration_context' on Instance uuid 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:35:23 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:35:23 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Ensure instance console log exists: /opt/stack/data/nova/instances/6f0f7d89-62d2-44cb-9dfc-f4e8d9285394/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:35:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:35:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:35:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG nova.network.neutron [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Successfully updated port: 41910b89-24df-459d-8f24-0a012a999f1a {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Acquiring lock "refresh_cache-6f0f7d89-62d2-44cb-9dfc-f4e8d9285394" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Acquired lock "refresh_cache-6f0f7d89-62d2-44cb-9dfc-f4e8d9285394" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG nova.network.neutron [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG nova.network.neutron [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG nova.compute.manager [req-a5f0eec7-9500-4f6f-b229-3f52019d5036 req-aa505674-3521-4da9-afc9-e8eee73e8413 service nova] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Received event network-changed-41910b89-24df-459d-8f24-0a012a999f1a {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG nova.compute.manager [req-a5f0eec7-9500-4f6f-b229-3f52019d5036 req-aa505674-3521-4da9-afc9-e8eee73e8413 service nova] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Refreshing instance network info cache due to event network-changed-41910b89-24df-459d-8f24-0a012a999f1a. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a5f0eec7-9500-4f6f-b229-3f52019d5036 req-aa505674-3521-4da9-afc9-e8eee73e8413 service nova] Acquiring lock "refresh_cache-6f0f7d89-62d2-44cb-9dfc-f4e8d9285394" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG nova.network.neutron [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Updating instance_info_cache with network_info: [{"id": "41910b89-24df-459d-8f24-0a012a999f1a", "address": "fa:16:3e:cd:8e:28", "network": {"id": "6194759c-ac83-4c8f-8604-c30c22e3ce5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-161254247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b8417e50ee41e89fedf55e7134fecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41910b89-24", "ovs_interfaceid": "41910b89-24df-459d-8f24-0a012a999f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Releasing lock "refresh_cache-6f0f7d89-62d2-44cb-9dfc-f4e8d9285394" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG nova.compute.manager [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Instance network_info: |[{"id": "41910b89-24df-459d-8f24-0a012a999f1a", "address": "fa:16:3e:cd:8e:28", "network": {"id": "6194759c-ac83-4c8f-8604-c30c22e3ce5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-161254247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b8417e50ee41e89fedf55e7134fecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41910b89-24", "ovs_interfaceid": "41910b89-24df-459d-8f24-0a012a999f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a5f0eec7-9500-4f6f-b229-3f52019d5036 req-aa505674-3521-4da9-afc9-e8eee73e8413 service nova] Acquired lock "refresh_cache-6f0f7d89-62d2-44cb-9dfc-f4e8d9285394" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG nova.network.neutron [req-a5f0eec7-9500-4f6f-b229-3f52019d5036 req-aa505674-3521-4da9-afc9-e8eee73e8413 service nova] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Refreshing network info cache for port 41910b89-24df-459d-8f24-0a012a999f1a {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Start _get_guest_xml network_info=[{"id": "41910b89-24df-459d-8f24-0a012a999f1a", "address": "fa:16:3e:cd:8e:28", "network": {"id": "6194759c-ac83-4c8f-8604-c30c22e3ce5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-161254247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b8417e50ee41e89fedf55e7134fecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41910b89-24", "ovs_interfaceid": "41910b89-24df-459d-8f24-0a012a999f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:35:24 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:35:24 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:35:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:35:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2031018238',display_name='tempest-VolumesSnapshotTestJSON-instance-2031018238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2031018238',id=30,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2LMNpdundDZgxPmQpsT/j4Gsjc/CUagJj2G1Fe5NDZ0jPgnzc7BpiaYOb9h1e35Mg+0PgZzl5oVIAq80gkhg7WgqoGWayRh0hGyqE2NumwZqFNZsUw9xUGH2/GGt127Q==',key_name='tempest-keypair-2048764813',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59b8417e50ee41e89fedf55e7134fecd',ramdisk_id='',reservation_id='r-0v94usbw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-671770143',owner_user_name='tempest-VolumesSnapshotTestJSON-671770143-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:35:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='432dc5daebf442fba54be7f62f6bb09c',uuid=6f0f7d89-62d2-44cb-9dfc-f4e8d9285394,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41910b89-24df-459d-8f24-0a012a999f1a", "address": "fa:16:3e:cd:8e:28", "network": {"id": "6194759c-ac83-4c8f-8604-c30c22e3ce5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-161254247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b8417e50ee41e89fedf55e7134fecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41910b89-24", "ovs_interfaceid": "41910b89-24df-459d-8f24-0a012a999f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Converting VIF {"id": "41910b89-24df-459d-8f24-0a012a999f1a", "address": "fa:16:3e:cd:8e:28", "network": {"id": "6194759c-ac83-4c8f-8604-c30c22e3ce5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-161254247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b8417e50ee41e89fedf55e7134fecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41910b89-24", "ovs_interfaceid": "41910b89-24df-459d-8f24-0a012a999f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:8e:28,bridge_name='br-int',has_traffic_filtering=True,id=41910b89-24df-459d-8f24-0a012a999f1a,network=Network(6194759c-ac83-4c8f-8604-c30c22e3ce5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41910b89-24') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG nova.objects.instance [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:35:24 user nova-compute[72773]:   <uuid>6f0f7d89-62d2-44cb-9dfc-f4e8d9285394</uuid>
Aug 16 22:35:24 user nova-compute[72773]:   <name>instance-0000001e</name>
Aug 16 22:35:24 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:35:24 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:35:24 user nova-compute[72773]:   <metadata>
Aug 16 22:35:24 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:35:24 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:35:24 user nova-compute[72773]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2031018238</nova:name>
Aug 16 22:35:24 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:35:24</nova:creationTime>
Aug 16 22:35:24 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:35:24 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:35:24 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:35:24 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:35:24 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:35:24 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:35:24 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:35:24 user nova-compute[72773]:       <nova:owner>
Aug 16 22:35:24 user nova-compute[72773]:         <nova:user uuid="432dc5daebf442fba54be7f62f6bb09c">tempest-VolumesSnapshotTestJSON-671770143-project-member</nova:user>
Aug 16 22:35:24 user nova-compute[72773]:         <nova:project uuid="59b8417e50ee41e89fedf55e7134fecd">tempest-VolumesSnapshotTestJSON-671770143</nova:project>
Aug 16 22:35:24 user nova-compute[72773]:       </nova:owner>
Aug 16 22:35:24 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:35:24 user nova-compute[72773]:       <nova:ports>
Aug 16 22:35:24 user nova-compute[72773]:         <nova:port uuid="41910b89-24df-459d-8f24-0a012a999f1a">
Aug 16 22:35:24 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 22:35:24 user nova-compute[72773]:         </nova:port>
Aug 16 22:35:24 user nova-compute[72773]:       </nova:ports>
Aug 16 22:35:24 user nova-compute[72773]:     </nova:instance>
Aug 16 22:35:24 user nova-compute[72773]:   </metadata>
Aug 16 22:35:24 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:35:24 user nova-compute[72773]:     <system>
Aug 16 22:35:24 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:35:24 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:35:24 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:35:24 user nova-compute[72773]:       <entry name="serial">6f0f7d89-62d2-44cb-9dfc-f4e8d9285394</entry>
Aug 16 22:35:24 user nova-compute[72773]:       <entry name="uuid">6f0f7d89-62d2-44cb-9dfc-f4e8d9285394</entry>
Aug 16 22:35:24 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:35:24 user nova-compute[72773]:     </system>
Aug 16 22:35:24 user nova-compute[72773]:   </sysinfo>
Aug 16 22:35:24 user nova-compute[72773]:   <os>
Aug 16 22:35:24 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:35:24 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:35:24 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:35:24 user nova-compute[72773]:   </os>
Aug 16 22:35:24 user nova-compute[72773]:   <features>
Aug 16 22:35:24 user nova-compute[72773]:     <acpi/>
Aug 16 22:35:24 user nova-compute[72773]:     <apic/>
Aug 16 22:35:24 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:35:24 user nova-compute[72773]:   </features>
Aug 16 22:35:24 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:35:24 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:35:24 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:35:24 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:35:24 user nova-compute[72773]:   </clock>
Aug 16 22:35:24 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:35:24 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:35:24 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:35:24 user nova-compute[72773]:   </cpu>
Aug 16 22:35:24 user nova-compute[72773]:   <devices>
Aug 16 22:35:24 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:35:24 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:35:24 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/6f0f7d89-62d2-44cb-9dfc-f4e8d9285394/disk"/>
Aug 16 22:35:24 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:35:24 user nova-compute[72773]:     </disk>
Aug 16 22:35:24 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:35:24 user nova-compute[72773]:       <mac address="fa:16:3e:cd:8e:28"/>
Aug 16 22:35:24 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:35:24 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:35:24 user nova-compute[72773]:       <target dev="tap41910b89-24"/>
Aug 16 22:35:24 user nova-compute[72773]:     </interface>
Aug 16 22:35:24 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:35:24 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/6f0f7d89-62d2-44cb-9dfc-f4e8d9285394/console.log" append="off"/>
Aug 16 22:35:24 user nova-compute[72773]:     </serial>
Aug 16 22:35:24 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:35:24 user nova-compute[72773]:     <video>
Aug 16 22:35:24 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:35:24 user nova-compute[72773]:     </video>
Aug 16 22:35:24 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:35:24 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:35:24 user nova-compute[72773]:     </rng>
Aug 16 22:35:24 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:35:24 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:35:24 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:35:24 user nova-compute[72773]:     </memballoon>
Aug 16 22:35:24 user nova-compute[72773]:   </devices>
Aug 16 22:35:24 user nova-compute[72773]: </domain>
Aug 16 22:35:24 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:35:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2031018238',display_name='tempest-VolumesSnapshotTestJSON-instance-2031018238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2031018238',id=30,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2LMNpdundDZgxPmQpsT/j4Gsjc/CUagJj2G1Fe5NDZ0jPgnzc7BpiaYOb9h1e35Mg+0PgZzl5oVIAq80gkhg7WgqoGWayRh0hGyqE2NumwZqFNZsUw9xUGH2/GGt127Q==',key_name='tempest-keypair-2048764813',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59b8417e50ee41e89fedf55e7134fecd',ramdisk_id='',reservation_id='r-0v94usbw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-671770143',owner_user_name='tempest-VolumesSnapshotTestJSON-671770143-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:35:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='432dc5daebf442fba54be7f62f6bb09c',uuid=6f0f7d89-62d2-44cb-9dfc-f4e8d9285394,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41910b89-24df-459d-8f24-0a012a999f1a", "address": "fa:16:3e:cd:8e:28", "network": {"id": "6194759c-ac83-4c8f-8604-c30c22e3ce5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-161254247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b8417e50ee41e89fedf55e7134fecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41910b89-24", "ovs_interfaceid": "41910b89-24df-459d-8f24-0a012a999f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Converting VIF {"id": "41910b89-24df-459d-8f24-0a012a999f1a", "address": "fa:16:3e:cd:8e:28", "network": {"id": "6194759c-ac83-4c8f-8604-c30c22e3ce5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-161254247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b8417e50ee41e89fedf55e7134fecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41910b89-24", "ovs_interfaceid": "41910b89-24df-459d-8f24-0a012a999f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:8e:28,bridge_name='br-int',has_traffic_filtering=True,id=41910b89-24df-459d-8f24-0a012a999f1a,network=Network(6194759c-ac83-4c8f-8604-c30c22e3ce5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41910b89-24') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG os_vif [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:8e:28,bridge_name='br-int',has_traffic_filtering=True,id=41910b89-24df-459d-8f24-0a012a999f1a,network=Network(6194759c-ac83-4c8f-8604-c30c22e3ce5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41910b89-24') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41910b89-24, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap41910b89-24, col_values=(('external_ids', {'iface-id': '41910b89-24df-459d-8f24-0a012a999f1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:8e:28', 'vm-uuid': '6f0f7d89-62d2-44cb-9dfc-f4e8d9285394'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:24 user nova-compute[72773]: INFO os_vif [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:8e:28,bridge_name='br-int',has_traffic_filtering=True,id=41910b89-24df-459d-8f24-0a012a999f1a,network=Network(6194759c-ac83-4c8f-8604-c30c22e3ce5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41910b89-24')
Aug 16 22:35:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:35:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] No VIF found with MAC fa:16:3e:cd:8e:28, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:35:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:25 user nova-compute[72773]: DEBUG nova.network.neutron [req-a5f0eec7-9500-4f6f-b229-3f52019d5036 req-aa505674-3521-4da9-afc9-e8eee73e8413 service nova] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Updated VIF entry in instance network info cache for port 41910b89-24df-459d-8f24-0a012a999f1a. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:35:25 user nova-compute[72773]: DEBUG nova.network.neutron [req-a5f0eec7-9500-4f6f-b229-3f52019d5036 req-aa505674-3521-4da9-afc9-e8eee73e8413 service nova] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Updating instance_info_cache with network_info: [{"id": "41910b89-24df-459d-8f24-0a012a999f1a", "address": "fa:16:3e:cd:8e:28", "network": {"id": "6194759c-ac83-4c8f-8604-c30c22e3ce5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-161254247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b8417e50ee41e89fedf55e7134fecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41910b89-24", "ovs_interfaceid": "41910b89-24df-459d-8f24-0a012a999f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:35:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a5f0eec7-9500-4f6f-b229-3f52019d5036 req-aa505674-3521-4da9-afc9-e8eee73e8413 service nova] Releasing lock "refresh_cache-6f0f7d89-62d2-44cb-9dfc-f4e8d9285394" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:35:25 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-575eb2da-c7d4-47b7-adad-7f218e183aa6 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Snapshot image upload complete
Aug 16 22:35:25 user nova-compute[72773]: INFO nova.compute.manager [None req-575eb2da-c7d4-47b7-adad-7f218e183aa6 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Took 6.68 seconds to snapshot the instance on the hypervisor.
Aug 16 22:35:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:26 user nova-compute[72773]: DEBUG nova.compute.manager [req-ef964bc0-0389-496b-8334-d0983cfae111 req-15f78039-0173-47bb-9647-86e6949ba2ec service nova] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Received event network-vif-plugged-41910b89-24df-459d-8f24-0a012a999f1a {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:35:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ef964bc0-0389-496b-8334-d0983cfae111 req-15f78039-0173-47bb-9647-86e6949ba2ec service nova] Acquiring lock "6f0f7d89-62d2-44cb-9dfc-f4e8d9285394-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:35:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ef964bc0-0389-496b-8334-d0983cfae111 req-15f78039-0173-47bb-9647-86e6949ba2ec service nova] Lock "6f0f7d89-62d2-44cb-9dfc-f4e8d9285394-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:35:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ef964bc0-0389-496b-8334-d0983cfae111 req-15f78039-0173-47bb-9647-86e6949ba2ec service nova] Lock "6f0f7d89-62d2-44cb-9dfc-f4e8d9285394-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:35:26 user nova-compute[72773]: DEBUG nova.compute.manager [req-ef964bc0-0389-496b-8334-d0983cfae111 req-15f78039-0173-47bb-9647-86e6949ba2ec service nova] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] No waiting events found dispatching network-vif-plugged-41910b89-24df-459d-8f24-0a012a999f1a {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:35:26 user nova-compute[72773]: WARNING nova.compute.manager [req-ef964bc0-0389-496b-8334-d0983cfae111 req-15f78039-0173-47bb-9647-86e6949ba2ec service nova] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Received unexpected event network-vif-plugged-41910b89-24df-459d-8f24-0a012a999f1a for instance with vm_state building and task_state spawning.
Aug 16 22:35:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-00098353-1228-474c-870c-edcc46f6ca8c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "e9259e07-3d7f-4169-96fc-b080b4b9ce6a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:35:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-00098353-1228-474c-870c-edcc46f6ca8c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "e9259e07-3d7f-4169-96fc-b080b4b9ce6a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:35:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-00098353-1228-474c-870c-edcc46f6ca8c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "e9259e07-3d7f-4169-96fc-b080b4b9ce6a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:35:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-00098353-1228-474c-870c-edcc46f6ca8c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "e9259e07-3d7f-4169-96fc-b080b4b9ce6a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:35:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-00098353-1228-474c-870c-edcc46f6ca8c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "e9259e07-3d7f-4169-96fc-b080b4b9ce6a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:35:27 user nova-compute[72773]: INFO nova.compute.manager [None req-00098353-1228-474c-870c-edcc46f6ca8c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Terminating instance
Aug 16 22:35:27 user nova-compute[72773]: DEBUG nova.compute.manager [None req-00098353-1228-474c-870c-edcc46f6ca8c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:35:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:28 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Instance destroyed successfully.
Aug 16 22:35:28 user nova-compute[72773]: DEBUG nova.objects.instance [None req-00098353-1228-474c-870c-edcc46f6ca8c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lazy-loading 'resources' on Instance uuid e9259e07-3d7f-4169-96fc-b080b4b9ce6a {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:35:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-00098353-1228-474c-870c-edcc46f6ca8c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:32:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2076296167',display_name='tempest-AttachVolumeNegativeTest-server-2076296167',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2076296167',id=24,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwF1i3r+Je4gjVxmd/yRAVvJnibw7m7REMhsm/9+fW4rz/TG2TRVgLY0243IfvNGQyFthB5HO+2no0OwhZzJYte1TuPJ47cf6J12LJNPVYyv9EeC29eVfkFLPjQKdp2zA==',key_name='tempest-keypair-431434493',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:32:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc49739a140d40508ea307eedceb9aaa',ramdisk_id='',reservation_id='r-dbt02mqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-801754299',owner_user_name='tempest-AttachVolumeNegativeTest-801754299-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:32:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3b873f599fc4a2686c154d856bd5f06',uuid=e9259e07-3d7f-4169-96fc-b080b4b9ce6a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3dd11c55-5b19-4376-954d-bb0339a28f07", "address": "fa:16:3e:92:99:c6", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd11c55-5b", "ovs_interfaceid": "3dd11c55-5b19-4376-954d-bb0339a28f07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:35:28 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-00098353-1228-474c-870c-edcc46f6ca8c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Converting VIF {"id": "3dd11c55-5b19-4376-954d-bb0339a28f07", "address": "fa:16:3e:92:99:c6", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd11c55-5b", "ovs_interfaceid": "3dd11c55-5b19-4376-954d-bb0339a28f07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:35:28 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-00098353-1228-474c-870c-edcc46f6ca8c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:99:c6,bridge_name='br-int',has_traffic_filtering=True,id=3dd11c55-5b19-4376-954d-bb0339a28f07,network=Network(e0974c13-ec74-4a35-95b4-afae254c04a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd11c55-5b') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:35:28 user nova-compute[72773]: DEBUG os_vif [None req-00098353-1228-474c-870c-edcc46f6ca8c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:99:c6,bridge_name='br-int',has_traffic_filtering=True,id=3dd11c55-5b19-4376-954d-bb0339a28f07,network=Network(e0974c13-ec74-4a35-95b4-afae254c04a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd11c55-5b') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:35:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3dd11c55-5b, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:35:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:28 user nova-compute[72773]: INFO os_vif [None req-00098353-1228-474c-870c-edcc46f6ca8c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:99:c6,bridge_name='br-int',has_traffic_filtering=True,id=3dd11c55-5b19-4376-954d-bb0339a28f07,network=Network(e0974c13-ec74-4a35-95b4-afae254c04a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd11c55-5b')
Aug 16 22:35:28 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-00098353-1228-474c-870c-edcc46f6ca8c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Deleting instance files /opt/stack/data/nova/instances/e9259e07-3d7f-4169-96fc-b080b4b9ce6a_del
Aug 16 22:35:28 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-00098353-1228-474c-870c-edcc46f6ca8c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Deletion of /opt/stack/data/nova/instances/e9259e07-3d7f-4169-96fc-b080b4b9ce6a_del complete
Aug 16 22:35:28 user nova-compute[72773]: INFO nova.compute.manager [None req-00098353-1228-474c-870c-edcc46f6ca8c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 16 22:35:28 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-00098353-1228-474c-870c-edcc46f6ca8c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:35:28 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:35:28 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:35:28 user nova-compute[72773]: DEBUG nova.compute.manager [req-9c3b9892-08bf-4856-b2dd-ad977511ceeb req-97559a46-984f-4ca8-8923-97dc09330e52 service nova] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Received event network-vif-plugged-41910b89-24df-459d-8f24-0a012a999f1a {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:35:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9c3b9892-08bf-4856-b2dd-ad977511ceeb req-97559a46-984f-4ca8-8923-97dc09330e52 service nova] Acquiring lock "6f0f7d89-62d2-44cb-9dfc-f4e8d9285394-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:35:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9c3b9892-08bf-4856-b2dd-ad977511ceeb req-97559a46-984f-4ca8-8923-97dc09330e52 service nova] Lock "6f0f7d89-62d2-44cb-9dfc-f4e8d9285394-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:35:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9c3b9892-08bf-4856-b2dd-ad977511ceeb req-97559a46-984f-4ca8-8923-97dc09330e52 service nova] Lock "6f0f7d89-62d2-44cb-9dfc-f4e8d9285394-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:35:28 user nova-compute[72773]: DEBUG nova.compute.manager [req-9c3b9892-08bf-4856-b2dd-ad977511ceeb req-97559a46-984f-4ca8-8923-97dc09330e52 service nova] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] No waiting events found dispatching network-vif-plugged-41910b89-24df-459d-8f24-0a012a999f1a {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:35:28 user nova-compute[72773]: WARNING nova.compute.manager [req-9c3b9892-08bf-4856-b2dd-ad977511ceeb req-97559a46-984f-4ca8-8923-97dc09330e52 service nova] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Received unexpected event network-vif-plugged-41910b89-24df-459d-8f24-0a012a999f1a for instance with vm_state building and task_state spawning.
Aug 16 22:35:28 user nova-compute[72773]: DEBUG nova.compute.manager [req-9c3b9892-08bf-4856-b2dd-ad977511ceeb req-97559a46-984f-4ca8-8923-97dc09330e52 service nova] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Received event network-vif-unplugged-3dd11c55-5b19-4376-954d-bb0339a28f07 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:35:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9c3b9892-08bf-4856-b2dd-ad977511ceeb req-97559a46-984f-4ca8-8923-97dc09330e52 service nova] Acquiring lock "e9259e07-3d7f-4169-96fc-b080b4b9ce6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:35:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9c3b9892-08bf-4856-b2dd-ad977511ceeb req-97559a46-984f-4ca8-8923-97dc09330e52 service nova] Lock "e9259e07-3d7f-4169-96fc-b080b4b9ce6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:35:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9c3b9892-08bf-4856-b2dd-ad977511ceeb req-97559a46-984f-4ca8-8923-97dc09330e52 service nova] Lock "e9259e07-3d7f-4169-96fc-b080b4b9ce6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:35:28 user nova-compute[72773]: DEBUG nova.compute.manager [req-9c3b9892-08bf-4856-b2dd-ad977511ceeb req-97559a46-984f-4ca8-8923-97dc09330e52 service nova] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] No waiting events found dispatching network-vif-unplugged-3dd11c55-5b19-4376-954d-bb0339a28f07 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:35:28 user nova-compute[72773]: DEBUG nova.compute.manager [req-9c3b9892-08bf-4856-b2dd-ad977511ceeb req-97559a46-984f-4ca8-8923-97dc09330e52 service nova] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Received event network-vif-unplugged-3dd11c55-5b19-4376-954d-bb0339a28f07 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:35:28 user nova-compute[72773]: DEBUG nova.compute.manager [req-9c3b9892-08bf-4856-b2dd-ad977511ceeb req-97559a46-984f-4ca8-8923-97dc09330e52 service nova] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Received event network-vif-plugged-3dd11c55-5b19-4376-954d-bb0339a28f07 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:35:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9c3b9892-08bf-4856-b2dd-ad977511ceeb req-97559a46-984f-4ca8-8923-97dc09330e52 service nova] Acquiring lock "e9259e07-3d7f-4169-96fc-b080b4b9ce6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:35:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9c3b9892-08bf-4856-b2dd-ad977511ceeb req-97559a46-984f-4ca8-8923-97dc09330e52 service nova] Lock "e9259e07-3d7f-4169-96fc-b080b4b9ce6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:35:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9c3b9892-08bf-4856-b2dd-ad977511ceeb req-97559a46-984f-4ca8-8923-97dc09330e52 service nova] Lock "e9259e07-3d7f-4169-96fc-b080b4b9ce6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:35:28 user nova-compute[72773]: DEBUG nova.compute.manager [req-9c3b9892-08bf-4856-b2dd-ad977511ceeb req-97559a46-984f-4ca8-8923-97dc09330e52 service nova] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] No waiting events found dispatching network-vif-plugged-3dd11c55-5b19-4376-954d-bb0339a28f07 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:35:28 user nova-compute[72773]: WARNING nova.compute.manager [req-9c3b9892-08bf-4856-b2dd-ad977511ceeb req-97559a46-984f-4ca8-8923-97dc09330e52 service nova] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Received unexpected event network-vif-plugged-3dd11c55-5b19-4376-954d-bb0339a28f07 for instance with vm_state active and task_state deleting.
Aug 16 22:35:28 user nova-compute[72773]: DEBUG nova.compute.manager [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:35:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:35:28 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225328.9726124, 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:35:28 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] VM Resumed (Lifecycle Event)
Aug 16 22:35:28 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Instance spawned successfully.
Aug 16 22:35:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:35:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:35:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:35:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:35:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:35:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:35:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:35:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:35:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:35:29 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:35:29 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225328.9762616, 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:35:29 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] VM Started (Lifecycle Event)
Aug 16 22:35:29 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:35:29 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Took 0.91 seconds to deallocate network for instance.
Aug 16 22:35:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:35:29 user nova-compute[72773]: INFO nova.compute.manager [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Took 6.87 seconds to spawn the instance on the hypervisor.
Aug 16 22:35:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:35:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:35:29 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:35:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-00098353-1228-474c-870c-edcc46f6ca8c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:35:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-00098353-1228-474c-870c-edcc46f6ca8c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:35:29 user nova-compute[72773]: INFO nova.compute.manager [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Took 8.47 seconds to build instance.
Aug 16 22:35:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4a7ed7ed-300d-4d2e-8e6b-f4e150e621ea tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "6f0f7d89-62d2-44cb-9dfc-f4e8d9285394" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.601s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:35:29 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-00098353-1228-474c-870c-edcc46f6ca8c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:35:29 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-00098353-1228-474c-870c-edcc46f6ca8c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:35:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-00098353-1228-474c-870c-edcc46f6ca8c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.474s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:35:29 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-00098353-1228-474c-870c-edcc46f6ca8c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Deleted allocations for instance e9259e07-3d7f-4169-96fc-b080b4b9ce6a
Aug 16 22:35:29 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692225314.9595003, 9da5bbc3-b0f9-48d1-be93-86e63e4963c2 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:35:29 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] VM Stopped (Lifecycle Event)
Aug 16 22:35:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-0c6ca755-ce93-4096-bc1b-878e020af488 None None] [instance: 9da5bbc3-b0f9-48d1-be93-86e63e4963c2] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:35:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-00098353-1228-474c-870c-edcc46f6ca8c tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "e9259e07-3d7f-4169-96fc-b080b4b9ce6a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.974s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:35:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:30 user nova-compute[72773]: DEBUG nova.compute.manager [req-5e284f08-f2b6-4762-81ff-f6f831dd8269 req-1f17de23-eefc-40e2-b1a4-c1ddb74974a8 service nova] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Received event network-vif-deleted-3dd11c55-5b19-4376-954d-bb0339a28f07 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:35:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeSoThVf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:35:36 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:35:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:35:36 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:35:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:35:36 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:35:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8589adf5-34b5-41b0-a818-33df78a0cd2b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:35:36 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b301b615-9570-4baf-ad7b-d27a161578f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4] added
Aug 16 22:35:36 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d350e67-c844-4b0c-b6a0-19d64c3f2a87]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[648424d9-6dfc-4aba-84c7-efb6a7c7f8c5]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JeSoThVf {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JeSoThVf" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2ddb8e-1bef-4fa4-981e-c7608ec55deb]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JeSoThVf'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[09472224-f5ef-44f1-869e-b80d07fa303d]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a014539c-732b-4332-bb51-442e769ba601]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:35:36 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:35:36 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[21db3021-2151-42bb-bff8-26012db8a677]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4, portal: 172.16.0.220,3260]
Aug 16 22:35:36 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4, portal: 172.16.0.220,3260] successful.
Aug 16 22:35:36 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e2d8b4-64f8-4677-8493-f684025ab6c1]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab40884-56fd-4039-b458-6036a4af3b21]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:35:36 user nova-compute[72773]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)
Aug 16 22:35:36 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:35:36 user nova-compute[72773]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)
Aug 16 22:35:36 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b025814c-a044-4bfc-b86d-001595c2ae92]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:35:36 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: None {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:35:37 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:35:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeSoThVf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:35:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:35:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23638656164376638', 'path': '/dev/sdc'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:35:37 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638656164376638', 'path': '/dev/sdc'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:35:37 user nova-compute[72773]: DEBUG nova.objects.instance [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lazy-loading 'flavor' on Instance uuid 9ea2a759-7a26-4ad6-9902-b8b75931b5f0 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:35:37 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 22:35:37 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:35:37 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 22:35:37 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:35:37 user nova-compute[72773]:   <serial>a4fed383-3540-45ca-9d2f-82daa2d66ad4</serial>
Aug 16 22:35:37 user nova-compute[72773]: </disk>
Aug 16 22:35:37 user nova-compute[72773]:  {{(pid=72773) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 22:35:37 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:35:37 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:35:37 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] No VIF found with MAC fa:16:3e:e4:b7:3c, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:35:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dd9a08bc-2185-442d-b319-04b2761f57a4 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.317s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:35:39 user nova-compute[72773]: INFO nova.compute.manager [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Rescuing
Aug 16 22:35:39 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Acquiring lock "refresh_cache-9ea2a759-7a26-4ad6-9902-b8b75931b5f0" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:35:39 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Acquired lock "refresh_cache-9ea2a759-7a26-4ad6-9902-b8b75931b5f0" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:35:39 user nova-compute[72773]: DEBUG nova.network.neutron [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:35:39 user nova-compute[72773]: DEBUG nova.network.neutron [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Updating instance_info_cache with network_info: [{"id": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "address": "fa:16:3e:e4:b7:3c", "network": {"id": "a18f2224-ffb0-4406-9c92-5dad954c3a2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1329143363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d68c72b1454d78934269042633293f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83003593-cf", "ovs_interfaceid": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:35:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Releasing lock "refresh_cache-9ea2a759-7a26-4ad6-9902-b8b75931b5f0" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:35:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:40 user nova-compute[72773]: DEBUG nova.compute.manager [req-9f6e18cf-2457-427f-8595-a9356baddd5d req-d0ebe24c-f56a-4340-8648-a22abe85101c service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received event network-vif-unplugged-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:35:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9f6e18cf-2457-427f-8595-a9356baddd5d req-d0ebe24c-f56a-4340-8648-a22abe85101c service nova] Acquiring lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:35:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9f6e18cf-2457-427f-8595-a9356baddd5d req-d0ebe24c-f56a-4340-8648-a22abe85101c service nova] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:35:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9f6e18cf-2457-427f-8595-a9356baddd5d req-d0ebe24c-f56a-4340-8648-a22abe85101c service nova] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:35:40 user nova-compute[72773]: DEBUG nova.compute.manager [req-9f6e18cf-2457-427f-8595-a9356baddd5d req-d0ebe24c-f56a-4340-8648-a22abe85101c service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] No waiting events found dispatching network-vif-unplugged-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:35:40 user nova-compute[72773]: WARNING nova.compute.manager [req-9f6e18cf-2457-427f-8595-a9356baddd5d req-d0ebe24c-f56a-4340-8648-a22abe85101c service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received unexpected event network-vif-unplugged-83003593-cfc0-44d3-94c6-4e3fb90573bd for instance with vm_state active and task_state rescuing.
Aug 16 22:35:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:40 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Instance destroyed successfully.
Aug 16 22:35:40 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Attempting a stable device rescue
Aug 16 22:35:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72773) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 22:35:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Instance directory exists: not creating {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 22:35:41 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Creating image(s)
Aug 16 22:35:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:35:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "/opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:35:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "/opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:35:41 user nova-compute[72773]: DEBUG nova.objects.instance [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9ea2a759-7a26-4ad6-9902-b8b75931b5f0 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:35:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Acquiring lock "653fcf975985dfeae77909d2c081423d4b1d0d21" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:35:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "653fcf975985dfeae77909d2c081423d4b1d0d21" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:35:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/653fcf975985dfeae77909d2c081423d4b1d0d21.part --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/653fcf975985dfeae77909d2c081423d4b1d0d21.part --force-share --output=json" returned: 0 in 0.204s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:42 user nova-compute[72773]: DEBUG nova.virt.images [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] 8a4c0768-1253-4e9f-bdd0-9a3330de503c was qcow2, converting to raw {{(pid=72773) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 22:35:42 user nova-compute[72773]: DEBUG nova.privsep.utils [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72773) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 22:35:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/653fcf975985dfeae77909d2c081423d4b1d0d21.part /opt/stack/data/nova/instances/_base/653fcf975985dfeae77909d2c081423d4b1d0d21.converted {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:42 user nova-compute[72773]: DEBUG nova.compute.manager [req-3858f7d6-2838-46e5-a7e8-793b74c9329f req-d28d3e17-9329-49b6-ac46-47d8a6292ba3 service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received event network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:35:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3858f7d6-2838-46e5-a7e8-793b74c9329f req-d28d3e17-9329-49b6-ac46-47d8a6292ba3 service nova] Acquiring lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:35:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3858f7d6-2838-46e5-a7e8-793b74c9329f req-d28d3e17-9329-49b6-ac46-47d8a6292ba3 service nova] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:35:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3858f7d6-2838-46e5-a7e8-793b74c9329f req-d28d3e17-9329-49b6-ac46-47d8a6292ba3 service nova] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:35:42 user nova-compute[72773]: DEBUG nova.compute.manager [req-3858f7d6-2838-46e5-a7e8-793b74c9329f req-d28d3e17-9329-49b6-ac46-47d8a6292ba3 service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] No waiting events found dispatching network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:35:42 user nova-compute[72773]: WARNING nova.compute.manager [req-3858f7d6-2838-46e5-a7e8-793b74c9329f req-d28d3e17-9329-49b6-ac46-47d8a6292ba3 service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received unexpected event network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd for instance with vm_state active and task_state rescuing.
Aug 16 22:35:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/653fcf975985dfeae77909d2c081423d4b1d0d21.part /opt/stack/data/nova/instances/_base/653fcf975985dfeae77909d2c081423d4b1d0d21.converted" returned: 0 in 0.482s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/653fcf975985dfeae77909d2c081423d4b1d0d21.converted --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692225328.0226321, e9259e07-3d7f-4169-96fc-b080b4b9ce6a => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:35:43 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] VM Stopped (Lifecycle Event)
Aug 16 22:35:43 user nova-compute[72773]: DEBUG nova.compute.manager [None req-5ce77e45-7d68-416c-ab4b-3e2c3076b2ef None None] [instance: e9259e07-3d7f-4169-96fc-b080b4b9ce6a] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/653fcf975985dfeae77909d2c081423d4b1d0d21.converted --force-share --output=json" returned: 0 in 0.205s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "653fcf975985dfeae77909d2c081423d4b1d0d21" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.133s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Acquiring lock "653fcf975985dfeae77909d2c081423d4b1d0d21" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "653fcf975985dfeae77909d2c081423d4b1d0d21" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/653fcf975985dfeae77909d2c081423d4b1d0d21 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/653fcf975985dfeae77909d2c081423d4b1d0d21 --force-share --output=json" returned: 0 in 0.204s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/653fcf975985dfeae77909d2c081423d4b1d0d21,backing_fmt=raw /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk.rescue {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/653fcf975985dfeae77909d2c081423d4b1d0d21,backing_fmt=raw /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk.rescue" returned: 0 in 0.068s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "653fcf975985dfeae77909d2c081423d4b1d0d21" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG nova.objects.instance [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lazy-loading 'migration_context' on Instance uuid 9ea2a759-7a26-4ad6-9902-b8b75931b5f0 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Start _get_guest_xml network_info=[{"id": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "address": "fa:16:3e:e4:b7:3c", "network": {"id": "a18f2224-ffb0-4406-9c92-5dad954c3a2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1329143363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1329143363-network", "vif_mac": "fa:16:3e:e4:b7:3c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d68c72b1454d78934269042633293f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83003593-cf", "ovs_interfaceid": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8a4c0768-1253-4e9f-bdd0-9a3330de503c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6bb78ba6-6597-487a-9038-344b2c9ba7b6', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeSoThVf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '9ea2a759-7a26-4ad6-9902-b8b75931b5f0', 'attached_at': '', 'detached_at': '', 'volume_id': 'a4fed383-3540-45ca-9d2f-82daa2d66ad4', 'serial': 'a4fed383-3540-45ca-9d2f-82daa2d66ad4'}, 'mount_device': '/dev/vdb', 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG nova.objects.instance [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lazy-loading 'resources' on Instance uuid 9ea2a759-7a26-4ad6-9902-b8b75931b5f0 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG nova.objects.instance [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lazy-loading 'numa_topology' on Instance uuid 9ea2a759-7a26-4ad6-9902-b8b75931b5f0 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:35:43 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:35:43 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:35:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG nova.objects.instance [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9ea2a759-7a26-4ad6-9902-b8b75931b5f0 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeSoThVf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:35:43 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:35:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:35:43 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:35:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:35:43 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:35:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd71256c-4a5a-446a-9020-e4e107889ae7]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = JeSoThVf\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 16 22:35:43 user nova-compute[72773]: node.name = iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4
Aug 16 22:35:43 user nova-compute[72773]: node.tpgt = -1
Aug 16 22:35:43 user nova-compute[72773]: node.startup = automatic
Aug 16 22:35:43 user nova-compute[72773]: node.leading_login = No
Aug 16 22:35:43 user nova-compute[72773]: iface.iscsi_ifacename = default
Aug 16 22:35:43 user nova-compute[72773]: iface.net_ifacename = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.ipaddress = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.prefix_len = 0
Aug 16 22:35:43 user nova-compute[72773]: iface.hwaddress = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.transport_name = tcp
Aug 16 22:35:43 user nova-compute[72773]: iface.initiatorname = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.state = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.vlan_id = 0
Aug 16 22:35:43 user nova-compute[72773]: iface.vlan_priority = 0
Aug 16 22:35:43 user nova-compute[72773]: iface.vlan_state = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.iface_num = 0
Aug 16 22:35:43 user nova-compute[72773]: iface.mtu = 0
Aug 16 22:35:43 user nova-compute[72773]: iface.port = 0
Aug 16 22:35:43 user nova-compute[72773]: iface.bootproto = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.subnet_mask = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.gateway = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.dhcp_alt_client_id_state = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.dhcp_alt_client_id = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.dhcp_dns = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.dhcp_learn_iqn = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.dhcp_req_vendor_id_state = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.dhcp_vendor_id_state = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.dhcp_vendor_id = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.dhcp_slp_da = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.fragmentation = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.gratuitous_arp = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.incoming_forwarding = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.tos_state = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.tos = 0
Aug 16 22:35:43 user nova-compute[72773]: iface.ttl = 0
Aug 16 22:35:43 user nova-compute[72773]: iface.delayed_ack = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.tcp_nagle = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.tcp_wsf_state = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.tcp_wsf = 0
Aug 16 22:35:43 user nova-compute[72773]: iface.tcp_timer_scale = 0
Aug 16 22:35:43 user nova-compute[72773]: iface.tcp_timestamp = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.redirect = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.def_task_mgmt_timeout = 0
Aug 16 22:35:43 user nova-compute[72773]: iface.header_digest = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.data_digest = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.immediate_data = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.initial_r2t = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.data_seq_inorder = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.data_pdu_inorder = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.erl = 0
Aug 16 22:35:43 user nova-compute[72773]: iface.max_receive_data_len = 0
Aug 16 22:35:43 user nova-compute[72773]: iface.first_burst_len = 0
Aug 16 22:35:43 user nova-compute[72773]: iface.max_outstanding_r2t = 0
Aug 16 22:35:43 user nova-compute[72773]: iface.max_burst_len = 0
Aug 16 22:35:43 user nova-compute[72773]: iface.chap_auth = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.bidi_chap = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.strict_login_compliance = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.discovery_auth = <empty>
Aug 16 22:35:43 user nova-compute[72773]: iface.discovery_logout = <empty>
Aug 16 22:35:43 user nova-compute[72773]: node.discovery_address = <empty>
Aug 16 22:35:43 user nova-compute[72773]: node.discovery_port = 0
Aug 16 22:35:43 user nova-compute[72773]: node.discovery_type = static
Aug 16 22:35:43 user nova-compute[72773]: node.session.initial_cmdsn = 0
Aug 16 22:35:43 user nova-compute[72773]: node.session.initial_login_retry_max = 8
Aug 16 22:35:43 user nova-compute[72773]: node.session.xmit_thread_priority = -20
Aug 16 22:35:43 user nova-compute[72773]: node.session.cmds_max = 128
Aug 16 22:35:43 user nova-compute[72773]: node.session.queue_depth = 32
Aug 16 22:35:43 user nova-compute[72773]: node.session.nr_sessions = 1
Aug 16 22:35:43 user nova-compute[72773]: node.session.auth.authmethod = CHAP
Aug 16 22:35:43 user nova-compute[72773]: node.session.auth.username = JeSoThVf
Aug 16 22:35:43 user nova-compute[72773]: node.session.auth.password = ***
Aug 16 22:35:43 user nova-compute[72773]: node.session.auth.username_in = <empty>
Aug 16 22:35:43 user nova-compute[72773]: node.session.auth.password_in = <empty>
Aug 16 22:35:43 user nova-compute[72773]: node.session.auth.chap_algs = MD5
Aug 16 22:35:43 user nova-compute[72773]: node.session.timeo.replacement_timeout = 120
Aug 16 22:35:43 user nova-compute[72773]: node.session.err_timeo.abort_timeout = 15
Aug 16 22:35:43 user nova-compute[72773]: node.session.err_timeo.lu_reset_timeout = 30
Aug 16 22:35:43 user nova-compute[72773]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 16 22:35:43 user nova-compute[72773]: node.session.err_timeo.host_reset_timeout = 60
Aug 16 22:35:43 user nova-compute[72773]: node.session.iscsi.FastAbort = Yes
Aug 16 22:35:43 user nova-compute[72773]: node.session.iscsi.InitialR2T = No
Aug 16 22:35:43 user nova-compute[72773]: node.session.iscsi.ImmediateData = Yes
Aug 16 22:35:43 user nova-compute[72773]: node.session.iscsi.FirstBurstLength = 262144
Aug 16 22:35:43 user nova-compute[72773]: node.session.iscsi.MaxBurstLength = 16776192
Aug 16 22:35:43 user nova-compute[72773]: node.session.iscsi.DefaultTime2Retain = 0
Aug 16 22:35:43 user nova-compute[72773]: node.session.iscsi.DefaultTime2Wait = 2
Aug 16 22:35:43 user nova-compute[72773]: node.session.iscsi.MaxConnections = 1
Aug 16 22:35:43 user nova-compute[72773]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 16 22:35:43 user nova-compute[72773]: node.session.iscsi.ERL = 0
Aug 16 22:35:43 user nova-compute[72773]: node.session.scan = manual
Aug 16 22:35:43 user nova-compute[72773]: node.session.reopen_max = 0
Aug 16 22:35:43 user nova-compute[72773]: node.conn[0].address = 172.16.0.220
Aug 16 22:35:43 user nova-compute[72773]: node.conn[0].port = 3260
Aug 16 22:35:43 user nova-compute[72773]: node.conn[0].startup = manual
Aug 16 22:35:43 user nova-compute[72773]: node.conn[0].tcp.window_size = 524288
Aug 16 22:35:43 user nova-compute[72773]: node.conn[0].tcp.type_of_service = 0
Aug 16 22:35:43 user nova-compute[72773]: node.conn[0].timeo.logout_timeout = 15
Aug 16 22:35:43 user nova-compute[72773]: node.conn[0].timeo.login_timeout = 15
Aug 16 22:35:43 user nova-compute[72773]: node.conn[0].timeo.auth_timeout = 45
Aug 16 22:35:43 user nova-compute[72773]: node.conn[0].timeo.noop_out_interval = 5
Aug 16 22:35:43 user nova-compute[72773]: node.conn[0].timeo.noop_out_timeout = 5
Aug 16 22:35:43 user nova-compute[72773]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 16 22:35:43 user nova-compute[72773]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 16 22:35:43 user nova-compute[72773]: node.conn[0].iscsi.HeaderDigest = None
Aug 16 22:35:43 user nova-compute[72773]: node.conn[0].iscsi.DataDigest = None
Aug 16 22:35:43 user nova-compute[72773]: node.conn[0].iscsi.IFMarker = No
Aug 16 22:35:43 user nova-compute[72773]: node.conn[0].iscsi.OFMarker = No
Aug 16 22:35:43 user nova-compute[72773]: # END RECORD
Aug 16 22:35:43 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[139d81d1-13a1-4636-ae8a-edd181b67618]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b491d1-8fd9-4dd1-9f19-0770f8c2b26b]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JeSoThVf {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JeSoThVf" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88c27c5-0859-4d5d-b75c-e4a21c465861]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JeSoThVf'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e073cc-a031-43b8-9f08-4a011186dcee]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a2ec99-28d7-47a7-949f-f9e8d51ae8b5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:35:43 user nova-compute[72773]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)
Aug 16 22:35:43 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:35:43 user nova-compute[72773]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)
Aug 16 22:35:43 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.146s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] HCTL ('34', '0', '0', 0) found on session 28 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8711ed51-7a87-4f9a-8008-11a4e1858812]: (4, ('0 0 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Searching for a device in session 28 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeSoThVf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.175s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] <== connect_volume: return (177ms) {'type': 'block', 'scsi_wwn': '23638656164376638', 'path': '/dev/sdc'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638656164376638', 'path': '/dev/sdc'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:31:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-738184949',display_name='tempest-ServerStableDeviceRescueTest-server-738184949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-738184949',id=19,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdDs0qSvSZ6qEmvaVSSkiC4v5VB61+2JkRBiyKREBlAfJAmOwhbAu0s7p7884ybaAUHg4xbKZuXPFC0FkwnafltxzeE+Ad+yovVfqAeD9IMpKRqI2/X3YGc2Onpir2t3A==',key_name='tempest-keypair-261024075',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:31:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2d68c72b1454d78934269042633293f',ramdisk_id='',reservation_id='r-1sapniu7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1505608702',owner_user_name='tempest-ServerStableDeviceRescueTest-1505608702-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:33:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38a5ab8690e4428e8f047081cdbd4a1e',uuid=9ea2a759-7a26-4ad6-9902-b8b75931b5f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "address": "fa:16:3e:e4:b7:3c", "network": {"id": "a18f2224-ffb0-4406-9c92-5dad954c3a2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1329143363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1329143363-network", "vif_mac": "fa:16:3e:e4:b7:3c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d68c72b1454d78934269042633293f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83003593-cf", "ovs_interfaceid": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Converting VIF {"id": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "address": "fa:16:3e:e4:b7:3c", "network": {"id": "a18f2224-ffb0-4406-9c92-5dad954c3a2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1329143363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1329143363-network", "vif_mac": "fa:16:3e:e4:b7:3c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d68c72b1454d78934269042633293f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83003593-cf", "ovs_interfaceid": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:b7:3c,bridge_name='br-int',has_traffic_filtering=True,id=83003593-cfc0-44d3-94c6-4e3fb90573bd,network=Network(a18f2224-ffb0-4406-9c92-5dad954c3a2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83003593-cf') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG nova.objects.instance [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ea2a759-7a26-4ad6-9902-b8b75931b5f0 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:35:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:35:43 user nova-compute[72773]:   <uuid>9ea2a759-7a26-4ad6-9902-b8b75931b5f0</uuid>
Aug 16 22:35:43 user nova-compute[72773]:   <name>instance-00000013</name>
Aug 16 22:35:43 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:35:43 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:35:43 user nova-compute[72773]:   <metadata>
Aug 16 22:35:43 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:35:43 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:35:43 user nova-compute[72773]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-738184949</nova:name>
Aug 16 22:35:43 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:35:43</nova:creationTime>
Aug 16 22:35:43 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:35:43 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:35:43 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:35:43 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:35:43 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:35:43 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:35:43 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:35:43 user nova-compute[72773]:       <nova:owner>
Aug 16 22:35:43 user nova-compute[72773]:         <nova:user uuid="38a5ab8690e4428e8f047081cdbd4a1e">tempest-ServerStableDeviceRescueTest-1505608702-project-member</nova:user>
Aug 16 22:35:43 user nova-compute[72773]:         <nova:project uuid="d2d68c72b1454d78934269042633293f">tempest-ServerStableDeviceRescueTest-1505608702</nova:project>
Aug 16 22:35:43 user nova-compute[72773]:       </nova:owner>
Aug 16 22:35:43 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:35:43 user nova-compute[72773]:       <nova:ports>
Aug 16 22:35:43 user nova-compute[72773]:         <nova:port uuid="83003593-cfc0-44d3-94c6-4e3fb90573bd">
Aug 16 22:35:43 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 22:35:43 user nova-compute[72773]:         </nova:port>
Aug 16 22:35:43 user nova-compute[72773]:       </nova:ports>
Aug 16 22:35:43 user nova-compute[72773]:     </nova:instance>
Aug 16 22:35:43 user nova-compute[72773]:   </metadata>
Aug 16 22:35:43 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:35:43 user nova-compute[72773]:     <system>
Aug 16 22:35:43 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:35:43 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:35:43 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:35:43 user nova-compute[72773]:       <entry name="serial">9ea2a759-7a26-4ad6-9902-b8b75931b5f0</entry>
Aug 16 22:35:43 user nova-compute[72773]:       <entry name="uuid">9ea2a759-7a26-4ad6-9902-b8b75931b5f0</entry>
Aug 16 22:35:43 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:35:43 user nova-compute[72773]:     </system>
Aug 16 22:35:43 user nova-compute[72773]:   </sysinfo>
Aug 16 22:35:43 user nova-compute[72773]:   <os>
Aug 16 22:35:43 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:35:43 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:35:43 user nova-compute[72773]:   </os>
Aug 16 22:35:43 user nova-compute[72773]:   <features>
Aug 16 22:35:43 user nova-compute[72773]:     <acpi/>
Aug 16 22:35:43 user nova-compute[72773]:     <apic/>
Aug 16 22:35:43 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:35:43 user nova-compute[72773]:   </features>
Aug 16 22:35:43 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:35:43 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:35:43 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:35:43 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:35:43 user nova-compute[72773]:   </clock>
Aug 16 22:35:43 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:35:43 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:35:43 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:35:43 user nova-compute[72773]:   </cpu>
Aug 16 22:35:43 user nova-compute[72773]:   <devices>
Aug 16 22:35:43 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:35:43 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:35:43 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk"/>
Aug 16 22:35:43 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:35:43 user nova-compute[72773]:     </disk>
Aug 16 22:35:43 user nova-compute[72773]:     <disk type="block" device="disk">
Aug 16 22:35:43 user nova-compute[72773]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:35:43 user nova-compute[72773]:       <source dev="/dev/sdc"/>
Aug 16 22:35:43 user nova-compute[72773]:       <target dev="vdb" bus="virtio"/>
Aug 16 22:35:43 user nova-compute[72773]:       <serial>a4fed383-3540-45ca-9d2f-82daa2d66ad4</serial>
Aug 16 22:35:43 user nova-compute[72773]:     </disk>
Aug 16 22:35:43 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:35:43 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:35:43 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk.rescue"/>
Aug 16 22:35:43 user nova-compute[72773]:       <target dev="vdc" bus="virtio"/>
Aug 16 22:35:43 user nova-compute[72773]:       <boot order="1"/>
Aug 16 22:35:43 user nova-compute[72773]:     </disk>
Aug 16 22:35:43 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:35:43 user nova-compute[72773]:       <mac address="fa:16:3e:e4:b7:3c"/>
Aug 16 22:35:43 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:35:43 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:35:43 user nova-compute[72773]:       <target dev="tap83003593-cf"/>
Aug 16 22:35:43 user nova-compute[72773]:     </interface>
Aug 16 22:35:43 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:35:43 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/console.log" append="off"/>
Aug 16 22:35:43 user nova-compute[72773]:     </serial>
Aug 16 22:35:43 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:35:43 user nova-compute[72773]:     <video>
Aug 16 22:35:43 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:35:43 user nova-compute[72773]:     </video>
Aug 16 22:35:43 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:35:43 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:35:43 user nova-compute[72773]:     </rng>
Aug 16 22:35:43 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:35:43 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:35:43 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:35:43 user nova-compute[72773]:     </memballoon>
Aug 16 22:35:43 user nova-compute[72773]:   </devices>
Aug 16 22:35:43 user nova-compute[72773]: </domain>
Aug 16 22:35:43 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:35:43 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Instance destroyed successfully.
Aug 16 22:35:44 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:35:44 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:35:44 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:35:44 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] No VIF found with MAC fa:16:3e:e4:b7:3c, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:35:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:45 user nova-compute[72773]: DEBUG nova.compute.manager [req-43beb221-a119-4c3d-84fb-245d85445ca8 req-5b9b2186-bb36-471d-958f-d3384fb09e33 service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received event network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:35:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-43beb221-a119-4c3d-84fb-245d85445ca8 req-5b9b2186-bb36-471d-958f-d3384fb09e33 service nova] Acquiring lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:35:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-43beb221-a119-4c3d-84fb-245d85445ca8 req-5b9b2186-bb36-471d-958f-d3384fb09e33 service nova] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:35:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-43beb221-a119-4c3d-84fb-245d85445ca8 req-5b9b2186-bb36-471d-958f-d3384fb09e33 service nova] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:35:45 user nova-compute[72773]: DEBUG nova.compute.manager [req-43beb221-a119-4c3d-84fb-245d85445ca8 req-5b9b2186-bb36-471d-958f-d3384fb09e33 service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] No waiting events found dispatching network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:35:45 user nova-compute[72773]: WARNING nova.compute.manager [req-43beb221-a119-4c3d-84fb-245d85445ca8 req-5b9b2186-bb36-471d-958f-d3384fb09e33 service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received unexpected event network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd for instance with vm_state active and task_state rescuing.
Aug 16 22:35:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:46 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:35:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:47 user nova-compute[72773]: DEBUG nova.compute.manager [req-16db8c75-50ef-4584-9b4c-10b3cbbd671d req-40179c65-4b6a-4952-9886-3860271586e7 service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received event network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:35:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-16db8c75-50ef-4584-9b4c-10b3cbbd671d req-40179c65-4b6a-4952-9886-3860271586e7 service nova] Acquiring lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:35:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-16db8c75-50ef-4584-9b4c-10b3cbbd671d req-40179c65-4b6a-4952-9886-3860271586e7 service nova] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:35:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-16db8c75-50ef-4584-9b4c-10b3cbbd671d req-40179c65-4b6a-4952-9886-3860271586e7 service nova] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:35:47 user nova-compute[72773]: DEBUG nova.compute.manager [req-16db8c75-50ef-4584-9b4c-10b3cbbd671d req-40179c65-4b6a-4952-9886-3860271586e7 service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] No waiting events found dispatching network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:35:47 user nova-compute[72773]: WARNING nova.compute.manager [req-16db8c75-50ef-4584-9b4c-10b3cbbd671d req-40179c65-4b6a-4952-9886-3860271586e7 service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received unexpected event network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd for instance with vm_state active and task_state rescuing.
Aug 16 22:35:47 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Removed pending event for 9ea2a759-7a26-4ad6-9902-b8b75931b5f0 due to event {{(pid=72773) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 22:35:47 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225347.8195088, 9ea2a759-7a26-4ad6-9902-b8b75931b5f0 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:35:47 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] VM Resumed (Lifecycle Event)
Aug 16 22:35:47 user nova-compute[72773]: DEBUG nova.compute.manager [None req-9f10ef9c-94ba-48e2-ad2b-e64663ea9be9 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:35:47 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:35:47 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:35:47 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 22:35:47 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225347.8218398, 9ea2a759-7a26-4ad6-9902-b8b75931b5f0 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:35:47 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] VM Started (Lifecycle Event)
Aug 16 22:35:47 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:35:47 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:35:47 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 22:35:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:48 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:35:48 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Cleaning up deleted instances {{(pid=72773) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 22:35:48 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] There are 0 instances to clean {{(pid=72773) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 22:35:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:50 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:35:50 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:35:50 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Cleaning up deleted instances with incomplete migration  {{(pid=72773) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 22:35:52 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:35:52 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:35:52 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Rebuilding the list of instances to heal {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 22:35:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-956d334e-f190-4625-b144-ab44d2f3321a" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:35:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-956d334e-f190-4625-b144-ab44d2f3321a" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:35:52 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 22:35:52 user nova-compute[72773]: DEBUG nova.objects.instance [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lazy-loading 'info_cache' on Instance uuid 956d334e-f190-4625-b144-ab44d2f3321a {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:35:53 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Updating instance_info_cache with network_info: [{"id": "d1807881-ec54-4e55-8f2e-6f8046efd351", "address": "fa:16:3e:b5:0f:ad", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1807881-ec", "ovs_interfaceid": "d1807881-ec54-4e55-8f2e-6f8046efd351", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:35:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-956d334e-f190-4625-b144-ab44d2f3321a" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:35:53 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 22:35:53 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:35:53 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:35:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:54 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:35:54 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:35:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:56 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:35:56 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:35:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:35:59 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:35:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:35:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:35:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:35:59 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:35:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:35:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:35:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:00 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:36:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:01 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:36:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0f7d89-62d2-44cb-9dfc-f4e8d9285394/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0f7d89-62d2-44cb-9dfc-f4e8d9285394/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0f7d89-62d2-44cb-9dfc-f4e8d9285394/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0f7d89-62d2-44cb-9dfc-f4e8d9285394/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:04 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:36:04 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:36:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=7273MB free_disk=25.30962371826172GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:36:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:36:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:36:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 956d334e-f190-4625-b144-ab44d2f3321a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:36:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 030d076d-5099-4236-ae31-6025017eb51e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:36:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 9ea2a759-7a26-4ad6-9902-b8b75931b5f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:36:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance ac2b49e4-59bc-46cd-b7d9-67aa68296e4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:36:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 391a6006-4fe6-4398-a1e8-ae95b5edbf2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:36:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance cf01c401-c424-4b3e-aa5b-439d62b1ae4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:36:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 23894101-2fd3-41a4-83a3-8f6869d24d97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:36:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 5ebcd117-6765-44eb-871b-226afd58e4e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:36:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance f4210738-d01e-4408-a15c-aeccada6dd23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:36:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:36:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:36:04 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:36:04 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Refreshing inventories for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 22:36:04 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Updating ProviderTree inventory for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 22:36:04 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Updating inventory in ProviderTree for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 22:36:04 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Refreshing aggregate associations for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e, aggregates: None {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 22:36:04 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Refreshing trait associations for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 22:36:05 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:36:05 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:36:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:05 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:36:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.759s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:36:05 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:36:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "63644e8f-95d4-43a7-a824-8845dd073423" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:36:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "63644e8f-95d4-43a7-a824-8845dd073423" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:36:20 user nova-compute[72773]: INFO nova.compute.manager [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Unshelving
Aug 16 22:36:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:36:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:36:20 user nova-compute[72773]: DEBUG nova.objects.instance [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lazy-loading 'pci_requests' on Instance uuid 63644e8f-95d4-43a7-a824-8845dd073423 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:36:20 user nova-compute[72773]: DEBUG nova.objects.instance [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lazy-loading 'numa_topology' on Instance uuid 63644e8f-95d4-43a7-a824-8845dd073423 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:36:20 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:36:20 user nova-compute[72773]: INFO nova.compute.claims [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Claim successful on node user
Aug 16 22:36:21 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:36:21 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:36:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:36:21 user nova-compute[72773]: INFO nova.network.neutron [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Updating port eae4e0ec-3105-463d-9c92-0e2f63192bb6 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 16 22:36:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "16a246c1-b2a7-4048-a6c9-235c15079d39" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:36:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "16a246c1-b2a7-4048-a6c9-235c15079d39" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:36:21 user nova-compute[72773]: DEBUG nova.compute.manager [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:36:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:36:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:36:21 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:36:21 user nova-compute[72773]: INFO nova.compute.claims [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Claim successful on node user
Aug 16 22:36:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "refresh_cache-63644e8f-95d4-43a7-a824-8845dd073423" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:36:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquired lock "refresh_cache-63644e8f-95d4-43a7-a824-8845dd073423" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:36:21 user nova-compute[72773]: DEBUG nova.network.neutron [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:36:21 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:36:22 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:36:22 user nova-compute[72773]: DEBUG nova.compute.manager [req-07395be5-e648-4547-80b2-bd6a8ed98737 req-7aef0b5f-f2ba-4816-b217-f4dfcaa32346 service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Received event network-changed-eae4e0ec-3105-463d-9c92-0e2f63192bb6 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:36:22 user nova-compute[72773]: DEBUG nova.compute.manager [req-07395be5-e648-4547-80b2-bd6a8ed98737 req-7aef0b5f-f2ba-4816-b217-f4dfcaa32346 service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Refreshing instance network info cache due to event network-changed-eae4e0ec-3105-463d-9c92-0e2f63192bb6. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:36:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-07395be5-e648-4547-80b2-bd6a8ed98737 req-7aef0b5f-f2ba-4816-b217-f4dfcaa32346 service nova] Acquiring lock "refresh_cache-63644e8f-95d4-43a7-a824-8845dd073423" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:36:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.527s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:36:22 user nova-compute[72773]: DEBUG nova.compute.manager [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:36:22 user nova-compute[72773]: DEBUG nova.compute.manager [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:36:22 user nova-compute[72773]: DEBUG nova.network.neutron [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:36:22 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:36:22 user nova-compute[72773]: DEBUG nova.compute.manager [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:36:22 user nova-compute[72773]: DEBUG nova.policy [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3b873f599fc4a2686c154d856bd5f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49739a140d40508ea307eedceb9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:36:22 user nova-compute[72773]: DEBUG nova.compute.manager [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:36:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:36:22 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Creating image(s)
Aug 16 22:36:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "/opt/stack/data/nova/instances/16a246c1-b2a7-4048-a6c9-235c15079d39/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:36:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "/opt/stack/data/nova/instances/16a246c1-b2a7-4048-a6c9-235c15079d39/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:36:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "/opt/stack/data/nova/instances/16a246c1-b2a7-4048-a6c9-235c15079d39/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:36:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:22 user nova-compute[72773]: DEBUG nova.network.neutron [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Updating instance_info_cache with network_info: [{"id": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "address": "fa:16:3e:0b:c6:49", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeae4e0ec-31", "ovs_interfaceid": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:36:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.191s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:36:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:36:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Releasing lock "refresh_cache-63644e8f-95d4-43a7-a824-8845dd073423" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:36:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:36:22 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Creating image(s)
Aug 16 22:36:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "/opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:36:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "/opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:36:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "/opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:36:22 user nova-compute[72773]: DEBUG nova.objects.instance [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lazy-loading 'trusted_certs' on Instance uuid 63644e8f-95d4-43a7-a824-8845dd073423 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:36:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-07395be5-e648-4547-80b2-bd6a8ed98737 req-7aef0b5f-f2ba-4816-b217-f4dfcaa32346 service nova] Acquired lock "refresh_cache-63644e8f-95d4-43a7-a824-8845dd073423" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:36:22 user nova-compute[72773]: DEBUG nova.network.neutron [req-07395be5-e648-4547-80b2-bd6a8ed98737 req-7aef0b5f-f2ba-4816-b217-f4dfcaa32346 service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Refreshing network info cache for port eae4e0ec-3105-463d-9c92-0e2f63192bb6 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:36:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "83bf6137b50f2656dc5bb4401cfa67393d062e4d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:36:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "83bf6137b50f2656dc5bb4401cfa67393d062e4d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:36:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83bf6137b50f2656dc5bb4401cfa67393d062e4d.part --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:23 user nova-compute[72773]: DEBUG nova.network.neutron [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Successfully created port: 1741e52a-4fe9-4496-9c8b-56f3e1816fc3 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:36:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 1.139s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/16a246c1-b2a7-4048-a6c9-235c15079d39/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/16a246c1-b2a7-4048-a6c9-235c15079d39/disk 1073741824" returned: 0 in 0.055s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 1.200s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:36:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83bf6137b50f2656dc5bb4401cfa67393d062e4d.part --force-share --output=json" returned: 0 in 0.181s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:23 user nova-compute[72773]: DEBUG nova.virt.images [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] 9ad4ea58-516d-47f5-8361-ed8a066e1975 was qcow2, converting to raw {{(pid=72773) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 22:36:23 user nova-compute[72773]: DEBUG nova.privsep.utils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72773) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 22:36:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/83bf6137b50f2656dc5bb4401cfa67393d062e4d.part /opt/stack/data/nova/instances/_base/83bf6137b50f2656dc5bb4401cfa67393d062e4d.converted {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.177s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:23 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16a246c1-b2a7-4048-a6c9-235c15079d39/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:36:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a246c1-b2a7-4048-a6c9-235c15079d39/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:24 user nova-compute[72773]: DEBUG nova.network.neutron [req-07395be5-e648-4547-80b2-bd6a8ed98737 req-7aef0b5f-f2ba-4816-b217-f4dfcaa32346 service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Updated VIF entry in instance network info cache for port eae4e0ec-3105-463d-9c92-0e2f63192bb6. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:36:24 user nova-compute[72773]: DEBUG nova.network.neutron [req-07395be5-e648-4547-80b2-bd6a8ed98737 req-7aef0b5f-f2ba-4816-b217-f4dfcaa32346 service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Updating instance_info_cache with network_info: [{"id": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "address": "fa:16:3e:0b:c6:49", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeae4e0ec-31", "ovs_interfaceid": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:36:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-07395be5-e648-4547-80b2-bd6a8ed98737 req-7aef0b5f-f2ba-4816-b217-f4dfcaa32346 service nova] Releasing lock "refresh_cache-63644e8f-95d4-43a7-a824-8845dd073423" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:36:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a246c1-b2a7-4048-a6c9-235c15079d39/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:24 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Cannot resize image /opt/stack/data/nova/instances/16a246c1-b2a7-4048-a6c9-235c15079d39/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:36:24 user nova-compute[72773]: DEBUG nova.objects.instance [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lazy-loading 'migration_context' on Instance uuid 16a246c1-b2a7-4048-a6c9-235c15079d39 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:36:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:36:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Ensure instance console log exists: /opt/stack/data/nova/instances/16a246c1-b2a7-4048-a6c9-235c15079d39/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:36:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:36:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:36:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:36:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/83bf6137b50f2656dc5bb4401cfa67393d062e4d.part /opt/stack/data/nova/instances/_base/83bf6137b50f2656dc5bb4401cfa67393d062e4d.converted" returned: 0 in 0.579s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83bf6137b50f2656dc5bb4401cfa67393d062e4d.converted --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:24 user nova-compute[72773]: DEBUG nova.network.neutron [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Successfully updated port: 1741e52a-4fe9-4496-9c8b-56f3e1816fc3 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:36:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "refresh_cache-16a246c1-b2a7-4048-a6c9-235c15079d39" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:36:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquired lock "refresh_cache-16a246c1-b2a7-4048-a6c9-235c15079d39" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:36:24 user nova-compute[72773]: DEBUG nova.network.neutron [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:36:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83bf6137b50f2656dc5bb4401cfa67393d062e4d.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "83bf6137b50f2656dc5bb4401cfa67393d062e4d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.991s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:36:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83bf6137b50f2656dc5bb4401cfa67393d062e4d --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:24 user nova-compute[72773]: DEBUG nova.compute.manager [req-916458f4-7545-4a4b-9d10-de5062a07d9e req-7857c68c-692f-4573-99e3-5cff1b47f543 service nova] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Received event network-changed-1741e52a-4fe9-4496-9c8b-56f3e1816fc3 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:36:24 user nova-compute[72773]: DEBUG nova.compute.manager [req-916458f4-7545-4a4b-9d10-de5062a07d9e req-7857c68c-692f-4573-99e3-5cff1b47f543 service nova] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Refreshing instance network info cache due to event network-changed-1741e52a-4fe9-4496-9c8b-56f3e1816fc3. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:36:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-916458f4-7545-4a4b-9d10-de5062a07d9e req-7857c68c-692f-4573-99e3-5cff1b47f543 service nova] Acquiring lock "refresh_cache-16a246c1-b2a7-4048-a6c9-235c15079d39" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:36:24 user nova-compute[72773]: DEBUG nova.network.neutron [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:36:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83bf6137b50f2656dc5bb4401cfa67393d062e4d --force-share --output=json" returned: 0 in 0.185s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "83bf6137b50f2656dc5bb4401cfa67393d062e4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:36:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "83bf6137b50f2656dc5bb4401cfa67393d062e4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:36:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83bf6137b50f2656dc5bb4401cfa67393d062e4d --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83bf6137b50f2656dc5bb4401cfa67393d062e4d --force-share --output=json" returned: 0 in 0.182s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83bf6137b50f2656dc5bb4401cfa67393d062e4d,backing_fmt=raw /opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:24 user nova-compute[72773]: DEBUG nova.network.neutron [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Updating instance_info_cache with network_info: [{"id": "1741e52a-4fe9-4496-9c8b-56f3e1816fc3", "address": "fa:16:3e:7d:dd:e5", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1741e52a-4f", "ovs_interfaceid": "1741e52a-4fe9-4496-9c8b-56f3e1816fc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:36:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83bf6137b50f2656dc5bb4401cfa67393d062e4d,backing_fmt=raw /opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk 1073741824" returned: 0 in 0.054s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "83bf6137b50f2656dc5bb4401cfa67393d062e4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:36:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83bf6137b50f2656dc5bb4401cfa67393d062e4d --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Releasing lock "refresh_cache-16a246c1-b2a7-4048-a6c9-235c15079d39" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG nova.compute.manager [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Instance network_info: |[{"id": "1741e52a-4fe9-4496-9c8b-56f3e1816fc3", "address": "fa:16:3e:7d:dd:e5", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1741e52a-4f", "ovs_interfaceid": "1741e52a-4fe9-4496-9c8b-56f3e1816fc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-916458f4-7545-4a4b-9d10-de5062a07d9e req-7857c68c-692f-4573-99e3-5cff1b47f543 service nova] Acquired lock "refresh_cache-16a246c1-b2a7-4048-a6c9-235c15079d39" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG nova.network.neutron [req-916458f4-7545-4a4b-9d10-de5062a07d9e req-7857c68c-692f-4573-99e3-5cff1b47f543 service nova] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Refreshing network info cache for port 1741e52a-4fe9-4496-9c8b-56f3e1816fc3 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Start _get_guest_xml network_info=[{"id": "1741e52a-4fe9-4496-9c8b-56f3e1816fc3", "address": "fa:16:3e:7d:dd:e5", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1741e52a-4f", "ovs_interfaceid": "1741e52a-4fe9-4496-9c8b-56f3e1816fc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:36:25 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:36:25 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:36:25 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:36:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1953913998',display_name='tempest-AttachVolumeNegativeTest-server-1953913998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1953913998',id=31,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9l9BaYSJopFVFDCOpQIaJmrA/aja2j7cOKKuESW6m+ej5Zoq5cgl+EV6ljXwb+A8w1tMOOpUty590k6uFQJJ+DIMNSddgzXX0nY/X8aPm2wNN1L8B3P10SkqEtG9nBPw==',key_name='tempest-keypair-1302603800',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc49739a140d40508ea307eedceb9aaa',ramdisk_id='',reservation_id='r-nk9y2me7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-801754299',owner_user_name='tempest-AttachVolumeNegativeTest-801754299-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:36:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3b873f599fc4a2686c154d856bd5f06',uuid=16a246c1-b2a7-4048-a6c9-235c15079d39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1741e52a-4fe9-4496-9c8b-56f3e1816fc3", "address": "fa:16:3e:7d:dd:e5", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1741e52a-4f", "ovs_interfaceid": "1741e52a-4fe9-4496-9c8b-56f3e1816fc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Converting VIF {"id": "1741e52a-4fe9-4496-9c8b-56f3e1816fc3", "address": "fa:16:3e:7d:dd:e5", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1741e52a-4f", "ovs_interfaceid": "1741e52a-4fe9-4496-9c8b-56f3e1816fc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:dd:e5,bridge_name='br-int',has_traffic_filtering=True,id=1741e52a-4fe9-4496-9c8b-56f3e1816fc3,network=Network(e0974c13-ec74-4a35-95b4-afae254c04a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1741e52a-4f') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG nova.objects.instance [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lazy-loading 'pci_devices' on Instance uuid 16a246c1-b2a7-4048-a6c9-235c15079d39 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:36:25 user nova-compute[72773]:   <uuid>16a246c1-b2a7-4048-a6c9-235c15079d39</uuid>
Aug 16 22:36:25 user nova-compute[72773]:   <name>instance-0000001f</name>
Aug 16 22:36:25 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:36:25 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:36:25 user nova-compute[72773]:   <metadata>
Aug 16 22:36:25 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:36:25 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:36:25 user nova-compute[72773]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1953913998</nova:name>
Aug 16 22:36:25 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:36:25</nova:creationTime>
Aug 16 22:36:25 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:36:25 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:36:25 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:36:25 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:36:25 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:36:25 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:36:25 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:36:25 user nova-compute[72773]:       <nova:owner>
Aug 16 22:36:25 user nova-compute[72773]:         <nova:user uuid="d3b873f599fc4a2686c154d856bd5f06">tempest-AttachVolumeNegativeTest-801754299-project-member</nova:user>
Aug 16 22:36:25 user nova-compute[72773]:         <nova:project uuid="dc49739a140d40508ea307eedceb9aaa">tempest-AttachVolumeNegativeTest-801754299</nova:project>
Aug 16 22:36:25 user nova-compute[72773]:       </nova:owner>
Aug 16 22:36:25 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:36:25 user nova-compute[72773]:       <nova:ports>
Aug 16 22:36:25 user nova-compute[72773]:         <nova:port uuid="1741e52a-4fe9-4496-9c8b-56f3e1816fc3">
Aug 16 22:36:25 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 22:36:25 user nova-compute[72773]:         </nova:port>
Aug 16 22:36:25 user nova-compute[72773]:       </nova:ports>
Aug 16 22:36:25 user nova-compute[72773]:     </nova:instance>
Aug 16 22:36:25 user nova-compute[72773]:   </metadata>
Aug 16 22:36:25 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:36:25 user nova-compute[72773]:     <system>
Aug 16 22:36:25 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:36:25 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:36:25 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:36:25 user nova-compute[72773]:       <entry name="serial">16a246c1-b2a7-4048-a6c9-235c15079d39</entry>
Aug 16 22:36:25 user nova-compute[72773]:       <entry name="uuid">16a246c1-b2a7-4048-a6c9-235c15079d39</entry>
Aug 16 22:36:25 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:36:25 user nova-compute[72773]:     </system>
Aug 16 22:36:25 user nova-compute[72773]:   </sysinfo>
Aug 16 22:36:25 user nova-compute[72773]:   <os>
Aug 16 22:36:25 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:36:25 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:36:25 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:36:25 user nova-compute[72773]:   </os>
Aug 16 22:36:25 user nova-compute[72773]:   <features>
Aug 16 22:36:25 user nova-compute[72773]:     <acpi/>
Aug 16 22:36:25 user nova-compute[72773]:     <apic/>
Aug 16 22:36:25 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:36:25 user nova-compute[72773]:   </features>
Aug 16 22:36:25 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:36:25 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:36:25 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:36:25 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:36:25 user nova-compute[72773]:   </clock>
Aug 16 22:36:25 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:36:25 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:36:25 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:36:25 user nova-compute[72773]:   </cpu>
Aug 16 22:36:25 user nova-compute[72773]:   <devices>
Aug 16 22:36:25 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:36:25 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:36:25 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/16a246c1-b2a7-4048-a6c9-235c15079d39/disk"/>
Aug 16 22:36:25 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:36:25 user nova-compute[72773]:     </disk>
Aug 16 22:36:25 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:36:25 user nova-compute[72773]:       <mac address="fa:16:3e:7d:dd:e5"/>
Aug 16 22:36:25 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:36:25 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:36:25 user nova-compute[72773]:       <target dev="tap1741e52a-4f"/>
Aug 16 22:36:25 user nova-compute[72773]:     </interface>
Aug 16 22:36:25 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:36:25 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/16a246c1-b2a7-4048-a6c9-235c15079d39/console.log" append="off"/>
Aug 16 22:36:25 user nova-compute[72773]:     </serial>
Aug 16 22:36:25 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:36:25 user nova-compute[72773]:     <video>
Aug 16 22:36:25 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:36:25 user nova-compute[72773]:     </video>
Aug 16 22:36:25 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:36:25 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:36:25 user nova-compute[72773]:     </rng>
Aug 16 22:36:25 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:36:25 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:36:25 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:36:25 user nova-compute[72773]:     </memballoon>
Aug 16 22:36:25 user nova-compute[72773]:   </devices>
Aug 16 22:36:25 user nova-compute[72773]: </domain>
Aug 16 22:36:25 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:36:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1953913998',display_name='tempest-AttachVolumeNegativeTest-server-1953913998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1953913998',id=31,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9l9BaYSJopFVFDCOpQIaJmrA/aja2j7cOKKuESW6m+ej5Zoq5cgl+EV6ljXwb+A8w1tMOOpUty590k6uFQJJ+DIMNSddgzXX0nY/X8aPm2wNN1L8B3P10SkqEtG9nBPw==',key_name='tempest-keypair-1302603800',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc49739a140d40508ea307eedceb9aaa',ramdisk_id='',reservation_id='r-nk9y2me7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-801754299',owner_user_name='tempest-AttachVolumeNegativeTest-801754299-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:36:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3b873f599fc4a2686c154d856bd5f06',uuid=16a246c1-b2a7-4048-a6c9-235c15079d39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1741e52a-4fe9-4496-9c8b-56f3e1816fc3", "address": "fa:16:3e:7d:dd:e5", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1741e52a-4f", "ovs_interfaceid": "1741e52a-4fe9-4496-9c8b-56f3e1816fc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Converting VIF {"id": "1741e52a-4fe9-4496-9c8b-56f3e1816fc3", "address": "fa:16:3e:7d:dd:e5", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1741e52a-4f", "ovs_interfaceid": "1741e52a-4fe9-4496-9c8b-56f3e1816fc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:dd:e5,bridge_name='br-int',has_traffic_filtering=True,id=1741e52a-4fe9-4496-9c8b-56f3e1816fc3,network=Network(e0974c13-ec74-4a35-95b4-afae254c04a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1741e52a-4f') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG os_vif [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:dd:e5,bridge_name='br-int',has_traffic_filtering=True,id=1741e52a-4fe9-4496-9c8b-56f3e1816fc3,network=Network(e0974c13-ec74-4a35-95b4-afae254c04a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1741e52a-4f') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1741e52a-4f, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1741e52a-4f, col_values=(('external_ids', {'iface-id': '1741e52a-4fe9-4496-9c8b-56f3e1816fc3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:dd:e5', 'vm-uuid': '16a246c1-b2a7-4048-a6c9-235c15079d39'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83bf6137b50f2656dc5bb4401cfa67393d062e4d --force-share --output=json" returned: 0 in 0.197s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG nova.objects.instance [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lazy-loading 'migration_context' on Instance uuid 63644e8f-95d4-43a7-a824-8845dd073423 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:25 user nova-compute[72773]: INFO os_vif [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:dd:e5,bridge_name='br-int',has_traffic_filtering=True,id=1741e52a-4fe9-4496-9c8b-56f3e1816fc3,network=Network(e0974c13-ec74-4a35-95b4-afae254c04a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1741e52a-4f')
Aug 16 22:36:25 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Rebasing disk image.
Aug 16 22:36:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] No VIF found with MAC fa:16:3e:7d:dd:e5, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.174s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 -F raw /opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG nova.network.neutron [req-916458f4-7545-4a4b-9d10-de5062a07d9e req-7857c68c-692f-4573-99e3-5cff1b47f543 service nova] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Updated VIF entry in instance network info cache for port 1741e52a-4fe9-4496-9c8b-56f3e1816fc3. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG nova.network.neutron [req-916458f4-7545-4a4b-9d10-de5062a07d9e req-7857c68c-692f-4573-99e3-5cff1b47f543 service nova] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Updating instance_info_cache with network_info: [{"id": "1741e52a-4fe9-4496-9c8b-56f3e1816fc3", "address": "fa:16:3e:7d:dd:e5", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1741e52a-4f", "ovs_interfaceid": "1741e52a-4fe9-4496-9c8b-56f3e1816fc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:36:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-916458f4-7545-4a4b-9d10-de5062a07d9e req-7857c68c-692f-4573-99e3-5cff1b47f543 service nova] Releasing lock "refresh_cache-16a246c1-b2a7-4048-a6c9-235c15079d39" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:36:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:26 user nova-compute[72773]: DEBUG nova.compute.manager [req-2822e91b-4a7e-42a0-aa55-c1c9b546d927 req-4ad7952d-4d31-43ab-9c98-2d653839d00e service nova] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Received event network-vif-plugged-1741e52a-4fe9-4496-9c8b-56f3e1816fc3 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:36:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2822e91b-4a7e-42a0-aa55-c1c9b546d927 req-4ad7952d-4d31-43ab-9c98-2d653839d00e service nova] Acquiring lock "16a246c1-b2a7-4048-a6c9-235c15079d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:36:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2822e91b-4a7e-42a0-aa55-c1c9b546d927 req-4ad7952d-4d31-43ab-9c98-2d653839d00e service nova] Lock "16a246c1-b2a7-4048-a6c9-235c15079d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:36:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2822e91b-4a7e-42a0-aa55-c1c9b546d927 req-4ad7952d-4d31-43ab-9c98-2d653839d00e service nova] Lock "16a246c1-b2a7-4048-a6c9-235c15079d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:36:26 user nova-compute[72773]: DEBUG nova.compute.manager [req-2822e91b-4a7e-42a0-aa55-c1c9b546d927 req-4ad7952d-4d31-43ab-9c98-2d653839d00e service nova] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] No waiting events found dispatching network-vif-plugged-1741e52a-4fe9-4496-9c8b-56f3e1816fc3 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:36:26 user nova-compute[72773]: WARNING nova.compute.manager [req-2822e91b-4a7e-42a0-aa55-c1c9b546d927 req-4ad7952d-4d31-43ab-9c98-2d653839d00e service nova] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Received unexpected event network-vif-plugged-1741e52a-4fe9-4496-9c8b-56f3e1816fc3 for instance with vm_state building and task_state spawning.
Aug 16 22:36:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 -F raw /opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk" returned: 0 in 2.626s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Ensure instance console log exists: /opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Start _get_guest_xml network_info=[{"id": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "address": "fa:16:3e:0b:c6:49", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeae4e0ec-31", "ovs_interfaceid": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d5b494e6bdb4323ff480c21123515ebb',container_format='bare',created_at=2023-08-16T22:34:26Z,direct_url=<?>,disk_format='qcow2',id=9ad4ea58-516d-47f5-8361-ed8a066e1975,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-420565271-shelved',owner='a2ef6a37d79341d7a94e5b314efddab4',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T22:34:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:36:28 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:36:28 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d5b494e6bdb4323ff480c21123515ebb',container_format='bare',created_at=2023-08-16T22:34:26Z,direct_url=<?>,disk_format='qcow2',id=9ad4ea58-516d-47f5-8361-ed8a066e1975,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-420565271-shelved',owner='a2ef6a37d79341d7a94e5b314efddab4',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T22:34:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.objects.instance [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lazy-loading 'vcpu_model' on Instance uuid 63644e8f-95d4-43a7-a824-8845dd073423 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "2c59217c-22f8-4745-b05e-53300ca454f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "2c59217c-22f8-4745-b05e-53300ca454f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T22:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-420565271',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-420565271',id=25,image_ref='9ad4ea58-516d-47f5-8361-ed8a066e1975',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-126270933',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:32:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a2ef6a37d79341d7a94e5b314efddab4',ramdisk_id='',reservation_id='r-ixfawem0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-488184195',owner_user_name='tempest-AttachVolumeShelveTestJSON-488184195-project-member',shelved_at='2023-08-16T22:34:30.272723',shelved_host='user',shelved_image_id='9ad4ea58-516d-47f5-8361-ed8a066e1975'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:36:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71cd9d1142ec45e792219e8b789cf2a0',uuid=63644e8f-95d4-43a7-a824-8845dd073423,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "address": "fa:16:3e:0b:c6:49", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeae4e0ec-31", "ovs_interfaceid": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Converting VIF {"id": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "address": "fa:16:3e:0b:c6:49", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeae4e0ec-31", "ovs_interfaceid": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c6:49,bridge_name='br-int',has_traffic_filtering=True,id=eae4e0ec-3105-463d-9c92-0e2f63192bb6,network=Network(9aa7e6bf-5a47-422d-b638-cff5a8429391),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeae4e0ec-31') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.objects.instance [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lazy-loading 'pci_devices' on Instance uuid 63644e8f-95d4-43a7-a824-8845dd073423 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.compute.manager [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:36:28 user nova-compute[72773]:   <uuid>63644e8f-95d4-43a7-a824-8845dd073423</uuid>
Aug 16 22:36:28 user nova-compute[72773]:   <name>instance-00000019</name>
Aug 16 22:36:28 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:36:28 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:36:28 user nova-compute[72773]:   <metadata>
Aug 16 22:36:28 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:36:28 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:36:28 user nova-compute[72773]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-420565271</nova:name>
Aug 16 22:36:28 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:36:28</nova:creationTime>
Aug 16 22:36:28 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:36:28 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:36:28 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:36:28 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:36:28 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:36:28 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:36:28 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:36:28 user nova-compute[72773]:       <nova:owner>
Aug 16 22:36:28 user nova-compute[72773]:         <nova:user uuid="71cd9d1142ec45e792219e8b789cf2a0">tempest-AttachVolumeShelveTestJSON-488184195-project-member</nova:user>
Aug 16 22:36:28 user nova-compute[72773]:         <nova:project uuid="a2ef6a37d79341d7a94e5b314efddab4">tempest-AttachVolumeShelveTestJSON-488184195</nova:project>
Aug 16 22:36:28 user nova-compute[72773]:       </nova:owner>
Aug 16 22:36:28 user nova-compute[72773]:       <nova:root type="image" uuid="9ad4ea58-516d-47f5-8361-ed8a066e1975"/>
Aug 16 22:36:28 user nova-compute[72773]:       <nova:ports>
Aug 16 22:36:28 user nova-compute[72773]:         <nova:port uuid="eae4e0ec-3105-463d-9c92-0e2f63192bb6">
Aug 16 22:36:28 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 22:36:28 user nova-compute[72773]:         </nova:port>
Aug 16 22:36:28 user nova-compute[72773]:       </nova:ports>
Aug 16 22:36:28 user nova-compute[72773]:     </nova:instance>
Aug 16 22:36:28 user nova-compute[72773]:   </metadata>
Aug 16 22:36:28 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:36:28 user nova-compute[72773]:     <system>
Aug 16 22:36:28 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:36:28 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:36:28 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:36:28 user nova-compute[72773]:       <entry name="serial">63644e8f-95d4-43a7-a824-8845dd073423</entry>
Aug 16 22:36:28 user nova-compute[72773]:       <entry name="uuid">63644e8f-95d4-43a7-a824-8845dd073423</entry>
Aug 16 22:36:28 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:36:28 user nova-compute[72773]:     </system>
Aug 16 22:36:28 user nova-compute[72773]:   </sysinfo>
Aug 16 22:36:28 user nova-compute[72773]:   <os>
Aug 16 22:36:28 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:36:28 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:36:28 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:36:28 user nova-compute[72773]:   </os>
Aug 16 22:36:28 user nova-compute[72773]:   <features>
Aug 16 22:36:28 user nova-compute[72773]:     <acpi/>
Aug 16 22:36:28 user nova-compute[72773]:     <apic/>
Aug 16 22:36:28 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:36:28 user nova-compute[72773]:   </features>
Aug 16 22:36:28 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:36:28 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:36:28 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:36:28 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:36:28 user nova-compute[72773]:   </clock>
Aug 16 22:36:28 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:36:28 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:36:28 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:36:28 user nova-compute[72773]:   </cpu>
Aug 16 22:36:28 user nova-compute[72773]:   <devices>
Aug 16 22:36:28 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:36:28 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:36:28 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk"/>
Aug 16 22:36:28 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:36:28 user nova-compute[72773]:     </disk>
Aug 16 22:36:28 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:36:28 user nova-compute[72773]:       <mac address="fa:16:3e:0b:c6:49"/>
Aug 16 22:36:28 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:36:28 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:36:28 user nova-compute[72773]:       <target dev="tapeae4e0ec-31"/>
Aug 16 22:36:28 user nova-compute[72773]:     </interface>
Aug 16 22:36:28 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:36:28 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/console.log" append="off"/>
Aug 16 22:36:28 user nova-compute[72773]:     </serial>
Aug 16 22:36:28 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:36:28 user nova-compute[72773]:     <video>
Aug 16 22:36:28 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:36:28 user nova-compute[72773]:     </video>
Aug 16 22:36:28 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:36:28 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:36:28 user nova-compute[72773]:     </rng>
Aug 16 22:36:28 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:36:28 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:36:28 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:36:28 user nova-compute[72773]:     </memballoon>
Aug 16 22:36:28 user nova-compute[72773]:   </devices>
Aug 16 22:36:28 user nova-compute[72773]: </domain>
Aug 16 22:36:28 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T22:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-420565271',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-420565271',id=25,image_ref='9ad4ea58-516d-47f5-8361-ed8a066e1975',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-126270933',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:32:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a2ef6a37d79341d7a94e5b314efddab4',ramdisk_id='',reservation_id='r-ixfawem0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-488184195',owner_user_name='tempest-AttachVolumeShelveTestJSON-488184195-project-member',shelved_at='2023-08-16T22:34:30.272723',shelved_host='user',shelved_image_id='9ad4ea58-516d-47f5-8361-ed8a066e1975'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:36:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71cd9d1142ec45e792219e8b789cf2a0',uuid=63644e8f-95d4-43a7-a824-8845dd073423,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "address": "fa:16:3e:0b:c6:49", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeae4e0ec-31", "ovs_interfaceid": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Converting VIF {"id": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "address": "fa:16:3e:0b:c6:49", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeae4e0ec-31", "ovs_interfaceid": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c6:49,bridge_name='br-int',has_traffic_filtering=True,id=eae4e0ec-3105-463d-9c92-0e2f63192bb6,network=Network(9aa7e6bf-5a47-422d-b638-cff5a8429391),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeae4e0ec-31') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG os_vif [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c6:49,bridge_name='br-int',has_traffic_filtering=True,id=eae4e0ec-3105-463d-9c92-0e2f63192bb6,network=Network(9aa7e6bf-5a47-422d-b638-cff5a8429391),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeae4e0ec-31') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeae4e0ec-31, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeae4e0ec-31, col_values=(('external_ids', {'iface-id': 'eae4e0ec-3105-463d-9c92-0e2f63192bb6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:c6:49', 'vm-uuid': '63644e8f-95d4-43a7-a824-8845dd073423'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:28 user nova-compute[72773]: INFO os_vif [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c6:49,bridge_name='br-int',has_traffic_filtering=True,id=eae4e0ec-3105-463d-9c92-0e2f63192bb6,network=Network(9aa7e6bf-5a47-422d-b638-cff5a8429391),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeae4e0ec-31')
Aug 16 22:36:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:36:28 user nova-compute[72773]: INFO nova.compute.claims [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Claim successful on node user
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] No VIF found with MAC fa:16:3e:0b:c6:49, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.536s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.compute.manager [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.compute.manager [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.network.neutron [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:36:28 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.compute.manager [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.compute.manager [req-1fd9724c-447c-4f19-9331-c903fbb4b7f4 req-423c7c46-11ba-4a62-99e2-fa0d762d48e0 service nova] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Received event network-vif-plugged-1741e52a-4fe9-4496-9c8b-56f3e1816fc3 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-1fd9724c-447c-4f19-9331-c903fbb4b7f4 req-423c7c46-11ba-4a62-99e2-fa0d762d48e0 service nova] Acquiring lock "16a246c1-b2a7-4048-a6c9-235c15079d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-1fd9724c-447c-4f19-9331-c903fbb4b7f4 req-423c7c46-11ba-4a62-99e2-fa0d762d48e0 service nova] Lock "16a246c1-b2a7-4048-a6c9-235c15079d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-1fd9724c-447c-4f19-9331-c903fbb4b7f4 req-423c7c46-11ba-4a62-99e2-fa0d762d48e0 service nova] Lock "16a246c1-b2a7-4048-a6c9-235c15079d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.compute.manager [req-1fd9724c-447c-4f19-9331-c903fbb4b7f4 req-423c7c46-11ba-4a62-99e2-fa0d762d48e0 service nova] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] No waiting events found dispatching network-vif-plugged-1741e52a-4fe9-4496-9c8b-56f3e1816fc3 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:36:28 user nova-compute[72773]: WARNING nova.compute.manager [req-1fd9724c-447c-4f19-9331-c903fbb4b7f4 req-423c7c46-11ba-4a62-99e2-fa0d762d48e0 service nova] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Received unexpected event network-vif-plugged-1741e52a-4fe9-4496-9c8b-56f3e1816fc3 for instance with vm_state building and task_state spawning.
Aug 16 22:36:28 user nova-compute[72773]: DEBUG nova.policy [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '42e8c8d0806e45ed9d1126aad24a034b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f496354017e467e9b7a537c73248fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:36:28 user nova-compute[72773]: INFO nova.virt.block_device [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Booting with volume-backed-image 370c21db-2a77-45c9-b1ac-4447fbc4f414 at /dev/vda
Aug 16 22:36:29 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225389.4645302, 16a246c1-b2a7-4048-a6c9-235c15079d39 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:36:29 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] VM Resumed (Lifecycle Event)
Aug 16 22:36:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:36:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:36:29 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Instance spawned successfully.
Aug 16 22:36:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:36:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:36:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:36:29 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:36:29 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225389.4723241, 16a246c1-b2a7-4048-a6c9-235c15079d39 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:36:29 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] VM Started (Lifecycle Event)
Aug 16 22:36:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:36:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:36:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:36:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:36:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:36:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:36:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:36:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:36:29 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:36:29 user nova-compute[72773]: DEBUG nova.network.neutron [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Successfully created port: 068f02fa-b6b9-4148-b9b2-737d79b6c82e {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:36:29 user nova-compute[72773]: INFO nova.compute.manager [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Took 7.51 seconds to spawn the instance on the hypervisor.
Aug 16 22:36:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:36:30 user nova-compute[72773]: INFO nova.compute.manager [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Took 8.61 seconds to build instance.
Aug 16 22:36:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-01e46c6c-bddd-4d32-97dd-7a9e18acce67 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "16a246c1-b2a7-4048-a6c9-235c15079d39" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.839s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:36:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:30 user nova-compute[72773]: DEBUG nova.compute.manager [req-fa927e3c-7d96-4355-b4b7-a65c0d0f5a1b req-11fbabbd-f8de-432b-b01c-a5a59c241a4d service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Received event network-vif-plugged-eae4e0ec-3105-463d-9c92-0e2f63192bb6 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:36:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fa927e3c-7d96-4355-b4b7-a65c0d0f5a1b req-11fbabbd-f8de-432b-b01c-a5a59c241a4d service nova] Acquiring lock "63644e8f-95d4-43a7-a824-8845dd073423-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:36:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fa927e3c-7d96-4355-b4b7-a65c0d0f5a1b req-11fbabbd-f8de-432b-b01c-a5a59c241a4d service nova] Lock "63644e8f-95d4-43a7-a824-8845dd073423-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:36:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fa927e3c-7d96-4355-b4b7-a65c0d0f5a1b req-11fbabbd-f8de-432b-b01c-a5a59c241a4d service nova] Lock "63644e8f-95d4-43a7-a824-8845dd073423-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:36:30 user nova-compute[72773]: DEBUG nova.compute.manager [req-fa927e3c-7d96-4355-b4b7-a65c0d0f5a1b req-11fbabbd-f8de-432b-b01c-a5a59c241a4d service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] No waiting events found dispatching network-vif-plugged-eae4e0ec-3105-463d-9c92-0e2f63192bb6 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:36:30 user nova-compute[72773]: WARNING nova.compute.manager [req-fa927e3c-7d96-4355-b4b7-a65c0d0f5a1b req-11fbabbd-f8de-432b-b01c-a5a59c241a4d service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Received unexpected event network-vif-plugged-eae4e0ec-3105-463d-9c92-0e2f63192bb6 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 22:36:30 user nova-compute[72773]: DEBUG nova.compute.manager [req-fa927e3c-7d96-4355-b4b7-a65c0d0f5a1b req-11fbabbd-f8de-432b-b01c-a5a59c241a4d service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Received event network-vif-plugged-eae4e0ec-3105-463d-9c92-0e2f63192bb6 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:36:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fa927e3c-7d96-4355-b4b7-a65c0d0f5a1b req-11fbabbd-f8de-432b-b01c-a5a59c241a4d service nova] Acquiring lock "63644e8f-95d4-43a7-a824-8845dd073423-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:36:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fa927e3c-7d96-4355-b4b7-a65c0d0f5a1b req-11fbabbd-f8de-432b-b01c-a5a59c241a4d service nova] Lock "63644e8f-95d4-43a7-a824-8845dd073423-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:36:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fa927e3c-7d96-4355-b4b7-a65c0d0f5a1b req-11fbabbd-f8de-432b-b01c-a5a59c241a4d service nova] Lock "63644e8f-95d4-43a7-a824-8845dd073423-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:36:31 user nova-compute[72773]: DEBUG nova.compute.manager [req-fa927e3c-7d96-4355-b4b7-a65c0d0f5a1b req-11fbabbd-f8de-432b-b01c-a5a59c241a4d service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] No waiting events found dispatching network-vif-plugged-eae4e0ec-3105-463d-9c92-0e2f63192bb6 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:36:31 user nova-compute[72773]: WARNING nova.compute.manager [req-fa927e3c-7d96-4355-b4b7-a65c0d0f5a1b req-11fbabbd-f8de-432b-b01c-a5a59c241a4d service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Received unexpected event network-vif-plugged-eae4e0ec-3105-463d-9c92-0e2f63192bb6 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 22:36:31 user nova-compute[72773]: DEBUG nova.network.neutron [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Successfully updated port: 068f02fa-b6b9-4148-b9b2-737d79b6c82e {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:36:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "refresh_cache-2c59217c-22f8-4745-b05e-53300ca454f2" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:36:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquired lock "refresh_cache-2c59217c-22f8-4745-b05e-53300ca454f2" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:36:31 user nova-compute[72773]: DEBUG nova.network.neutron [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:36:31 user nova-compute[72773]: DEBUG nova.compute.manager [req-cf95909e-4959-48ae-abdf-03354ed0eed9 req-315077ce-c01e-4268-8b42-be53a3aa11f1 service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Received event network-changed-068f02fa-b6b9-4148-b9b2-737d79b6c82e {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:36:31 user nova-compute[72773]: DEBUG nova.compute.manager [req-cf95909e-4959-48ae-abdf-03354ed0eed9 req-315077ce-c01e-4268-8b42-be53a3aa11f1 service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Refreshing instance network info cache due to event network-changed-068f02fa-b6b9-4148-b9b2-737d79b6c82e. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:36:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-cf95909e-4959-48ae-abdf-03354ed0eed9 req-315077ce-c01e-4268-8b42-be53a3aa11f1 service nova] Acquiring lock "refresh_cache-2c59217c-22f8-4745-b05e-53300ca454f2" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:36:31 user nova-compute[72773]: DEBUG nova.network.neutron [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:36:31 user nova-compute[72773]: DEBUG nova.network.neutron [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Updating instance_info_cache with network_info: [{"id": "068f02fa-b6b9-4148-b9b2-737d79b6c82e", "address": "fa:16:3e:6b:7c:d2", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068f02fa-b6", "ovs_interfaceid": "068f02fa-b6b9-4148-b9b2-737d79b6c82e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:36:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Releasing lock "refresh_cache-2c59217c-22f8-4745-b05e-53300ca454f2" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:36:31 user nova-compute[72773]: DEBUG nova.compute.manager [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Instance network_info: |[{"id": "068f02fa-b6b9-4148-b9b2-737d79b6c82e", "address": "fa:16:3e:6b:7c:d2", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068f02fa-b6", "ovs_interfaceid": "068f02fa-b6b9-4148-b9b2-737d79b6c82e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:36:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-cf95909e-4959-48ae-abdf-03354ed0eed9 req-315077ce-c01e-4268-8b42-be53a3aa11f1 service nova] Acquired lock "refresh_cache-2c59217c-22f8-4745-b05e-53300ca454f2" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:36:31 user nova-compute[72773]: DEBUG nova.network.neutron [req-cf95909e-4959-48ae-abdf-03354ed0eed9 req-315077ce-c01e-4268-8b42-be53a3aa11f1 service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Refreshing network info cache for port 068f02fa-b6b9-4148-b9b2-737d79b6c82e {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:36:32 user nova-compute[72773]: DEBUG nova.network.neutron [req-cf95909e-4959-48ae-abdf-03354ed0eed9 req-315077ce-c01e-4268-8b42-be53a3aa11f1 service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Updated VIF entry in instance network info cache for port 068f02fa-b6b9-4148-b9b2-737d79b6c82e. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:36:32 user nova-compute[72773]: DEBUG nova.network.neutron [req-cf95909e-4959-48ae-abdf-03354ed0eed9 req-315077ce-c01e-4268-8b42-be53a3aa11f1 service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Updating instance_info_cache with network_info: [{"id": "068f02fa-b6b9-4148-b9b2-737d79b6c82e", "address": "fa:16:3e:6b:7c:d2", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068f02fa-b6", "ovs_interfaceid": "068f02fa-b6b9-4148-b9b2-737d79b6c82e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:36:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-cf95909e-4959-48ae-abdf-03354ed0eed9 req-315077ce-c01e-4268-8b42-be53a3aa11f1 service nova] Releasing lock "refresh_cache-2c59217c-22f8-4745-b05e-53300ca454f2" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:36:32 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225392.3738317, 63644e8f-95d4-43a7-a824-8845dd073423 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:36:32 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] VM Resumed (Lifecycle Event)
Aug 16 22:36:32 user nova-compute[72773]: DEBUG nova.compute.manager [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:36:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:36:32 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Instance spawned successfully.
Aug 16 22:36:32 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:36:32 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:36:32 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:36:32 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225392.3758268, 63644e8f-95d4-43a7-a824-8845dd073423 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:36:32 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] VM Started (Lifecycle Event)
Aug 16 22:36:32 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:36:32 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:36:32 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:36:32 user nova-compute[72773]: DEBUG nova.compute.manager [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:36:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-89f26012-a81c-4e02-a25a-9751cbee7920 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "63644e8f-95d4-43a7-a824-8845dd073423" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.537s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:36:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:39 user nova-compute[72773]: DEBUG os_brick.utils [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:36:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:39 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7dbdfbd-3608-4b19-9f13-1dd789ed5adc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:36:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:39 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9a2c98-5584-4252-ab02-a33f205e21b0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:36:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:39 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10fa868-ccc3-40d4-aba6-60ac2144eebb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:36:39 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81e3a2f-5a1c-4866-bc47-b89ebeeb262d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:36:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:36:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:36:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:36:39 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:36:39 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c840561-8f24-430a-8c06-80b89e157bca]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:36:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:36:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:36:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:36:39 user nova-compute[72773]: DEBUG os_brick.utils [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:36:39 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Updating existing volume attachment record: 022261dd-bc65-4e4d-bc79-fe3da273e302 {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:36:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:36:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 22:36:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:36:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:36:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:47 user nova-compute[72773]: DEBUG nova.compute.manager [req-813a14b9-98c6-4978-986f-29f1a7006927 req-4d02b745-858a-47d0-83da-f1e79e2ca8d7 service nova] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Received event network-changed-bb573e79-a106-40c5-8c53-ab73eb6ba240 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:36:47 user nova-compute[72773]: DEBUG nova.compute.manager [req-813a14b9-98c6-4978-986f-29f1a7006927 req-4d02b745-858a-47d0-83da-f1e79e2ca8d7 service nova] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Refreshing instance network info cache due to event network-changed-bb573e79-a106-40c5-8c53-ab73eb6ba240. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:36:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-813a14b9-98c6-4978-986f-29f1a7006927 req-4d02b745-858a-47d0-83da-f1e79e2ca8d7 service nova] Acquiring lock "refresh_cache-f4210738-d01e-4408-a15c-aeccada6dd23" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:36:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-813a14b9-98c6-4978-986f-29f1a7006927 req-4d02b745-858a-47d0-83da-f1e79e2ca8d7 service nova] Acquired lock "refresh_cache-f4210738-d01e-4408-a15c-aeccada6dd23" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:36:47 user nova-compute[72773]: DEBUG nova.network.neutron [req-813a14b9-98c6-4978-986f-29f1a7006927 req-4d02b745-858a-47d0-83da-f1e79e2ca8d7 service nova] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Refreshing network info cache for port bb573e79-a106-40c5-8c53-ab73eb6ba240 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:36:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:48 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:36:48 user nova-compute[72773]: DEBUG nova.network.neutron [req-813a14b9-98c6-4978-986f-29f1a7006927 req-4d02b745-858a-47d0-83da-f1e79e2ca8d7 service nova] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Updated VIF entry in instance network info cache for port bb573e79-a106-40c5-8c53-ab73eb6ba240. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:36:48 user nova-compute[72773]: DEBUG nova.network.neutron [req-813a14b9-98c6-4978-986f-29f1a7006927 req-4d02b745-858a-47d0-83da-f1e79e2ca8d7 service nova] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Updating instance_info_cache with network_info: [{"id": "bb573e79-a106-40c5-8c53-ab73eb6ba240", "address": "fa:16:3e:1e:80:9b", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb573e79-a1", "ovs_interfaceid": "bb573e79-a106-40c5-8c53-ab73eb6ba240", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:36:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-813a14b9-98c6-4978-986f-29f1a7006927 req-4d02b745-858a-47d0-83da-f1e79e2ca8d7 service nova] Releasing lock "refresh_cache-f4210738-d01e-4408-a15c-aeccada6dd23" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:36:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:51 user nova-compute[72773]: INFO nova.compute.manager [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Rescuing
Aug 16 22:36:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "refresh_cache-391a6006-4fe6-4398-a1e8-ae95b5edbf2b" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquired lock "refresh_cache-391a6006-4fe6-4398-a1e8-ae95b5edbf2b" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG nova.compute.manager [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:36:51 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Creating image(s)
Aug 16 22:36:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Did not create local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Ensure instance console log exists: /opt/stack/data/nova/instances/2c59217c-22f8-4745-b05e-53300ca454f2/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Start _get_guest_xml network_info=[{"id": "068f02fa-b6b9-4148-b9b2-737d79b6c82e", "address": "fa:16:3e:6b:7c:d2", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068f02fa-b6", "ovs_interfaceid": "068f02fa-b6b9-4148-b9b2-737d79b6c82e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '022261dd-bc65-4e4d-bc79-fe3da273e302', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yplbNxGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2c59217c-22f8-4745-b05e-53300ca454f2', 'attached_at': '', 'detached_at': '', 'volume_id': 'b853e2cd-8117-4231-bb70-cfc6469d3fad', 'serial': 'b853e2cd-8117-4231-bb70-cfc6469d3fad'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:36:51 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:36:51 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:36:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yplbNxGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:36:51 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:36:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:36:51 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:36:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:36:51 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:36:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83cd288-61a9-41d2-94b9-b8aa6d4dbfe4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:36:51 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4de5c4-755d-4f28-add7-f40be69710c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad] added
Aug 16 22:36:51 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10544fb-192a-420b-b5f8-3aeee3816fc3]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0393db38-0f25-4317-9b4f-efa2ce891897]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yplbNxGO {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yplbNxGO" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3edee7b-6821-4dc5-ba2a-86dc84db6975]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yplbNxGO'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5bcd6b-3802-44d8-ade1-ed63145f4b94]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a7aef9-b705-4262-9186-740bc58648fc]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:36:51 user nova-compute[72773]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)
Aug 16 22:36:51 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:36:51 user nova-compute[72773]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)
Aug 16 22:36:51 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35b474c-6440-4e7b-babe-1559cdf5e703]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad, portal: 172.16.0.220,3260]
Aug 16 22:36:51 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad, portal: 172.16.0.220,3260] successful.
Aug 16 22:36:51 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:36:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:52 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a5e4b7-e544-455c-9eea-38de42bd5049]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:36:52 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:36:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:52 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3612ba-617c-48ce-acc6-dcaf8b3661d6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:36:52 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:36:52 user nova-compute[72773]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)
Aug 16 22:36:52 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:36:52 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:36:52 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:36:52 user nova-compute[72773]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)
Aug 16 22:36:52 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:36:52 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:36:52 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:36:52 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:36:52 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:36:52 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:36:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:52 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e76ad8-5cc7-4653-a943-a01100b770bb]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:36:52 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: None {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:36:52 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Updating instance_info_cache with network_info: [{"id": "6961298d-d62e-4f7b-b97e-4198a325816c", "address": "fa:16:3e:2d:58:d4", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6961298d-d6", "ovs_interfaceid": "6961298d-d62e-4f7b-b97e-4198a325816c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:36:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Releasing lock "refresh_cache-391a6006-4fe6-4398-a1e8-ae95b5edbf2b" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:36:52 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:36:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:52 user nova-compute[72773]: DEBUG nova.compute.manager [req-2cfbec64-9feb-42e3-bb6c-56a0fbcd2331 req-40d654e8-b64a-4ea6-8945-8f43c18646cc service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Received event network-vif-unplugged-6961298d-d62e-4f7b-b97e-4198a325816c {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:36:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2cfbec64-9feb-42e3-bb6c-56a0fbcd2331 req-40d654e8-b64a-4ea6-8945-8f43c18646cc service nova] Acquiring lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:36:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2cfbec64-9feb-42e3-bb6c-56a0fbcd2331 req-40d654e8-b64a-4ea6-8945-8f43c18646cc service nova] Lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:36:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2cfbec64-9feb-42e3-bb6c-56a0fbcd2331 req-40d654e8-b64a-4ea6-8945-8f43c18646cc service nova] Lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:36:52 user nova-compute[72773]: DEBUG nova.compute.manager [req-2cfbec64-9feb-42e3-bb6c-56a0fbcd2331 req-40d654e8-b64a-4ea6-8945-8f43c18646cc service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] No waiting events found dispatching network-vif-unplugged-6961298d-d62e-4f7b-b97e-4198a325816c {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:36:52 user nova-compute[72773]: WARNING nova.compute.manager [req-2cfbec64-9feb-42e3-bb6c-56a0fbcd2331 req-40d654e8-b64a-4ea6-8945-8f43c18646cc service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Received unexpected event network-vif-unplugged-6961298d-d62e-4f7b-b97e-4198a325816c for instance with vm_state active and task_state rescuing.
Aug 16 22:36:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:53 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Instance destroyed successfully.
Aug 16 22:36:53 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Attempting rescue
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72773) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Instance directory exists: not creating {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 22:36:53 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Creating image(s)
Aug 16 22:36:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "/opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "/opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "/opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.objects.instance [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lazy-loading 'trusted_certs' on Instance uuid 391a6006-4fe6-4398-a1e8-ae95b5edbf2b {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yplbNxGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '26365303239303034', 'path': '/dev/sdd'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365303239303034', 'path': '/dev/sdd'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:36:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-886465728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-886465728',id=32,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f496354017e467e9b7a537c73248fe2',ramdisk_id='',reservation_id='r-qolg41tm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648946443',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:36:29Z,user_data=None,user_id='42e8c8d0806e45ed9d1126aad24a034b',uuid=2c59217c-22f8-4745-b05e-53300ca454f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "068f02fa-b6b9-4148-b9b2-737d79b6c82e", "address": "fa:16:3e:6b:7c:d2", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068f02fa-b6", "ovs_interfaceid": "068f02fa-b6b9-4148-b9b2-737d79b6c82e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Converting VIF {"id": "068f02fa-b6b9-4148-b9b2-737d79b6c82e", "address": "fa:16:3e:6b:7c:d2", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068f02fa-b6", "ovs_interfaceid": "068f02fa-b6b9-4148-b9b2-737d79b6c82e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=068f02fa-b6b9-4148-b9b2-737d79b6c82e,network=Network(0a6ec813-28f9-4716-bf41-20722c69fe20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068f02fa-b6') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.objects.instance [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c59217c-22f8-4745-b05e-53300ca454f2 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:36:53 user nova-compute[72773]:   <uuid>2c59217c-22f8-4745-b05e-53300ca454f2</uuid>
Aug 16 22:36:53 user nova-compute[72773]:   <name>instance-00000020</name>
Aug 16 22:36:53 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:36:53 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:36:53 user nova-compute[72773]:   <metadata>
Aug 16 22:36:53 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:36:53 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:36:53 user nova-compute[72773]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-886465728</nova:name>
Aug 16 22:36:53 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:36:51</nova:creationTime>
Aug 16 22:36:53 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:36:53 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:36:53 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:36:53 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:36:53 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:36:53 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:36:53 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:36:53 user nova-compute[72773]:       <nova:owner>
Aug 16 22:36:53 user nova-compute[72773]:         <nova:user uuid="42e8c8d0806e45ed9d1126aad24a034b">tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member</nova:user>
Aug 16 22:36:53 user nova-compute[72773]:         <nova:project uuid="4f496354017e467e9b7a537c73248fe2">tempest-ServerBootFromVolumeStableRescueTest-1648946443</nova:project>
Aug 16 22:36:53 user nova-compute[72773]:       </nova:owner>
Aug 16 22:36:53 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:36:53 user nova-compute[72773]:       <nova:ports>
Aug 16 22:36:53 user nova-compute[72773]:         <nova:port uuid="068f02fa-b6b9-4148-b9b2-737d79b6c82e">
Aug 16 22:36:53 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 22:36:53 user nova-compute[72773]:         </nova:port>
Aug 16 22:36:53 user nova-compute[72773]:       </nova:ports>
Aug 16 22:36:53 user nova-compute[72773]:     </nova:instance>
Aug 16 22:36:53 user nova-compute[72773]:   </metadata>
Aug 16 22:36:53 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:36:53 user nova-compute[72773]:     <system>
Aug 16 22:36:53 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:36:53 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:36:53 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:36:53 user nova-compute[72773]:       <entry name="serial">2c59217c-22f8-4745-b05e-53300ca454f2</entry>
Aug 16 22:36:53 user nova-compute[72773]:       <entry name="uuid">2c59217c-22f8-4745-b05e-53300ca454f2</entry>
Aug 16 22:36:53 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:36:53 user nova-compute[72773]:     </system>
Aug 16 22:36:53 user nova-compute[72773]:   </sysinfo>
Aug 16 22:36:53 user nova-compute[72773]:   <os>
Aug 16 22:36:53 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:36:53 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:36:53 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:36:53 user nova-compute[72773]:   </os>
Aug 16 22:36:53 user nova-compute[72773]:   <features>
Aug 16 22:36:53 user nova-compute[72773]:     <acpi/>
Aug 16 22:36:53 user nova-compute[72773]:     <apic/>
Aug 16 22:36:53 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:36:53 user nova-compute[72773]:   </features>
Aug 16 22:36:53 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:36:53 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:36:53 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:36:53 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:36:53 user nova-compute[72773]:   </clock>
Aug 16 22:36:53 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:36:53 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:36:53 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:36:53 user nova-compute[72773]:   </cpu>
Aug 16 22:36:53 user nova-compute[72773]:   <devices>
Aug 16 22:36:53 user nova-compute[72773]:     <disk type="block" device="disk">
Aug 16 22:36:53 user nova-compute[72773]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:36:53 user nova-compute[72773]:       <source dev="/dev/sdd"/>
Aug 16 22:36:53 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:36:53 user nova-compute[72773]:       <serial>b853e2cd-8117-4231-bb70-cfc6469d3fad</serial>
Aug 16 22:36:53 user nova-compute[72773]:     </disk>
Aug 16 22:36:53 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:36:53 user nova-compute[72773]:       <mac address="fa:16:3e:6b:7c:d2"/>
Aug 16 22:36:53 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:36:53 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:36:53 user nova-compute[72773]:       <target dev="tap068f02fa-b6"/>
Aug 16 22:36:53 user nova-compute[72773]:     </interface>
Aug 16 22:36:53 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:36:53 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/2c59217c-22f8-4745-b05e-53300ca454f2/console.log" append="off"/>
Aug 16 22:36:53 user nova-compute[72773]:     </serial>
Aug 16 22:36:53 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:36:53 user nova-compute[72773]:     <video>
Aug 16 22:36:53 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:36:53 user nova-compute[72773]:     </video>
Aug 16 22:36:53 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:36:53 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:36:53 user nova-compute[72773]:     </rng>
Aug 16 22:36:53 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:36:53 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:36:53 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:36:53 user nova-compute[72773]:     </memballoon>
Aug 16 22:36:53 user nova-compute[72773]:   </devices>
Aug 16 22:36:53 user nova-compute[72773]: </domain>
Aug 16 22:36:53 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:36:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-886465728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-886465728',id=32,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f496354017e467e9b7a537c73248fe2',ramdisk_id='',reservation_id='r-qolg41tm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648946443',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:36:29Z,user_data=None,user_id='42e8c8d0806e45ed9d1126aad24a034b',uuid=2c59217c-22f8-4745-b05e-53300ca454f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "068f02fa-b6b9-4148-b9b2-737d79b6c82e", "address": "fa:16:3e:6b:7c:d2", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068f02fa-b6", "ovs_interfaceid": "068f02fa-b6b9-4148-b9b2-737d79b6c82e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Converting VIF {"id": "068f02fa-b6b9-4148-b9b2-737d79b6c82e", "address": "fa:16:3e:6b:7c:d2", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068f02fa-b6", "ovs_interfaceid": "068f02fa-b6b9-4148-b9b2-737d79b6c82e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=068f02fa-b6b9-4148-b9b2-737d79b6c82e,network=Network(0a6ec813-28f9-4716-bf41-20722c69fe20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068f02fa-b6') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG os_vif [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=068f02fa-b6b9-4148-b9b2-737d79b6c82e,network=Network(0a6ec813-28f9-4716-bf41-20722c69fe20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068f02fa-b6') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap068f02fa-b6, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap068f02fa-b6, col_values=(('external_ids', {'iface-id': '068f02fa-b6b9-4148-b9b2-737d79b6c82e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:7c:d2', 'vm-uuid': '2c59217c-22f8-4745-b05e-53300ca454f2'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:53 user nova-compute[72773]: INFO os_vif [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=068f02fa-b6b9-4148-b9b2-737d79b6c82e,network=Network(0a6ec813-28f9-4716-bf41-20722c69fe20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068f02fa-b6')
Aug 16 22:36:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.178s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk.rescue {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk.rescue" returned: 0 in 0.064s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.objects.instance [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lazy-loading 'migration_context' on Instance uuid 391a6006-4fe6-4398-a1e8-ae95b5edbf2b {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Start _get_guest_xml network_info=[{"id": "6961298d-d62e-4f7b-b97e-4198a325816c", "address": "fa:16:3e:2d:58:d4", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "vif_mac": "fa:16:3e:2d:58:d4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6961298d-d6", "ovs_interfaceid": "6961298d-d62e-4f7b-b97e-4198a325816c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.objects.instance [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lazy-loading 'resources' on Instance uuid 391a6006-4fe6-4398-a1e8-ae95b5edbf2b {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.objects.instance [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lazy-loading 'numa_topology' on Instance uuid 391a6006-4fe6-4398-a1e8-ae95b5edbf2b {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] No VIF found with MAC fa:16:3e:6b:7c:d2, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:36:53 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:36:53 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.objects.instance [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lazy-loading 'vcpu_model' on Instance uuid 391a6006-4fe6-4398-a1e8-ae95b5edbf2b {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:32:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1414401215',display_name='tempest-ServerRescueNegativeTestJSON-server-1414401215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1414401215',id=21,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:32:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f8e068df8094356b16a6480cd231675',ramdisk_id='',reservation_id='r-biq7d4v4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1754829282',owner_user_name='tempest-ServerRescueNegativeTestJSON-1754829282-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:32:13Z,user_data=None,user_id='62e5b77a149140fd8613d566f41cc23d',uuid=391a6006-4fe6-4398-a1e8-ae95b5edbf2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6961298d-d62e-4f7b-b97e-4198a325816c", "address": "fa:16:3e:2d:58:d4", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "vif_mac": "fa:16:3e:2d:58:d4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6961298d-d6", "ovs_interfaceid": "6961298d-d62e-4f7b-b97e-4198a325816c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Converting VIF {"id": "6961298d-d62e-4f7b-b97e-4198a325816c", "address": "fa:16:3e:2d:58:d4", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "vif_mac": "fa:16:3e:2d:58:d4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6961298d-d6", "ovs_interfaceid": "6961298d-d62e-4f7b-b97e-4198a325816c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:58:d4,bridge_name='br-int',has_traffic_filtering=True,id=6961298d-d62e-4f7b-b97e-4198a325816c,network=Network(8a43bbad-aab2-44c9-a7e4-62696d908234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6961298d-d6') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.objects.instance [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lazy-loading 'pci_devices' on Instance uuid 391a6006-4fe6-4398-a1e8-ae95b5edbf2b {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:36:53 user nova-compute[72773]:   <uuid>391a6006-4fe6-4398-a1e8-ae95b5edbf2b</uuid>
Aug 16 22:36:53 user nova-compute[72773]:   <name>instance-00000015</name>
Aug 16 22:36:53 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:36:53 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:36:53 user nova-compute[72773]:   <metadata>
Aug 16 22:36:53 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:36:53 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:36:53 user nova-compute[72773]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1414401215</nova:name>
Aug 16 22:36:53 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:36:53</nova:creationTime>
Aug 16 22:36:53 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:36:53 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:36:53 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:36:53 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:36:53 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:36:53 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:36:53 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:36:53 user nova-compute[72773]:       <nova:owner>
Aug 16 22:36:53 user nova-compute[72773]:         <nova:user uuid="62e5b77a149140fd8613d566f41cc23d">tempest-ServerRescueNegativeTestJSON-1754829282-project-member</nova:user>
Aug 16 22:36:53 user nova-compute[72773]:         <nova:project uuid="0f8e068df8094356b16a6480cd231675">tempest-ServerRescueNegativeTestJSON-1754829282</nova:project>
Aug 16 22:36:53 user nova-compute[72773]:       </nova:owner>
Aug 16 22:36:53 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:36:53 user nova-compute[72773]:       <nova:ports>
Aug 16 22:36:53 user nova-compute[72773]:         <nova:port uuid="6961298d-d62e-4f7b-b97e-4198a325816c">
Aug 16 22:36:53 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 22:36:53 user nova-compute[72773]:         </nova:port>
Aug 16 22:36:53 user nova-compute[72773]:       </nova:ports>
Aug 16 22:36:53 user nova-compute[72773]:     </nova:instance>
Aug 16 22:36:53 user nova-compute[72773]:   </metadata>
Aug 16 22:36:53 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:36:53 user nova-compute[72773]:     <system>
Aug 16 22:36:53 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:36:53 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:36:53 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:36:53 user nova-compute[72773]:       <entry name="serial">391a6006-4fe6-4398-a1e8-ae95b5edbf2b</entry>
Aug 16 22:36:53 user nova-compute[72773]:       <entry name="uuid">391a6006-4fe6-4398-a1e8-ae95b5edbf2b</entry>
Aug 16 22:36:53 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:36:53 user nova-compute[72773]:     </system>
Aug 16 22:36:53 user nova-compute[72773]:   </sysinfo>
Aug 16 22:36:53 user nova-compute[72773]:   <os>
Aug 16 22:36:53 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:36:53 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:36:53 user nova-compute[72773]:   </os>
Aug 16 22:36:53 user nova-compute[72773]:   <features>
Aug 16 22:36:53 user nova-compute[72773]:     <acpi/>
Aug 16 22:36:53 user nova-compute[72773]:     <apic/>
Aug 16 22:36:53 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:36:53 user nova-compute[72773]:   </features>
Aug 16 22:36:53 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:36:53 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:36:53 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:36:53 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:36:53 user nova-compute[72773]:   </clock>
Aug 16 22:36:53 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:36:53 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:36:53 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:36:53 user nova-compute[72773]:   </cpu>
Aug 16 22:36:53 user nova-compute[72773]:   <devices>
Aug 16 22:36:53 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:36:53 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:36:53 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk.rescue"/>
Aug 16 22:36:53 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:36:53 user nova-compute[72773]:     </disk>
Aug 16 22:36:53 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:36:53 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:36:53 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk"/>
Aug 16 22:36:53 user nova-compute[72773]:       <target dev="vdb" bus="virtio"/>
Aug 16 22:36:53 user nova-compute[72773]:     </disk>
Aug 16 22:36:53 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:36:53 user nova-compute[72773]:       <mac address="fa:16:3e:2d:58:d4"/>
Aug 16 22:36:53 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:36:53 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:36:53 user nova-compute[72773]:       <target dev="tap6961298d-d6"/>
Aug 16 22:36:53 user nova-compute[72773]:     </interface>
Aug 16 22:36:53 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:36:53 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/console.log" append="off"/>
Aug 16 22:36:53 user nova-compute[72773]:     </serial>
Aug 16 22:36:53 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:36:53 user nova-compute[72773]:     <video>
Aug 16 22:36:53 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:36:53 user nova-compute[72773]:     </video>
Aug 16 22:36:53 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:36:53 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:36:53 user nova-compute[72773]:     </rng>
Aug 16 22:36:53 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:36:53 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:36:53 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:36:53 user nova-compute[72773]:     </memballoon>
Aug 16 22:36:53 user nova-compute[72773]:   </devices>
Aug 16 22:36:53 user nova-compute[72773]: </domain>
Aug 16 22:36:53 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:36:53 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Instance destroyed successfully.
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:36:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] No VIF found with MAC fa:16:3e:2d:58:d4, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:36:54 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:36:54 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:36:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-030d076d-5099-4236-ae31-6025017eb51e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:36:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-030d076d-5099-4236-ae31-6025017eb51e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:36:54 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 22:36:54 user nova-compute[72773]: DEBUG nova.compute.manager [req-79b8ba2b-a8bb-453d-ad3e-388fafcfb4ff req-622acd18-b385-4cf1-908a-f6be82e8e7d6 service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Received event network-vif-plugged-6961298d-d62e-4f7b-b97e-4198a325816c {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:36:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-79b8ba2b-a8bb-453d-ad3e-388fafcfb4ff req-622acd18-b385-4cf1-908a-f6be82e8e7d6 service nova] Acquiring lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:36:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-79b8ba2b-a8bb-453d-ad3e-388fafcfb4ff req-622acd18-b385-4cf1-908a-f6be82e8e7d6 service nova] Lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:36:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-79b8ba2b-a8bb-453d-ad3e-388fafcfb4ff req-622acd18-b385-4cf1-908a-f6be82e8e7d6 service nova] Lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:36:54 user nova-compute[72773]: DEBUG nova.compute.manager [req-79b8ba2b-a8bb-453d-ad3e-388fafcfb4ff req-622acd18-b385-4cf1-908a-f6be82e8e7d6 service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] No waiting events found dispatching network-vif-plugged-6961298d-d62e-4f7b-b97e-4198a325816c {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:36:54 user nova-compute[72773]: WARNING nova.compute.manager [req-79b8ba2b-a8bb-453d-ad3e-388fafcfb4ff req-622acd18-b385-4cf1-908a-f6be82e8e7d6 service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Received unexpected event network-vif-plugged-6961298d-d62e-4f7b-b97e-4198a325816c for instance with vm_state active and task_state rescuing.
Aug 16 22:36:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Updating instance_info_cache with network_info: [{"id": "bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c", "address": "fa:16:3e:27:b6:2b", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc3b07d-2b", "ovs_interfaceid": "bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-030d076d-5099-4236-ae31-6025017eb51e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Acquiring lock "23894101-2fd3-41a4-83a3-8f6869d24d97" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG nova.objects.instance [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lazy-loading 'flavor' on Instance uuid 23894101-2fd3-41a4-83a3-8f6869d24d97 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Acquiring lock "23894101-2fd3-41a4-83a3-8f6869d24d97" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:36:55 user nova-compute[72773]: INFO nova.compute.manager [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Attaching volume 9c2e61c3-7e0d-4dec-84b6-038a4b3b175d to /dev/vdb
Aug 16 22:36:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG os_brick.utils [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90f78af-1448-4180-8d35-a6b932261ad5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbbd9f8-f35c-4df1-9b01-65fbc6541c52]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04bd68c-d6e1-485f-9264-3d840a577b26]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0933642-2a26-4bcc-91d5-2fca8c897cb2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:36:55 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:36:55 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ce7ef9-9166-4068-b9d7-3ceb3b255fab]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG os_brick.utils [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:36:55 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Updating existing volume attachment record: e5cc2365-1a7d-4fad-8159-b72e45615d22 {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:36:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:56 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:36:56 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:36:56 user nova-compute[72773]: DEBUG nova.compute.manager [req-33433597-f0eb-47ac-8269-afb68a4dd8e0 req-5e0cb9d2-7867-47a6-a90c-91b22a3ebe52 service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Received event network-vif-plugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:36:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-33433597-f0eb-47ac-8269-afb68a4dd8e0 req-5e0cb9d2-7867-47a6-a90c-91b22a3ebe52 service nova] Acquiring lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:36:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-33433597-f0eb-47ac-8269-afb68a4dd8e0 req-5e0cb9d2-7867-47a6-a90c-91b22a3ebe52 service nova] Lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:36:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-33433597-f0eb-47ac-8269-afb68a4dd8e0 req-5e0cb9d2-7867-47a6-a90c-91b22a3ebe52 service nova] Lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:36:56 user nova-compute[72773]: DEBUG nova.compute.manager [req-33433597-f0eb-47ac-8269-afb68a4dd8e0 req-5e0cb9d2-7867-47a6-a90c-91b22a3ebe52 service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] No waiting events found dispatching network-vif-plugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:36:56 user nova-compute[72773]: WARNING nova.compute.manager [req-33433597-f0eb-47ac-8269-afb68a4dd8e0 req-5e0cb9d2-7867-47a6-a90c-91b22a3ebe52 service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Received unexpected event network-vif-plugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e for instance with vm_state building and task_state spawning.
Aug 16 22:36:57 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:36:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:36:58 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225418.5706086, 2c59217c-22f8-4745-b05e-53300ca454f2 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:36:58 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] VM Resumed (Lifecycle Event)
Aug 16 22:36:58 user nova-compute[72773]: DEBUG nova.compute.manager [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:36:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:36:58 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Instance spawned successfully.
Aug 16 22:36:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:36:58 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:36:58 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:36:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:36:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:36:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:36:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:36:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:36:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:36:58 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:36:58 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225418.57239, 2c59217c-22f8-4745-b05e-53300ca454f2 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:36:58 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] VM Started (Lifecycle Event)
Aug 16 22:36:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-56ba2ce0-a649-4dc4-90a7-e2805618047c req-66922543-5629-4ec1-b0e1-ce83552ad7ae service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Received event network-vif-plugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:36:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-56ba2ce0-a649-4dc4-90a7-e2805618047c req-66922543-5629-4ec1-b0e1-ce83552ad7ae service nova] Acquiring lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:36:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-56ba2ce0-a649-4dc4-90a7-e2805618047c req-66922543-5629-4ec1-b0e1-ce83552ad7ae service nova] Lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:36:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-56ba2ce0-a649-4dc4-90a7-e2805618047c req-66922543-5629-4ec1-b0e1-ce83552ad7ae service nova] Lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:36:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-56ba2ce0-a649-4dc4-90a7-e2805618047c req-66922543-5629-4ec1-b0e1-ce83552ad7ae service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] No waiting events found dispatching network-vif-plugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:36:58 user nova-compute[72773]: WARNING nova.compute.manager [req-56ba2ce0-a649-4dc4-90a7-e2805618047c req-66922543-5629-4ec1-b0e1-ce83552ad7ae service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Received unexpected event network-vif-plugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e for instance with vm_state building and task_state spawning.
Aug 16 22:36:58 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a55857d8-8420-46bf-8909-a7745d4c7691 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:36:58 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:36:58 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:36:58 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:36:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Removed pending event for 391a6006-4fe6-4398-a1e8-ae95b5edbf2b due to event {{(pid=72773) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 22:36:58 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225418.619259, 391a6006-4fe6-4398-a1e8-ae95b5edbf2b => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:36:58 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] VM Resumed (Lifecycle Event)
Aug 16 22:36:58 user nova-compute[72773]: INFO nova.compute.manager [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Took 7.05 seconds to spawn the instance on the hypervisor.
Aug 16 22:36:58 user nova-compute[72773]: DEBUG nova.compute.manager [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:36:58 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:36:58 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:36:58 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225418.6228516, 391a6006-4fe6-4398-a1e8-ae95b5edbf2b => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:36:58 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] VM Started (Lifecycle Event)
Aug 16 22:36:58 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:36:58 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:36:58 user nova-compute[72773]: INFO nova.compute.manager [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Took 30.60 seconds to build instance.
Aug 16 22:36:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6d5964e1-ff54-4476-8861-5d5f3f22d4c5 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "2c59217c-22f8-4745-b05e-53300ca454f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.723s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:37:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:00 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:37:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:37:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:37:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:37:00 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:37:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:00 user nova-compute[72773]: DEBUG nova.compute.manager [req-f90b803f-97f8-4ab0-9cda-b0f31b5e33a0 req-e10cda0c-47e1-493a-80a1-6192ccb09ddf service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Received event network-vif-plugged-6961298d-d62e-4f7b-b97e-4198a325816c {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:37:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f90b803f-97f8-4ab0-9cda-b0f31b5e33a0 req-e10cda0c-47e1-493a-80a1-6192ccb09ddf service nova] Acquiring lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:37:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f90b803f-97f8-4ab0-9cda-b0f31b5e33a0 req-e10cda0c-47e1-493a-80a1-6192ccb09ddf service nova] Lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:37:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f90b803f-97f8-4ab0-9cda-b0f31b5e33a0 req-e10cda0c-47e1-493a-80a1-6192ccb09ddf service nova] Lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:37:00 user nova-compute[72773]: DEBUG nova.compute.manager [req-f90b803f-97f8-4ab0-9cda-b0f31b5e33a0 req-e10cda0c-47e1-493a-80a1-6192ccb09ddf service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] No waiting events found dispatching network-vif-plugged-6961298d-d62e-4f7b-b97e-4198a325816c {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:37:00 user nova-compute[72773]: WARNING nova.compute.manager [req-f90b803f-97f8-4ab0-9cda-b0f31b5e33a0 req-e10cda0c-47e1-493a-80a1-6192ccb09ddf service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Received unexpected event network-vif-plugged-6961298d-d62e-4f7b-b97e-4198a325816c for instance with vm_state rescued and task_state None.
Aug 16 22:37:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:01 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:37:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:37:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:37:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:02 user nova-compute[72773]: DEBUG nova.compute.manager [req-3f8a2df3-556d-41cc-a1c4-f2b21f04f1da req-ca3a112a-2640-46d8-bcc6-e3f1325a8c03 service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Received event network-vif-plugged-6961298d-d62e-4f7b-b97e-4198a325816c {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:37:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3f8a2df3-556d-41cc-a1c4-f2b21f04f1da req-ca3a112a-2640-46d8-bcc6-e3f1325a8c03 service nova] Acquiring lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:37:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3f8a2df3-556d-41cc-a1c4-f2b21f04f1da req-ca3a112a-2640-46d8-bcc6-e3f1325a8c03 service nova] Lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:37:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3f8a2df3-556d-41cc-a1c4-f2b21f04f1da req-ca3a112a-2640-46d8-bcc6-e3f1325a8c03 service nova] Lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:37:02 user nova-compute[72773]: DEBUG nova.compute.manager [req-3f8a2df3-556d-41cc-a1c4-f2b21f04f1da req-ca3a112a-2640-46d8-bcc6-e3f1325a8c03 service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] No waiting events found dispatching network-vif-plugged-6961298d-d62e-4f7b-b97e-4198a325816c {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:37:02 user nova-compute[72773]: WARNING nova.compute.manager [req-3f8a2df3-556d-41cc-a1c4-f2b21f04f1da req-ca3a112a-2640-46d8-bcc6-e3f1325a8c03 service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Received unexpected event network-vif-plugged-6961298d-d62e-4f7b-b97e-4198a325816c for instance with vm_state rescued and task_state None.
Aug 16 22:37:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk.rescue --force-share --output=json" returned: 0 in 0.225s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk.rescue --force-share --output=json" returned: 0 in 0.253s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0f7d89-62d2-44cb-9dfc-f4e8d9285394/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0f7d89-62d2-44cb-9dfc-f4e8d9285394/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0f7d89-62d2-44cb-9dfc-f4e8d9285394/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0f7d89-62d2-44cb-9dfc-f4e8d9285394/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a246c1-b2a7-4048-a6c9-235c15079d39/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a246c1-b2a7-4048-a6c9-235c15079d39/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a246c1-b2a7-4048-a6c9-235c15079d39/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a246c1-b2a7-4048-a6c9-235c15079d39/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:07 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:37:07 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:37:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=7300MB free_disk=25.24050521850586GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:37:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:37:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:37:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 956d334e-f190-4625-b144-ab44d2f3321a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:37:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 030d076d-5099-4236-ae31-6025017eb51e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:37:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 9ea2a759-7a26-4ad6-9902-b8b75931b5f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:37:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance ac2b49e4-59bc-46cd-b7d9-67aa68296e4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:37:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 391a6006-4fe6-4398-a1e8-ae95b5edbf2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:37:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance cf01c401-c424-4b3e-aa5b-439d62b1ae4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:37:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 23894101-2fd3-41a4-83a3-8f6869d24d97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:37:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 5ebcd117-6765-44eb-871b-226afd58e4e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:37:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance f4210738-d01e-4408-a15c-aeccada6dd23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:37:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:37:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 63644e8f-95d4-43a7-a824-8845dd073423 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:37:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 16a246c1-b2a7-4048-a6c9-235c15079d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:37:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 2c59217c-22f8-4745-b05e-53300ca454f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:37:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:37:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:37:08 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:37:08 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:37:08 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:37:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.723s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:37:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:12 user nova-compute[72773]: DEBUG nova.compute.manager [req-3579fa0f-e28d-4d05-bab9-1fd44c923979 req-566c9160-4564-4a66-8b94-4acbde00acb6 service nova] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Received event network-changed-41910b89-24df-459d-8f24-0a012a999f1a {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:37:12 user nova-compute[72773]: DEBUG nova.compute.manager [req-3579fa0f-e28d-4d05-bab9-1fd44c923979 req-566c9160-4564-4a66-8b94-4acbde00acb6 service nova] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Refreshing instance network info cache due to event network-changed-41910b89-24df-459d-8f24-0a012a999f1a. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:37:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3579fa0f-e28d-4d05-bab9-1fd44c923979 req-566c9160-4564-4a66-8b94-4acbde00acb6 service nova] Acquiring lock "refresh_cache-6f0f7d89-62d2-44cb-9dfc-f4e8d9285394" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:37:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3579fa0f-e28d-4d05-bab9-1fd44c923979 req-566c9160-4564-4a66-8b94-4acbde00acb6 service nova] Acquired lock "refresh_cache-6f0f7d89-62d2-44cb-9dfc-f4e8d9285394" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:37:12 user nova-compute[72773]: DEBUG nova.network.neutron [req-3579fa0f-e28d-4d05-bab9-1fd44c923979 req-566c9160-4564-4a66-8b94-4acbde00acb6 service nova] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Refreshing network info cache for port 41910b89-24df-459d-8f24-0a012a999f1a {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:37:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Acquiring lock "6f0f7d89-62d2-44cb-9dfc-f4e8d9285394" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:37:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "6f0f7d89-62d2-44cb-9dfc-f4e8d9285394" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:37:12 user nova-compute[72773]: DEBUG nova.objects.instance [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lazy-loading 'flavor' on Instance uuid 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:37:12 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Ignoring supplied device name: /dev/vdb
Aug 16 22:37:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "6f0f7d89-62d2-44cb-9dfc-f4e8d9285394" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG nova.network.neutron [req-3579fa0f-e28d-4d05-bab9-1fd44c923979 req-566c9160-4564-4a66-8b94-4acbde00acb6 service nova] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Updated VIF entry in instance network info cache for port 41910b89-24df-459d-8f24-0a012a999f1a. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG nova.network.neutron [req-3579fa0f-e28d-4d05-bab9-1fd44c923979 req-566c9160-4564-4a66-8b94-4acbde00acb6 service nova] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Updating instance_info_cache with network_info: [{"id": "41910b89-24df-459d-8f24-0a012a999f1a", "address": "fa:16:3e:cd:8e:28", "network": {"id": "6194759c-ac83-4c8f-8604-c30c22e3ce5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-161254247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b8417e50ee41e89fedf55e7134fecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41910b89-24", "ovs_interfaceid": "41910b89-24df-459d-8f24-0a012a999f1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3579fa0f-e28d-4d05-bab9-1fd44c923979 req-566c9160-4564-4a66-8b94-4acbde00acb6 service nova] Releasing lock "refresh_cache-6f0f7d89-62d2-44cb-9dfc-f4e8d9285394" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Acquiring lock "6f0f7d89-62d2-44cb-9dfc-f4e8d9285394" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "6f0f7d89-62d2-44cb-9dfc-f4e8d9285394" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:37:13 user nova-compute[72773]: INFO nova.compute.manager [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Attaching volume 5fd15e45-e158-4324-b7ab-49d893d1f8e7 to /dev/vdb
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yDKPldmU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:37:13 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:37:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:37:13 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:37:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:37:13 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf06494-f101-46bf-8390-ec45dc3d1533]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:37:13 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[711607ba-512c-4962-81e1-aa6e960a874c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d] added
Aug 16 22:37:13 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG os_brick.utils [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af7afc0-bcc5-46fa-accc-b1bda4b265d9]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd73bf1-acea-4b08-9c7a-6017e91bd9e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1be84af-688b-473b-a6b8-d8462bc820fa]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yDKPldmU {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f60e2da-87aa-4988-980b-fcc28c51850b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yDKPldmU" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f3eeec-8e30-42b0-9c3a-635ee9d53eef]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yDKPldmU'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4610738e-3f71-499f-8906-acc6888148ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f053e0c5-fed2-4fe0-9740-cae2833ed6e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85f40b9-bab4-4179-a456-8520029e7f7c]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:37:13 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b810bbf-7339-4d4c-9833-9af8abded81c]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG os_brick.utils [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Updating existing volume attachment record: e93770d3-6d81-4252-b2b3-f2efc1a567d7 {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e34bd7-1e47-4c27-b0f6-acb972e4a168]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:37:13 user nova-compute[72773]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)
Aug 16 22:37:13 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:37:13 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:37:13 user nova-compute[72773]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)
Aug 16 22:37:13 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:37:13 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7aff38-59ca-4d2d-a19d-7740d83c0311]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d, portal: 172.16.0.220,3260]
Aug 16 22:37:13 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d, portal: 172.16.0.220,3260] successful.
Aug 16 22:37:13 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[253726ec-0310-408c-8131-81af159acb36]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[752cc5d9-a3a9-41f2-ae2b-cd07aa2a765b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:37:13 user nova-compute[72773]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)
Aug 16 22:37:13 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:37:13 user nova-compute[72773]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:37:13 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:37:13 user nova-compute[72773]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)
Aug 16 22:37:13 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:37:13 user nova-compute[72773]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:37:13 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90ff604-9972-4c38-bac3-d25ac6ae4770]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:37:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yDKPldmU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:37:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:37:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '26335666134656639', 'path': '/dev/sde'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:37:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335666134656639', 'path': '/dev/sde'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:37:14 user nova-compute[72773]: DEBUG nova.objects.instance [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lazy-loading 'flavor' on Instance uuid 23894101-2fd3-41a4-83a3-8f6869d24d97 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:37:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 22:37:14 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:37:14 user nova-compute[72773]:   <source dev="/dev/sde"/>
Aug 16 22:37:14 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:37:14 user nova-compute[72773]:   <serial>9c2e61c3-7e0d-4dec-84b6-038a4b3b175d</serial>
Aug 16 22:37:14 user nova-compute[72773]: </disk>
Aug 16 22:37:14 user nova-compute[72773]:  {{(pid=72773) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 22:37:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:37:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:37:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] No VIF found with MAC fa:16:3e:98:fa:bf, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:37:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d59805b2-a5bc-40d1-ab80-9ec8f73035af tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.689s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:37:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Acquiring lock "7cf275ce-0647-43af-ad03-24cbac934b59" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:37:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lock "7cf275ce-0647-43af-ad03-24cbac934b59" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:37:17 user nova-compute[72773]: DEBUG nova.compute.manager [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:37:17 user nova-compute[72773]: DEBUG nova.compute.manager [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Stashing vm_state: active {{(pid=72773) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 16 22:37:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:37:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:37:18 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:37:18 user nova-compute[72773]: INFO nova.compute.claims [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Claim successful on node user
Aug 16 22:37:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:37:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:18 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:37:18 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:37:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.498s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:37:18 user nova-compute[72773]: DEBUG nova.compute.manager [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:37:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.492s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:37:18 user nova-compute[72773]: DEBUG nova.objects.instance [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lazy-loading 'pci_requests' on Instance uuid 23894101-2fd3-41a4-83a3-8f6869d24d97 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:37:18 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:37:18 user nova-compute[72773]: INFO nova.compute.claims [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Claim successful on node user
Aug 16 22:37:18 user nova-compute[72773]: DEBUG nova.objects.instance [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lazy-loading 'resources' on Instance uuid 23894101-2fd3-41a4-83a3-8f6869d24d97 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:37:18 user nova-compute[72773]: DEBUG nova.compute.manager [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:37:18 user nova-compute[72773]: DEBUG nova.network.neutron [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:37:18 user nova-compute[72773]: DEBUG nova.objects.instance [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lazy-loading 'pci_devices' on Instance uuid 23894101-2fd3-41a4-83a3-8f6869d24d97 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:37:18 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:37:18 user nova-compute[72773]: DEBUG nova.compute.manager [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:37:18 user nova-compute[72773]: INFO nova.compute.resource_tracker [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Updating resource usage from migration 1b92ace4-bf05-425a-9f60-0add43adbfcd
Aug 16 22:37:18 user nova-compute[72773]: INFO nova.virt.block_device [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Booting with volume c203a677-77d4-45aa-a91d-f69ed23c7dca at /dev/vda
Aug 16 22:37:18 user nova-compute[72773]: DEBUG nova.policy [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6e5f5ea155144f91886018bc0057e13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '128365b541d848b4a369bdb73a357786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:37:18 user nova-compute[72773]: DEBUG os_brick.utils [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:37:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:18 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[17889979-66ae-4337-96e5-10a90cba267f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:18 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7aeb2d3-4638-4f0d-8c6c-039f6d974a58]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:18 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c79e63-615b-4771-82f5-0408b11460fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:18 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c17c60-9366-421c-8852-73a156ef22aa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:37:18 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:37:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:37:18 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:37:18 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55d0678-2f81-4dc7-9330-267de0cd9003]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:18 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:37:18 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:37:18 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:37:18 user nova-compute[72773]: DEBUG os_brick.utils [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:37:18 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Updating existing volume attachment record: 0b53a7b1-9aba-43a5-ae73-371b186877e9 {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:37:19 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:37:19 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:37:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.622s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:37:19 user nova-compute[72773]: INFO nova.compute.manager [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Migrating
Aug 16 22:37:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:37:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:37:19 user nova-compute[72773]: INFO nova.compute.rpcapi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 16 22:37:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:37:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Acquiring lock "refresh_cache-23894101-2fd3-41a4-83a3-8f6869d24d97" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:37:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Acquired lock "refresh_cache-23894101-2fd3-41a4-83a3-8f6869d24d97" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:37:19 user nova-compute[72773]: DEBUG nova.network.neutron [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:37:19 user nova-compute[72773]: DEBUG nova.network.neutron [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Successfully created port: ef9aad5b-2373-47b5-910b-8664d08e5df5 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:37:19 user nova-compute[72773]: DEBUG nova.network.neutron [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Updating instance_info_cache with network_info: [{"id": "5725a1df-f51f-4ba4-99f7-777975663b2e", "address": "fa:16:3e:98:fa:bf", "network": {"id": "00744c2a-d566-47bc-abeb-8e9bc9ab312d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-384143120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cafc1d829ed749c2bfe35f7bc58e331c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5725a1df-f5", "ovs_interfaceid": "5725a1df-f51f-4ba4-99f7-777975663b2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:37:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Releasing lock "refresh_cache-23894101-2fd3-41a4-83a3-8f6869d24d97" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:37:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Starting migrate_disk_and_power_off {{(pid=72773) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-b96a957e-7472-40b7-ab51-c9ea720dcbda req-a4015495-c092-4dd0-ba78-574f97a73215 service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Received event network-vif-unplugged-5725a1df-f51f-4ba4-99f7-777975663b2e {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b96a957e-7472-40b7-ab51-c9ea720dcbda req-a4015495-c092-4dd0-ba78-574f97a73215 service nova] Acquiring lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b96a957e-7472-40b7-ab51-c9ea720dcbda req-a4015495-c092-4dd0-ba78-574f97a73215 service nova] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b96a957e-7472-40b7-ab51-c9ea720dcbda req-a4015495-c092-4dd0-ba78-574f97a73215 service nova] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-b96a957e-7472-40b7-ab51-c9ea720dcbda req-a4015495-c092-4dd0-ba78-574f97a73215 service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] No waiting events found dispatching network-vif-unplugged-5725a1df-f51f-4ba4-99f7-777975663b2e {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:37:20 user nova-compute[72773]: WARNING nova.compute.manager [req-b96a957e-7472-40b7-ab51-c9ea720dcbda req-a4015495-c092-4dd0-ba78-574f97a73215 service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Received unexpected event network-vif-unplugged-5725a1df-f51f-4ba4-99f7-777975663b2e for instance with vm_state active and task_state resize_migrating.
Aug 16 22:37:20 user nova-compute[72773]: DEBUG nova.network.neutron [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Successfully updated port: ef9aad5b-2373-47b5-910b-8664d08e5df5 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Acquiring lock "refresh_cache-7cf275ce-0647-43af-ad03-24cbac934b59" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Acquired lock "refresh_cache-7cf275ce-0647-43af-ad03-24cbac934b59" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG nova.network.neutron [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-823c7b54-702d-4e47-baf5-5685179ea1f6 req-55aa83b1-8135-482c-8ba4-c93f347669e0 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Received event network-changed-ef9aad5b-2373-47b5-910b-8664d08e5df5 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-823c7b54-702d-4e47-baf5-5685179ea1f6 req-55aa83b1-8135-482c-8ba4-c93f347669e0 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Refreshing instance network info cache due to event network-changed-ef9aad5b-2373-47b5-910b-8664d08e5df5. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-823c7b54-702d-4e47-baf5-5685179ea1f6 req-55aa83b1-8135-482c-8ba4-c93f347669e0 service nova] Acquiring lock "refresh_cache-7cf275ce-0647-43af-ad03-24cbac934b59" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG nova.network.neutron [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:37:20 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Instance destroyed successfully.
Aug 16 22:37:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:33:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2107689448',display_name='tempest-ServerActionsTestOtherB-server-2107689448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2107689448',id=26,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh1GymZbw24IcnH5dONTb6loGV9Z6Plyeb2rJeaUseM4wpzMr4OTPGkSKihakM6H3XgBNMxcd+thJYbV9RDvja0dJb4k7n+wBitov4O9EMqeBt9unfmT2aB8P/P3aCmCA==',key_name='tempest-keypair-1176159006',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:33:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cafc1d829ed749c2bfe35f7bc58e331c',ramdisk_id='',reservation_id='r-sdzz0nnk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1140735028',owner_user_name='tempest-ServerActionsTestOtherB-1140735028-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:37:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cdb4ae56354496ab9e3f71461bd9d6d',uuid=23894101-2fd3-41a4-83a3-8f6869d24d97,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5725a1df-f51f-4ba4-99f7-777975663b2e", "address": "fa:16:3e:98:fa:bf", "network": {"id": "00744c2a-d566-47bc-abeb-8e9bc9ab312d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-384143120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-384143120-network", "vif_mac": "fa:16:3e:98:fa:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cafc1d829ed749c2bfe35f7bc58e331c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5725a1df-f5", "ovs_interfaceid": "5725a1df-f51f-4ba4-99f7-777975663b2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Converting VIF {"id": "5725a1df-f51f-4ba4-99f7-777975663b2e", "address": "fa:16:3e:98:fa:bf", "network": {"id": "00744c2a-d566-47bc-abeb-8e9bc9ab312d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-384143120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-384143120-network", "vif_mac": "fa:16:3e:98:fa:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cafc1d829ed749c2bfe35f7bc58e331c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5725a1df-f5", "ovs_interfaceid": "5725a1df-f51f-4ba4-99f7-777975663b2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:fa:bf,bridge_name='br-int',has_traffic_filtering=True,id=5725a1df-f51f-4ba4-99f7-777975663b2e,network=Network(00744c2a-d566-47bc-abeb-8e9bc9ab312d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5725a1df-f5') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG os_vif [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:fa:bf,bridge_name='br-int',has_traffic_filtering=True,id=5725a1df-f51f-4ba4-99f7-777975663b2e,network=Network(00744c2a-d566-47bc-abeb-8e9bc9ab312d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5725a1df-f5') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5725a1df-f5, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:37:20 user nova-compute[72773]: INFO os_vif [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:fa:bf,bridge_name='br-int',has_traffic_filtering=True,id=5725a1df-f51f-4ba4-99f7-777975663b2e,network=Network(00744c2a-d566-47bc-abeb-8e9bc9ab312d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5725a1df-f5')
Aug 16 22:37:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yDKPldmU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:37:20 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:37:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23d7701-475e-46b8-87bb-33bbc5865769]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG nova.network.neutron [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Updating instance_info_cache with network_info: [{"id": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "address": "fa:16:3e:11:03:33", "network": {"id": "09f1ea90-9baf-4dc6-965e-30b89fa0557d", "bridge": "br-int", "label": "tempest-TestShelveInstance-375734384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "128365b541d848b4a369bdb73a357786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9aad5b-23", "ovs_interfaceid": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb0ef44-3e0c-4cfd-a2b8-585e26e0b6ea]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:37:20 user nova-compute[72773]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)
Aug 16 22:37:20 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:37:20 user nova-compute[72773]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:37:20 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:37:20 user nova-compute[72773]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)
Aug 16 22:37:20 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:37:20 user nova-compute[72773]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:37:20 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef80409cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d'): ({'sde'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Removing single pathed devices sde {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Releasing lock "refresh_cache-7cf275ce-0647-43af-ad03-24cbac934b59" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG nova.compute.manager [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Instance network_info: |[{"id": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "address": "fa:16:3e:11:03:33", "network": {"id": "09f1ea90-9baf-4dc6-965e-30b89fa0557d", "bridge": "br-int", "label": "tempest-TestShelveInstance-375734384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "128365b541d848b4a369bdb73a357786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9aad5b-23", "ovs_interfaceid": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-823c7b54-702d-4e47-baf5-5685179ea1f6 req-55aa83b1-8135-482c-8ba4-c93f347669e0 service nova] Acquired lock "refresh_cache-7cf275ce-0647-43af-ad03-24cbac934b59" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG nova.network.neutron [req-823c7b54-702d-4e47-baf5-5685179ea1f6 req-55aa83b1-8135-482c-8ba4-c93f347669e0 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Refreshing network info cache for port ef9aad5b-2373-47b5-910b-8664d08e5df5 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cdefb2-5a4a-4231-bbf4-c48c195600fd]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bcd4c2-aa39-468a-bc27-d8ecd96a9974]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Flushing IO for device /dev/sde {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c69ca7-eec0-421a-9424-f2521a53e5a3]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d53d88-3197-46de-92e0-22ecfaaac9c1]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] SCSI volumes sde have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d55b23e-a0ca-47d1-96d3-5186041d4d62]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:37:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3aa783-4cde-4908-ba7b-5724e9ee07bb]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d, portal: 172.16.0.220,3260]
Aug 16 22:37:21 user nova-compute[72773]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d, portal: 172.16.0.220,3260] successful.
Aug 16 22:37:21 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:37:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[847c6668-e557-4c78-ac77-0432256fe865]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:37:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:37:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] <== disconnect_volume: return (291ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:37:21 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:37:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:21 user nova-compute[72773]: DEBUG nova.network.neutron [req-823c7b54-702d-4e47-baf5-5685179ea1f6 req-55aa83b1-8135-482c-8ba4-c93f347669e0 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Updated VIF entry in instance network info cache for port ef9aad5b-2373-47b5-910b-8664d08e5df5. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:37:21 user nova-compute[72773]: DEBUG nova.network.neutron [req-823c7b54-702d-4e47-baf5-5685179ea1f6 req-55aa83b1-8135-482c-8ba4-c93f347669e0 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Updating instance_info_cache with network_info: [{"id": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "address": "fa:16:3e:11:03:33", "network": {"id": "09f1ea90-9baf-4dc6-965e-30b89fa0557d", "bridge": "br-int", "label": "tempest-TestShelveInstance-375734384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "128365b541d848b4a369bdb73a357786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9aad5b-23", "ovs_interfaceid": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:37:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-823c7b54-702d-4e47-baf5-5685179ea1f6 req-55aa83b1-8135-482c-8ba4-c93f347669e0 service nova] Releasing lock "refresh_cache-7cf275ce-0647-43af-ad03-24cbac934b59" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:37:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:21 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:37:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97_resize/disk /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] CMD "cp -r /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97_resize/disk /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk" returned: 0 in 0.373s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97_resize/disk.info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk.info {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] CMD "cp -r /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97_resize/disk.info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk.info" returned: 0 in 0.034s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:22 user nova-compute[72773]: DEBUG nova.compute.manager [req-d0b7c72f-d8c0-450c-a6fe-20d502dcd6e6 req-8923d846-d16b-4d39-81f6-af0cc143349f service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Received event network-vif-plugged-5725a1df-f51f-4ba4-99f7-777975663b2e {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:37:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d0b7c72f-d8c0-450c-a6fe-20d502dcd6e6 req-8923d846-d16b-4d39-81f6-af0cc143349f service nova] Acquiring lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:37:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d0b7c72f-d8c0-450c-a6fe-20d502dcd6e6 req-8923d846-d16b-4d39-81f6-af0cc143349f service nova] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:37:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d0b7c72f-d8c0-450c-a6fe-20d502dcd6e6 req-8923d846-d16b-4d39-81f6-af0cc143349f service nova] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:37:22 user nova-compute[72773]: DEBUG nova.compute.manager [req-d0b7c72f-d8c0-450c-a6fe-20d502dcd6e6 req-8923d846-d16b-4d39-81f6-af0cc143349f service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] No waiting events found dispatching network-vif-plugged-5725a1df-f51f-4ba4-99f7-777975663b2e {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:37:22 user nova-compute[72773]: WARNING nova.compute.manager [req-d0b7c72f-d8c0-450c-a6fe-20d502dcd6e6 req-8923d846-d16b-4d39-81f6-af0cc143349f service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Received unexpected event network-vif-plugged-5725a1df-f51f-4ba4-99f7-777975663b2e for instance with vm_state active and task_state resize_migrating.
Aug 16 22:37:22 user nova-compute[72773]: DEBUG nova.network.neutron [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Port 5725a1df-f51f-4ba4-99f7-777975663b2e binding to destination host user is already ACTIVE {{(pid=72773) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 16 22:37:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Acquiring lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:37:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:37:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:37:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Acquiring lock "refresh_cache-23894101-2fd3-41a4-83a3-8f6869d24d97" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:37:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Acquired lock "refresh_cache-23894101-2fd3-41a4-83a3-8f6869d24d97" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:37:23 user nova-compute[72773]: DEBUG nova.network.neutron [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:37:23 user nova-compute[72773]: DEBUG nova.network.neutron [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Updating instance_info_cache with network_info: [{"id": "5725a1df-f51f-4ba4-99f7-777975663b2e", "address": "fa:16:3e:98:fa:bf", "network": {"id": "00744c2a-d566-47bc-abeb-8e9bc9ab312d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-384143120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cafc1d829ed749c2bfe35f7bc58e331c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5725a1df-f5", "ovs_interfaceid": "5725a1df-f51f-4ba4-99f7-777975663b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:37:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Releasing lock "refresh_cache-23894101-2fd3-41a4-83a3-8f6869d24d97" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:37:23 user nova-compute[72773]: DEBUG os_brick.utils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:37:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:23 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[83afbe0f-335c-4816-868f-a846218d1f92]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:23 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2223315-58c3-4652-8be4-2efb7cbc9848]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:23 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a538bc2e-870d-4ba9-8c41-c84d552ad800]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:23 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d17fc5-423a-42d3-8e79-65afd3e3d975]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:37:23 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:37:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:37:23 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:37:23 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a3d6e6-b39f-468b-bba3-5a9ca64d003d]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:23 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:37:23 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:37:23 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:37:23 user nova-compute[72773]: DEBUG os_brick.utils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:37:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wgJvjPec', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:37:27 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:37:27 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:37:27 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:37:27 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:37:27 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:37:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb477aa-a5c1-4f9c-9809-27c08e34b5e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:37:27 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdb621c-9b13-4471-b0b3-477e67dd6e57]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7] added
Aug 16 22:37:27 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a5ddd5-b34b-468b-aae0-0edf29ddf27d]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2eb2f74-8349-4670-aa72-e4b16b5cbf30]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wgJvjPec {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wgJvjPec" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b295ab1a-16d3-490d-a009-474fc01e02c7]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wgJvjPec'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[69126d0e-2ea7-4053-bfb4-f6838780b5ea]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b92948-70da-47ad-b065-41fffc06930f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:37:27 user nova-compute[72773]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)
Aug 16 22:37:27 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:37:27 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:37:27 user nova-compute[72773]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)
Aug 16 22:37:27 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:37:27 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[341441f6-47bf-48cb-a4b3-cd243c12345a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7, portal: 172.16.0.220,3260]
Aug 16 22:37:27 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7, portal: 172.16.0.220,3260] successful.
Aug 16 22:37:27 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[284b193d-ff4a-49a5-af0c-e5179695666d]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[842f93b3-9903-46e6-a4b8-6713dd3bd12a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:37:27 user nova-compute[72773]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)
Aug 16 22:37:27 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:37:27 user nova-compute[72773]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 (non-flash)
Aug 16 22:37:27 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:37:27 user nova-compute[72773]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)
Aug 16 22:37:27 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:37:27 user nova-compute[72773]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 (non-flash)
Aug 16 22:37:27 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd43e61-0a89-436f-ba41-cdbb07325cda]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:27 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: None {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:37:28 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:37:28 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wgJvjPec', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:37:28 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:37:28 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26230343732613433', 'path': '/dev/sde'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:37:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230343732613433', 'path': '/dev/sde'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:37:28 user nova-compute[72773]: DEBUG nova.objects.instance [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lazy-loading 'flavor' on Instance uuid 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:37:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 22:37:28 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:37:28 user nova-compute[72773]:   <source dev="/dev/sde"/>
Aug 16 22:37:28 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:37:28 user nova-compute[72773]:   <serial>5fd15e45-e158-4324-b7ab-49d893d1f8e7</serial>
Aug 16 22:37:28 user nova-compute[72773]: </disk>
Aug 16 22:37:28 user nova-compute[72773]:  {{(pid=72773) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 22:37:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:37:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:37:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] No VIF found with MAC fa:16:3e:cd:8e:28, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:37:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-0705bccc-a406-4ea4-a4cf-57a2ab63547d tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "6f0f7d89-62d2-44cb-9dfc-f4e8d9285394" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.979s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:37:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:30 user nova-compute[72773]: INFO nova.compute.manager [None req-1ba3a6f6-8d13-4004-b1fd-9e4f24e1123d tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Unrescuing
Aug 16 22:37:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1ba3a6f6-8d13-4004-b1fd-9e4f24e1123d tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Acquiring lock "refresh_cache-9ea2a759-7a26-4ad6-9902-b8b75931b5f0" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:37:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1ba3a6f6-8d13-4004-b1fd-9e4f24e1123d tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Acquired lock "refresh_cache-9ea2a759-7a26-4ad6-9902-b8b75931b5f0" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:37:30 user nova-compute[72773]: DEBUG nova.network.neutron [None req-1ba3a6f6-8d13-4004-b1fd-9e4f24e1123d tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:37:31 user nova-compute[72773]: DEBUG nova.network.neutron [None req-1ba3a6f6-8d13-4004-b1fd-9e4f24e1123d tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Updating instance_info_cache with network_info: [{"id": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "address": "fa:16:3e:e4:b7:3c", "network": {"id": "a18f2224-ffb0-4406-9c92-5dad954c3a2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1329143363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d68c72b1454d78934269042633293f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83003593-cf", "ovs_interfaceid": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:37:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1ba3a6f6-8d13-4004-b1fd-9e4f24e1123d tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Releasing lock "refresh_cache-9ea2a759-7a26-4ad6-9902-b8b75931b5f0" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:37:31 user nova-compute[72773]: DEBUG nova.objects.instance [None req-1ba3a6f6-8d13-4004-b1fd-9e4f24e1123d tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lazy-loading 'flavor' on Instance uuid 9ea2a759-7a26-4ad6-9902-b8b75931b5f0 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:37:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:32 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Instance destroyed successfully.
Aug 16 22:37:32 user nova-compute[72773]: DEBUG nova.compute.manager [req-a9d5e956-86fd-491d-b174-7b5ff668f03f req-2a501b0e-62c2-4905-8ae7-609d712ad434 service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received event network-vif-unplugged-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:37:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a9d5e956-86fd-491d-b174-7b5ff668f03f req-2a501b0e-62c2-4905-8ae7-609d712ad434 service nova] Acquiring lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:37:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a9d5e956-86fd-491d-b174-7b5ff668f03f req-2a501b0e-62c2-4905-8ae7-609d712ad434 service nova] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:37:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a9d5e956-86fd-491d-b174-7b5ff668f03f req-2a501b0e-62c2-4905-8ae7-609d712ad434 service nova] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:37:32 user nova-compute[72773]: DEBUG nova.compute.manager [req-a9d5e956-86fd-491d-b174-7b5ff668f03f req-2a501b0e-62c2-4905-8ae7-609d712ad434 service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] No waiting events found dispatching network-vif-unplugged-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:37:32 user nova-compute[72773]: WARNING nova.compute.manager [req-a9d5e956-86fd-491d-b174-7b5ff668f03f req-2a501b0e-62c2-4905-8ae7-609d712ad434 service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received unexpected event network-vif-unplugged-83003593-cfc0-44d3-94c6-4e3fb90573bd for instance with vm_state rescued and task_state unrescuing.
Aug 16 22:37:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:34 user nova-compute[72773]: DEBUG nova.compute.manager [req-6531ca0d-9cbb-4231-9218-821a62b4ae0a req-e104876c-97d8-453d-af58-8deceddcbe7f service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received event network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:37:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6531ca0d-9cbb-4231-9218-821a62b4ae0a req-e104876c-97d8-453d-af58-8deceddcbe7f service nova] Acquiring lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:37:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6531ca0d-9cbb-4231-9218-821a62b4ae0a req-e104876c-97d8-453d-af58-8deceddcbe7f service nova] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:37:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6531ca0d-9cbb-4231-9218-821a62b4ae0a req-e104876c-97d8-453d-af58-8deceddcbe7f service nova] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:37:34 user nova-compute[72773]: DEBUG nova.compute.manager [req-6531ca0d-9cbb-4231-9218-821a62b4ae0a req-e104876c-97d8-453d-af58-8deceddcbe7f service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] No waiting events found dispatching network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:37:34 user nova-compute[72773]: WARNING nova.compute.manager [req-6531ca0d-9cbb-4231-9218-821a62b4ae0a req-e104876c-97d8-453d-af58-8deceddcbe7f service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received unexpected event network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd for instance with vm_state rescued and task_state unrescuing.
Aug 16 22:37:34 user nova-compute[72773]: DEBUG nova.compute.manager [req-6531ca0d-9cbb-4231-9218-821a62b4ae0a req-e104876c-97d8-453d-af58-8deceddcbe7f service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received event network-changed-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:37:34 user nova-compute[72773]: DEBUG nova.compute.manager [req-6531ca0d-9cbb-4231-9218-821a62b4ae0a req-e104876c-97d8-453d-af58-8deceddcbe7f service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Refreshing instance network info cache due to event network-changed-83003593-cfc0-44d3-94c6-4e3fb90573bd. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:37:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6531ca0d-9cbb-4231-9218-821a62b4ae0a req-e104876c-97d8-453d-af58-8deceddcbe7f service nova] Acquiring lock "refresh_cache-9ea2a759-7a26-4ad6-9902-b8b75931b5f0" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:37:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6531ca0d-9cbb-4231-9218-821a62b4ae0a req-e104876c-97d8-453d-af58-8deceddcbe7f service nova] Acquired lock "refresh_cache-9ea2a759-7a26-4ad6-9902-b8b75931b5f0" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:37:34 user nova-compute[72773]: DEBUG nova.network.neutron [req-6531ca0d-9cbb-4231-9218-821a62b4ae0a req-e104876c-97d8-453d-af58-8deceddcbe7f service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Refreshing network info cache for port 83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:37:34 user nova-compute[72773]: DEBUG nova.network.neutron [req-6531ca0d-9cbb-4231-9218-821a62b4ae0a req-e104876c-97d8-453d-af58-8deceddcbe7f service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Updated VIF entry in instance network info cache for port 83003593-cfc0-44d3-94c6-4e3fb90573bd. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:37:34 user nova-compute[72773]: DEBUG nova.network.neutron [req-6531ca0d-9cbb-4231-9218-821a62b4ae0a req-e104876c-97d8-453d-af58-8deceddcbe7f service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Updating instance_info_cache with network_info: [{"id": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "address": "fa:16:3e:e4:b7:3c", "network": {"id": "a18f2224-ffb0-4406-9c92-5dad954c3a2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1329143363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d68c72b1454d78934269042633293f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83003593-cf", "ovs_interfaceid": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:37:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6531ca0d-9cbb-4231-9218-821a62b4ae0a req-e104876c-97d8-453d-af58-8deceddcbe7f service nova] Releasing lock "refresh_cache-9ea2a759-7a26-4ad6-9902-b8b75931b5f0" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:37:34 user nova-compute[72773]: DEBUG nova.compute.manager [req-6531ca0d-9cbb-4231-9218-821a62b4ae0a req-e104876c-97d8-453d-af58-8deceddcbe7f service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received event network-changed-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:37:34 user nova-compute[72773]: DEBUG nova.compute.manager [req-6531ca0d-9cbb-4231-9218-821a62b4ae0a req-e104876c-97d8-453d-af58-8deceddcbe7f service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Refreshing instance network info cache due to event network-changed-83003593-cfc0-44d3-94c6-4e3fb90573bd. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:37:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6531ca0d-9cbb-4231-9218-821a62b4ae0a req-e104876c-97d8-453d-af58-8deceddcbe7f service nova] Acquiring lock "refresh_cache-9ea2a759-7a26-4ad6-9902-b8b75931b5f0" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:37:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6531ca0d-9cbb-4231-9218-821a62b4ae0a req-e104876c-97d8-453d-af58-8deceddcbe7f service nova] Acquired lock "refresh_cache-9ea2a759-7a26-4ad6-9902-b8b75931b5f0" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:37:34 user nova-compute[72773]: DEBUG nova.network.neutron [req-6531ca0d-9cbb-4231-9218-821a62b4ae0a req-e104876c-97d8-453d-af58-8deceddcbe7f service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Refreshing network info cache for port 83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Starting finish_migration {{(pid=72773) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Instance directory exists: not creating {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 22:37:35 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Creating image(s)
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.objects.instance [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lazy-loading 'trusted_certs' on Instance uuid 23894101-2fd3-41a4-83a3-8f6869d24d97 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.network.neutron [req-6531ca0d-9cbb-4231-9218-821a62b4ae0a req-e104876c-97d8-453d-af58-8deceddcbe7f service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Updated VIF entry in instance network info cache for port 83003593-cfc0-44d3-94c6-4e3fb90573bd. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.network.neutron [req-6531ca0d-9cbb-4231-9218-821a62b4ae0a req-e104876c-97d8-453d-af58-8deceddcbe7f service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Updating instance_info_cache with network_info: [{"id": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "address": "fa:16:3e:e4:b7:3c", "network": {"id": "a18f2224-ffb0-4406-9c92-5dad954c3a2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1329143363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d68c72b1454d78934269042633293f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83003593-cf", "ovs_interfaceid": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6531ca0d-9cbb-4231-9218-821a62b4ae0a req-e104876c-97d8-453d-af58-8deceddcbe7f service nova] Releasing lock "refresh_cache-9ea2a759-7a26-4ad6-9902-b8b75931b5f0" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.compute.manager [req-6531ca0d-9cbb-4231-9218-821a62b4ae0a req-e104876c-97d8-453d-af58-8deceddcbe7f service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received event network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6531ca0d-9cbb-4231-9218-821a62b4ae0a req-e104876c-97d8-453d-af58-8deceddcbe7f service nova] Acquiring lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6531ca0d-9cbb-4231-9218-821a62b4ae0a req-e104876c-97d8-453d-af58-8deceddcbe7f service nova] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6531ca0d-9cbb-4231-9218-821a62b4ae0a req-e104876c-97d8-453d-af58-8deceddcbe7f service nova] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.compute.manager [req-6531ca0d-9cbb-4231-9218-821a62b4ae0a req-e104876c-97d8-453d-af58-8deceddcbe7f service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] No waiting events found dispatching network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:37:35 user nova-compute[72773]: WARNING nova.compute.manager [req-6531ca0d-9cbb-4231-9218-821a62b4ae0a req-e104876c-97d8-453d-af58-8deceddcbe7f service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received unexpected event network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd for instance with vm_state rescued and task_state unrescuing.
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.compute.manager [req-6531ca0d-9cbb-4231-9218-821a62b4ae0a req-e104876c-97d8-453d-af58-8deceddcbe7f service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received event network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6531ca0d-9cbb-4231-9218-821a62b4ae0a req-e104876c-97d8-453d-af58-8deceddcbe7f service nova] Acquiring lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6531ca0d-9cbb-4231-9218-821a62b4ae0a req-e104876c-97d8-453d-af58-8deceddcbe7f service nova] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6531ca0d-9cbb-4231-9218-821a62b4ae0a req-e104876c-97d8-453d-af58-8deceddcbe7f service nova] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.compute.manager [req-6531ca0d-9cbb-4231-9218-821a62b4ae0a req-e104876c-97d8-453d-af58-8deceddcbe7f service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] No waiting events found dispatching network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:37:35 user nova-compute[72773]: WARNING nova.compute.manager [req-6531ca0d-9cbb-4231-9218-821a62b4ae0a req-e104876c-97d8-453d-af58-8deceddcbe7f service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received unexpected event network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd for instance with vm_state rescued and task_state unrescuing.
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.compute.manager [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:37:35 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Creating image(s)
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Did not create local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Ensure instance console log exists: /opt/stack/data/nova/instances/7cf275ce-0647-43af-ad03-24cbac934b59/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Start _get_guest_xml network_info=[{"id": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "address": "fa:16:3e:11:03:33", "network": {"id": "09f1ea90-9baf-4dc6-965e-30b89fa0557d", "bridge": "br-int", "label": "tempest-TestShelveInstance-375734384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "128365b541d848b4a369bdb73a357786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9aad5b-23", "ovs_interfaceid": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '0b53a7b1-9aba-43a5-ae73-371b186877e9', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YszrhEio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7cf275ce-0647-43af-ad03-24cbac934b59', 'attached_at': '', 'detached_at': '', 'volume_id': 'c203a677-77d4-45aa-a91d-f69ed23c7dca', 'serial': 'c203a677-77d4-45aa-a91d-f69ed23c7dca'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:37:35 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:37:35 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.177s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Checking if we can resize image /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk. size=21474836480 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YszrhEio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:37:35 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:37:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:37:35 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:37:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:37:35 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bbdfaf-3f0a-4bd3-aa19-38bd5bf4c463]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:37:35 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692225440.71529, 23894101-2fd3-41a4-83a3-8f6869d24d97 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:37:35 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] VM Stopped (Lifecycle Event)
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27f628a-60fa-4446-af30-8651abb2ac32]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca] added
Aug 16 22:37:35 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.compute.manager [None req-b6813d61-3414-465a-b834-1678400006d0 None None] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.compute.manager [None req-b6813d61-3414-465a-b834-1678400006d0 None None] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[280c4bc6-77d8-448c-b6e4-19ecde30f017]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:35 user nova-compute[72773]: INFO nova.compute.manager [None req-b6813d61-3414-465a-b834-1678400006d0 None None] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk 21474836480 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef32487d-a38a-4c90-8241-846867a0b7ad]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YszrhEio {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk 21474836480" returned: 0 in 0.054s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YszrhEio" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[283603d4-716e-4530-a9aa-9cd90e8a43bb]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YszrhEio'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Did not create local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Ensure instance console log exists: /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Start _get_guest_xml network_info=[{"id": "5725a1df-f51f-4ba4-99f7-777975663b2e", "address": "fa:16:3e:98:fa:bf", "network": {"id": "00744c2a-d566-47bc-abeb-8e9bc9ab312d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-384143120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-384143120-network", "vif_mac": "fa:16:3e:98:fa:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cafc1d829ed749c2bfe35f7bc58e331c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5725a1df-f5", "ovs_interfaceid": "5725a1df-f51f-4ba4-99f7-777975663b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '122da793-937f-419d-a5b7-bbad36378af5', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yDKPldmU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '23894101-2fd3-41a4-83a3-8f6869d24d97', 'attached_at': '2023-08-16T22:37:35.000000', 'detached_at': '', 'volume_id': '9c2e61c3-7e0d-4dec-84b6-038a4b3b175d', 'serial': '9c2e61c3-7e0d-4dec-84b6-038a4b3b175d'}, 'mount_device': '/dev/vdb', 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Removed pending event for 9ea2a759-7a26-4ad6-9902-b8b75931b5f0 due to event {{(pid=72773) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225455.8600218, 9ea2a759-7a26-4ad6-9902-b8b75931b5f0 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:37:35 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] VM Resumed (Lifecycle Event)
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d39fdd-a288-4874-93e8-7f5853503b87]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.compute.manager [None req-1ba3a6f6-8d13-4004-b1fd-9e4f24e1123d tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:35 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:37:35 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:21:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.objects.instance [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lazy-loading 'vcpu_model' on Instance uuid 23894101-2fd3-41a4-83a3-8f6869d24d97 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a712fab2-c07f-4d14-a73a-ccd5e10ac269]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:37:35 user nova-compute[72773]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)
Aug 16 22:37:35 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:37:35 user nova-compute[72773]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 (non-flash)
Aug 16 22:37:35 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:37:35 user nova-compute[72773]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)
Aug 16 22:37:35 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:37:35 user nova-compute[72773]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 (non-flash)
Aug 16 22:37:35 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yDKPldmU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:37:35 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:37:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:37:35 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225455.862549, 9ea2a759-7a26-4ad6-9902-b8b75931b5f0 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:37:35 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] VM Started (Lifecycle Event)
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:37:35 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:37:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:36 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2bf1d3-3980-4d00-bc0f-d62d107d4693]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca, portal: 172.16.0.220,3260]
Aug 16 22:37:36 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca, portal: 172.16.0.220,3260] successful.
Aug 16 22:37:36 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:37:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:36 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5f4e06-695a-47c7-a056-e90cc8dfc8b5]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:37:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:36 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ea8ef1-02cb-4ddb-96d4-f9b009b160d9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:37:36 user nova-compute[72773]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)
Aug 16 22:37:36 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:37:36 user nova-compute[72773]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 (non-flash)
Aug 16 22:37:36 user nova-compute[72773]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)
Aug 16 22:37:36 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:37:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:37:36 user nova-compute[72773]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)
Aug 16 22:37:36 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:37:36 user nova-compute[72773]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 (non-flash)
Aug 16 22:37:36 user nova-compute[72773]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)
Aug 16 22:37:36 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:37:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:37:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:37:36 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] HCTL ('37', '-', '-', 0) found on session 32 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:37:36 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:37:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:36 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce49473-3f04-4fc1-9b73-5cbd90ca9697]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:36 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: None {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YszrhEio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23033396563376432', 'path': '/dev/sdf'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033396563376432', 'path': '/dev/sdf'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.128s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:37:37 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:37:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:37:37 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:37:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[47923aef-1ffe-45eb-b945-c28b9283a9b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:37:37 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:37:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1525734974',display_name='tempest-TestShelveInstance-server-1525734974',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1525734974',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXQBASS0jXrxI3OGcv7vu4DdfXzpmoqsRvSbmQ6vxACy0aQ5iheigPnMtUaevvjo5jGI3reLnnhACND3PPyJAWWWf8sEZP9M76YWibt3G9R/QtnNRpsjmPAUnUPnW3dlQ==',key_name='tempest-TestShelveInstance-631846690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='128365b541d848b4a369bdb73a357786',ramdisk_id='',reservation_id='r-ppxqqatm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1515246832',owner_user_name='tempest-TestShelveInstance-1515246832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:37:19Z,user_data=None,user_id='6e5f5ea155144f91886018bc0057e13b',uuid=7cf275ce-0647-43af-ad03-24cbac934b59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "address": "fa:16:3e:11:03:33", "network": {"id": "09f1ea90-9baf-4dc6-965e-30b89fa0557d", "bridge": "br-int", "label": "tempest-TestShelveInstance-375734384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "128365b541d848b4a369bdb73a357786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9aad5b-23", "ovs_interfaceid": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Converting VIF {"id": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "address": "fa:16:3e:11:03:33", "network": {"id": "09f1ea90-9baf-4dc6-965e-30b89fa0557d", "bridge": "br-int", "label": "tempest-TestShelveInstance-375734384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "128365b541d848b4a369bdb73a357786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9aad5b-23", "ovs_interfaceid": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:03:33,bridge_name='br-int',has_traffic_filtering=True,id=ef9aad5b-2373-47b5-910b-8664d08e5df5,network=Network(09f1ea90-9baf-4dc6-965e-30b89fa0557d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef9aad5b-23') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG nova.objects.instance [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lazy-loading 'pci_devices' on Instance uuid 7cf275ce-0647-43af-ad03-24cbac934b59 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:37:37 user nova-compute[72773]:   <uuid>7cf275ce-0647-43af-ad03-24cbac934b59</uuid>
Aug 16 22:37:37 user nova-compute[72773]:   <name>instance-00000021</name>
Aug 16 22:37:37 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:37:37 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:37:37 user nova-compute[72773]:   <metadata>
Aug 16 22:37:37 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:37:37 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:37:37 user nova-compute[72773]:       <nova:name>tempest-TestShelveInstance-server-1525734974</nova:name>
Aug 16 22:37:37 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:37:35</nova:creationTime>
Aug 16 22:37:37 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:37:37 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:37:37 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:37:37 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:37:37 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:37:37 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:37:37 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:37:37 user nova-compute[72773]:       <nova:owner>
Aug 16 22:37:37 user nova-compute[72773]:         <nova:user uuid="6e5f5ea155144f91886018bc0057e13b">tempest-TestShelveInstance-1515246832-project-member</nova:user>
Aug 16 22:37:37 user nova-compute[72773]:         <nova:project uuid="128365b541d848b4a369bdb73a357786">tempest-TestShelveInstance-1515246832</nova:project>
Aug 16 22:37:37 user nova-compute[72773]:       </nova:owner>
Aug 16 22:37:37 user nova-compute[72773]:       <nova:ports>
Aug 16 22:37:37 user nova-compute[72773]:         <nova:port uuid="ef9aad5b-2373-47b5-910b-8664d08e5df5">
Aug 16 22:37:37 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 22:37:37 user nova-compute[72773]:         </nova:port>
Aug 16 22:37:37 user nova-compute[72773]:       </nova:ports>
Aug 16 22:37:37 user nova-compute[72773]:     </nova:instance>
Aug 16 22:37:37 user nova-compute[72773]:   </metadata>
Aug 16 22:37:37 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:37:37 user nova-compute[72773]:     <system>
Aug 16 22:37:37 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:37:37 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:37:37 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:37:37 user nova-compute[72773]:       <entry name="serial">7cf275ce-0647-43af-ad03-24cbac934b59</entry>
Aug 16 22:37:37 user nova-compute[72773]:       <entry name="uuid">7cf275ce-0647-43af-ad03-24cbac934b59</entry>
Aug 16 22:37:37 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:37:37 user nova-compute[72773]:     </system>
Aug 16 22:37:37 user nova-compute[72773]:   </sysinfo>
Aug 16 22:37:37 user nova-compute[72773]:   <os>
Aug 16 22:37:37 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:37:37 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:37:37 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:37:37 user nova-compute[72773]:   </os>
Aug 16 22:37:37 user nova-compute[72773]:   <features>
Aug 16 22:37:37 user nova-compute[72773]:     <acpi/>
Aug 16 22:37:37 user nova-compute[72773]:     <apic/>
Aug 16 22:37:37 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:37:37 user nova-compute[72773]:   </features>
Aug 16 22:37:37 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:37:37 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:37:37 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:37:37 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:37:37 user nova-compute[72773]:   </clock>
Aug 16 22:37:37 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:37:37 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:37:37 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:37:37 user nova-compute[72773]:   </cpu>
Aug 16 22:37:37 user nova-compute[72773]:   <devices>
Aug 16 22:37:37 user nova-compute[72773]:     <disk type="block" device="disk">
Aug 16 22:37:37 user nova-compute[72773]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:37:37 user nova-compute[72773]:       <source dev="/dev/sdf"/>
Aug 16 22:37:37 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:37:37 user nova-compute[72773]:       <serial>c203a677-77d4-45aa-a91d-f69ed23c7dca</serial>
Aug 16 22:37:37 user nova-compute[72773]:     </disk>
Aug 16 22:37:37 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:37:37 user nova-compute[72773]:       <mac address="fa:16:3e:11:03:33"/>
Aug 16 22:37:37 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:37:37 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:37:37 user nova-compute[72773]:       <target dev="tapef9aad5b-23"/>
Aug 16 22:37:37 user nova-compute[72773]:     </interface>
Aug 16 22:37:37 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:37:37 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/7cf275ce-0647-43af-ad03-24cbac934b59/console.log" append="off"/>
Aug 16 22:37:37 user nova-compute[72773]:     </serial>
Aug 16 22:37:37 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:37:37 user nova-compute[72773]:     <video>
Aug 16 22:37:37 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:37:37 user nova-compute[72773]:     </video>
Aug 16 22:37:37 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:37:37 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:37:37 user nova-compute[72773]:     </rng>
Aug 16 22:37:37 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:37:37 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:37:37 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:37:37 user nova-compute[72773]:     </memballoon>
Aug 16 22:37:37 user nova-compute[72773]:   </devices>
Aug 16 22:37:37 user nova-compute[72773]: </domain>
Aug 16 22:37:37 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:37:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1525734974',display_name='tempest-TestShelveInstance-server-1525734974',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1525734974',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXQBASS0jXrxI3OGcv7vu4DdfXzpmoqsRvSbmQ6vxACy0aQ5iheigPnMtUaevvjo5jGI3reLnnhACND3PPyJAWWWf8sEZP9M76YWibt3G9R/QtnNRpsjmPAUnUPnW3dlQ==',key_name='tempest-TestShelveInstance-631846690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='128365b541d848b4a369bdb73a357786',ramdisk_id='',reservation_id='r-ppxqqatm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1515246832',owner_user_name='tempest-TestShelveInstance-1515246832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:37:19Z,user_data=None,user_id='6e5f5ea155144f91886018bc0057e13b',uuid=7cf275ce-0647-43af-ad03-24cbac934b59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "address": "fa:16:3e:11:03:33", "network": {"id": "09f1ea90-9baf-4dc6-965e-30b89fa0557d", "bridge": "br-int", "label": "tempest-TestShelveInstance-375734384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "128365b541d848b4a369bdb73a357786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9aad5b-23", "ovs_interfaceid": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Converting VIF {"id": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "address": "fa:16:3e:11:03:33", "network": {"id": "09f1ea90-9baf-4dc6-965e-30b89fa0557d", "bridge": "br-int", "label": "tempest-TestShelveInstance-375734384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "128365b541d848b4a369bdb73a357786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9aad5b-23", "ovs_interfaceid": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:03:33,bridge_name='br-int',has_traffic_filtering=True,id=ef9aad5b-2373-47b5-910b-8664d08e5df5,network=Network(09f1ea90-9baf-4dc6-965e-30b89fa0557d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef9aad5b-23') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG os_vif [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:03:33,bridge_name='br-int',has_traffic_filtering=True,id=ef9aad5b-2373-47b5-910b-8664d08e5df5,network=Network(09f1ea90-9baf-4dc6-965e-30b89fa0557d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef9aad5b-23') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e4164e-b23f-4e72-977c-386d0074a2a7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d] added
Aug 16 22:37:37 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef9aad5b-23, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapef9aad5b-23, col_values=(('external_ids', {'iface-id': 'ef9aad5b-2373-47b5-910b-8664d08e5df5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:03:33', 'vm-uuid': '7cf275ce-0647-43af-ad03-24cbac934b59'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:37 user nova-compute[72773]: INFO os_vif [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:03:33,bridge_name='br-int',has_traffic_filtering=True,id=ef9aad5b-2373-47b5-910b-8664d08e5df5,network=Network(09f1ea90-9baf-4dc6-965e-30b89fa0557d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef9aad5b-23')
Aug 16 22:37:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c864508-ac53-4f86-befb-da30084f297f]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6562498d-2eda-4d2a-93de-b2020de87237]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yDKPldmU {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yDKPldmU" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d3ec4f-3c78-4cb1-838d-fd82db85832f]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yDKPldmU'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] No VIF found with MAC fa:16:3e:11:03:33, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7929e9-3357-486d-be65-cfe45b1eb6a5]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[285b8002-9687-4108-b462-b53a6cb74663]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:37:37 user nova-compute[72773]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)
Aug 16 22:37:37 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:37:37 user nova-compute[72773]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 (non-flash)
Aug 16 22:37:37 user nova-compute[72773]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)
Aug 16 22:37:37 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:37:37 user nova-compute[72773]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)
Aug 16 22:37:37 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:37:37 user nova-compute[72773]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 (non-flash)
Aug 16 22:37:37 user nova-compute[72773]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)
Aug 16 22:37:37 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ca82b8-dbe0-4550-b319-28f410e76bb9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d, portal: 172.16.0.220,3260]
Aug 16 22:37:37 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d, portal: 172.16.0.220,3260] successful.
Aug 16 22:37:37 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfd538e-00df-4a54-8647-2c4c7ff04fdd]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d276a77-1619-40a2-80aa-e8895ddff31f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:37:37 user nova-compute[72773]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)
Aug 16 22:37:37 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:37:37 user nova-compute[72773]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 (non-flash)
Aug 16 22:37:37 user nova-compute[72773]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)
Aug 16 22:37:37 user nova-compute[72773]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:37:37 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:37:37 user nova-compute[72773]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)
Aug 16 22:37:37 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:37:37 user nova-compute[72773]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 (non-flash)
Aug 16 22:37:37 user nova-compute[72773]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)
Aug 16 22:37:37 user nova-compute[72773]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:37:37 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] HCTL ('38', '-', '-', 0) found on session 33 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5599f182-09d5-4700-9a58-bdf44bab231c]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Searching for a device in session 33 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:37:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yDKPldmU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:37:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:37:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] <== connect_volume: return (2518ms) {'type': 'block', 'scsi_wwn': '26335666134656639', 'path': '/dev/sdg'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:37:38 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335666134656639', 'path': '/dev/sdg'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:37:38 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:33:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2107689448',display_name='tempest-ServerActionsTestOtherB-server-2107689448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2107689448',id=26,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh1GymZbw24IcnH5dONTb6loGV9Z6Plyeb2rJeaUseM4wpzMr4OTPGkSKihakM6H3XgBNMxcd+thJYbV9RDvja0dJb4k7n+wBitov4O9EMqeBt9unfmT2aB8P/P3aCmCA==',key_name='tempest-keypair-1176159006',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:33:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cafc1d829ed749c2bfe35f7bc58e331c',ramdisk_id='',reservation_id='r-sdzz0nnk',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1140735028',owner_user_name='tempest-ServerActionsTestOtherB-1140735028-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:37:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cdb4ae56354496ab9e3f71461bd9d6d',uuid=23894101-2fd3-41a4-83a3-8f6869d24d97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5725a1df-f51f-4ba4-99f7-777975663b2e", "address": "fa:16:3e:98:fa:bf", "network": {"id": "00744c2a-d566-47bc-abeb-8e9bc9ab312d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-384143120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-384143120-network", "vif_mac": "fa:16:3e:98:fa:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cafc1d829ed749c2bfe35f7bc58e331c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5725a1df-f5", "ovs_interfaceid": "5725a1df-f51f-4ba4-99f7-777975663b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:37:38 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Converting VIF {"id": "5725a1df-f51f-4ba4-99f7-777975663b2e", "address": "fa:16:3e:98:fa:bf", "network": {"id": "00744c2a-d566-47bc-abeb-8e9bc9ab312d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-384143120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-384143120-network", "vif_mac": "fa:16:3e:98:fa:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cafc1d829ed749c2bfe35f7bc58e331c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5725a1df-f5", "ovs_interfaceid": "5725a1df-f51f-4ba4-99f7-777975663b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:37:38 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:fa:bf,bridge_name='br-int',has_traffic_filtering=True,id=5725a1df-f51f-4ba4-99f7-777975663b2e,network=Network(00744c2a-d566-47bc-abeb-8e9bc9ab312d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5725a1df-f5') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:37:38 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:37:38 user nova-compute[72773]:   <uuid>23894101-2fd3-41a4-83a3-8f6869d24d97</uuid>
Aug 16 22:37:38 user nova-compute[72773]:   <name>instance-0000001a</name>
Aug 16 22:37:38 user nova-compute[72773]:   <memory>2097152</memory>
Aug 16 22:37:38 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:37:38 user nova-compute[72773]:   <metadata>
Aug 16 22:37:38 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:37:38 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:37:38 user nova-compute[72773]:       <nova:name>tempest-ServerActionsTestOtherB-server-2107689448</nova:name>
Aug 16 22:37:38 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:37:35</nova:creationTime>
Aug 16 22:37:38 user nova-compute[72773]:       <nova:flavor name="m1.small">
Aug 16 22:37:38 user nova-compute[72773]:         <nova:memory>2048</nova:memory>
Aug 16 22:37:38 user nova-compute[72773]:         <nova:disk>20</nova:disk>
Aug 16 22:37:38 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:37:38 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:37:38 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:37:38 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:37:38 user nova-compute[72773]:       <nova:owner>
Aug 16 22:37:38 user nova-compute[72773]:         <nova:user uuid="7cdb4ae56354496ab9e3f71461bd9d6d">tempest-ServerActionsTestOtherB-1140735028-project-member</nova:user>
Aug 16 22:37:38 user nova-compute[72773]:         <nova:project uuid="cafc1d829ed749c2bfe35f7bc58e331c">tempest-ServerActionsTestOtherB-1140735028</nova:project>
Aug 16 22:37:38 user nova-compute[72773]:       </nova:owner>
Aug 16 22:37:38 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:37:38 user nova-compute[72773]:       <nova:ports>
Aug 16 22:37:38 user nova-compute[72773]:         <nova:port uuid="5725a1df-f51f-4ba4-99f7-777975663b2e">
Aug 16 22:37:38 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 22:37:38 user nova-compute[72773]:         </nova:port>
Aug 16 22:37:38 user nova-compute[72773]:       </nova:ports>
Aug 16 22:37:38 user nova-compute[72773]:     </nova:instance>
Aug 16 22:37:38 user nova-compute[72773]:   </metadata>
Aug 16 22:37:38 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:37:38 user nova-compute[72773]:     <system>
Aug 16 22:37:38 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:37:38 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:37:38 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:37:38 user nova-compute[72773]:       <entry name="serial">23894101-2fd3-41a4-83a3-8f6869d24d97</entry>
Aug 16 22:37:38 user nova-compute[72773]:       <entry name="uuid">23894101-2fd3-41a4-83a3-8f6869d24d97</entry>
Aug 16 22:37:38 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:37:38 user nova-compute[72773]:     </system>
Aug 16 22:37:38 user nova-compute[72773]:   </sysinfo>
Aug 16 22:37:38 user nova-compute[72773]:   <os>
Aug 16 22:37:38 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:37:38 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:37:38 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:37:38 user nova-compute[72773]:   </os>
Aug 16 22:37:38 user nova-compute[72773]:   <features>
Aug 16 22:37:38 user nova-compute[72773]:     <acpi/>
Aug 16 22:37:38 user nova-compute[72773]:     <apic/>
Aug 16 22:37:38 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:37:38 user nova-compute[72773]:   </features>
Aug 16 22:37:38 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:37:38 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:37:38 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:37:38 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:37:38 user nova-compute[72773]:   </clock>
Aug 16 22:37:38 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:37:38 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:37:38 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:37:38 user nova-compute[72773]:   </cpu>
Aug 16 22:37:38 user nova-compute[72773]:   <devices>
Aug 16 22:37:38 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:37:38 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:37:38 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk"/>
Aug 16 22:37:38 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:37:38 user nova-compute[72773]:     </disk>
Aug 16 22:37:38 user nova-compute[72773]:     <disk type="block" device="disk">
Aug 16 22:37:38 user nova-compute[72773]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:37:38 user nova-compute[72773]:       <source dev="/dev/sdg"/>
Aug 16 22:37:38 user nova-compute[72773]:       <target dev="vdb" bus="virtio"/>
Aug 16 22:37:38 user nova-compute[72773]:       <serial>9c2e61c3-7e0d-4dec-84b6-038a4b3b175d</serial>
Aug 16 22:37:38 user nova-compute[72773]:     </disk>
Aug 16 22:37:38 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:37:38 user nova-compute[72773]:       <mac address="fa:16:3e:98:fa:bf"/>
Aug 16 22:37:38 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:37:38 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:37:38 user nova-compute[72773]:       <target dev="tap5725a1df-f5"/>
Aug 16 22:37:38 user nova-compute[72773]:     </interface>
Aug 16 22:37:38 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:37:38 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/console.log" append="off"/>
Aug 16 22:37:38 user nova-compute[72773]:     </serial>
Aug 16 22:37:38 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:37:38 user nova-compute[72773]:     <video>
Aug 16 22:37:38 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:37:38 user nova-compute[72773]:     </video>
Aug 16 22:37:38 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:37:38 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:37:38 user nova-compute[72773]:     </rng>
Aug 16 22:37:38 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:37:38 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:37:38 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:37:38 user nova-compute[72773]:     </memballoon>
Aug 16 22:37:38 user nova-compute[72773]:   </devices>
Aug 16 22:37:38 user nova-compute[72773]: </domain>
Aug 16 22:37:38 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:37:38 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:33:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2107689448',display_name='tempest-ServerActionsTestOtherB-server-2107689448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2107689448',id=26,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh1GymZbw24IcnH5dONTb6loGV9Z6Plyeb2rJeaUseM4wpzMr4OTPGkSKihakM6H3XgBNMxcd+thJYbV9RDvja0dJb4k7n+wBitov4O9EMqeBt9unfmT2aB8P/P3aCmCA==',key_name='tempest-keypair-1176159006',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:33:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cafc1d829ed749c2bfe35f7bc58e331c',ramdisk_id='',reservation_id='r-sdzz0nnk',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1140735028',owner_user_name='tempest-ServerActionsTestOtherB-1140735028-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:37:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cdb4ae56354496ab9e3f71461bd9d6d',uuid=23894101-2fd3-41a4-83a3-8f6869d24d97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5725a1df-f51f-4ba4-99f7-777975663b2e", "address": "fa:16:3e:98:fa:bf", "network": {"id": "00744c2a-d566-47bc-abeb-8e9bc9ab312d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-384143120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-384143120-network", "vif_mac": "fa:16:3e:98:fa:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cafc1d829ed749c2bfe35f7bc58e331c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5725a1df-f5", "ovs_interfaceid": "5725a1df-f51f-4ba4-99f7-777975663b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:37:38 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Converting VIF {"id": "5725a1df-f51f-4ba4-99f7-777975663b2e", "address": "fa:16:3e:98:fa:bf", "network": {"id": "00744c2a-d566-47bc-abeb-8e9bc9ab312d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-384143120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-384143120-network", "vif_mac": "fa:16:3e:98:fa:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cafc1d829ed749c2bfe35f7bc58e331c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5725a1df-f5", "ovs_interfaceid": "5725a1df-f51f-4ba4-99f7-777975663b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:37:38 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:fa:bf,bridge_name='br-int',has_traffic_filtering=True,id=5725a1df-f51f-4ba4-99f7-777975663b2e,network=Network(00744c2a-d566-47bc-abeb-8e9bc9ab312d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5725a1df-f5') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:37:38 user nova-compute[72773]: DEBUG os_vif [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:fa:bf,bridge_name='br-int',has_traffic_filtering=True,id=5725a1df-f51f-4ba4-99f7-777975663b2e,network=Network(00744c2a-d566-47bc-abeb-8e9bc9ab312d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5725a1df-f5') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:37:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:37:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:37:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5725a1df-f5, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:37:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5725a1df-f5, col_values=(('external_ids', {'iface-id': '5725a1df-f51f-4ba4-99f7-777975663b2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:fa:bf', 'vm-uuid': '23894101-2fd3-41a4-83a3-8f6869d24d97'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:37:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:37:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:38 user nova-compute[72773]: INFO os_vif [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:fa:bf,bridge_name='br-int',has_traffic_filtering=True,id=5725a1df-f51f-4ba4-99f7-777975663b2e,network=Network(00744c2a-d566-47bc-abeb-8e9bc9ab312d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5725a1df-f5')
Aug 16 22:37:38 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:37:38 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:37:38 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] No VIF found with MAC fa:16:3e:98:fa:bf, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:37:38 user nova-compute[72773]: DEBUG nova.compute.manager [req-f1f84457-0762-48ad-9d99-ee4391e89b14 req-b91ed8c3-95f9-44a7-8970-9dbbbaf2d6f9 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Received event network-vif-plugged-ef9aad5b-2373-47b5-910b-8664d08e5df5 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:37:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f1f84457-0762-48ad-9d99-ee4391e89b14 req-b91ed8c3-95f9-44a7-8970-9dbbbaf2d6f9 service nova] Acquiring lock "7cf275ce-0647-43af-ad03-24cbac934b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:37:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f1f84457-0762-48ad-9d99-ee4391e89b14 req-b91ed8c3-95f9-44a7-8970-9dbbbaf2d6f9 service nova] Lock "7cf275ce-0647-43af-ad03-24cbac934b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:37:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f1f84457-0762-48ad-9d99-ee4391e89b14 req-b91ed8c3-95f9-44a7-8970-9dbbbaf2d6f9 service nova] Lock "7cf275ce-0647-43af-ad03-24cbac934b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:37:38 user nova-compute[72773]: DEBUG nova.compute.manager [req-f1f84457-0762-48ad-9d99-ee4391e89b14 req-b91ed8c3-95f9-44a7-8970-9dbbbaf2d6f9 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] No waiting events found dispatching network-vif-plugged-ef9aad5b-2373-47b5-910b-8664d08e5df5 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:37:38 user nova-compute[72773]: WARNING nova.compute.manager [req-f1f84457-0762-48ad-9d99-ee4391e89b14 req-b91ed8c3-95f9-44a7-8970-9dbbbaf2d6f9 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Received unexpected event network-vif-plugged-ef9aad5b-2373-47b5-910b-8664d08e5df5 for instance with vm_state building and task_state spawning.
Aug 16 22:37:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:40 user nova-compute[72773]: DEBUG nova.compute.manager [req-38282fbd-b1c5-48a6-b9d8-3dca54aebaaf req-dcf7e353-c957-483a-aea0-e829f599247d service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Received event network-vif-plugged-ef9aad5b-2373-47b5-910b-8664d08e5df5 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:37:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-38282fbd-b1c5-48a6-b9d8-3dca54aebaaf req-dcf7e353-c957-483a-aea0-e829f599247d service nova] Acquiring lock "7cf275ce-0647-43af-ad03-24cbac934b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:37:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-38282fbd-b1c5-48a6-b9d8-3dca54aebaaf req-dcf7e353-c957-483a-aea0-e829f599247d service nova] Lock "7cf275ce-0647-43af-ad03-24cbac934b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:37:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-38282fbd-b1c5-48a6-b9d8-3dca54aebaaf req-dcf7e353-c957-483a-aea0-e829f599247d service nova] Lock "7cf275ce-0647-43af-ad03-24cbac934b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:37:40 user nova-compute[72773]: DEBUG nova.compute.manager [req-38282fbd-b1c5-48a6-b9d8-3dca54aebaaf req-dcf7e353-c957-483a-aea0-e829f599247d service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] No waiting events found dispatching network-vif-plugged-ef9aad5b-2373-47b5-910b-8664d08e5df5 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:37:40 user nova-compute[72773]: WARNING nova.compute.manager [req-38282fbd-b1c5-48a6-b9d8-3dca54aebaaf req-dcf7e353-c957-483a-aea0-e829f599247d service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Received unexpected event network-vif-plugged-ef9aad5b-2373-47b5-910b-8664d08e5df5 for instance with vm_state building and task_state spawning.
Aug 16 22:37:40 user nova-compute[72773]: DEBUG nova.compute.manager [req-38282fbd-b1c5-48a6-b9d8-3dca54aebaaf req-dcf7e353-c957-483a-aea0-e829f599247d service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Received event network-vif-plugged-5725a1df-f51f-4ba4-99f7-777975663b2e {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:37:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-38282fbd-b1c5-48a6-b9d8-3dca54aebaaf req-dcf7e353-c957-483a-aea0-e829f599247d service nova] Acquiring lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:37:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-38282fbd-b1c5-48a6-b9d8-3dca54aebaaf req-dcf7e353-c957-483a-aea0-e829f599247d service nova] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:37:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-38282fbd-b1c5-48a6-b9d8-3dca54aebaaf req-dcf7e353-c957-483a-aea0-e829f599247d service nova] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:37:40 user nova-compute[72773]: DEBUG nova.compute.manager [req-38282fbd-b1c5-48a6-b9d8-3dca54aebaaf req-dcf7e353-c957-483a-aea0-e829f599247d service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] No waiting events found dispatching network-vif-plugged-5725a1df-f51f-4ba4-99f7-777975663b2e {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:37:40 user nova-compute[72773]: WARNING nova.compute.manager [req-38282fbd-b1c5-48a6-b9d8-3dca54aebaaf req-dcf7e353-c957-483a-aea0-e829f599247d service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Received unexpected event network-vif-plugged-5725a1df-f51f-4ba4-99f7-777975663b2e for instance with vm_state active and task_state resize_finish.
Aug 16 22:37:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:41 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:42 user nova-compute[72773]: DEBUG nova.compute.manager [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:37:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:37:42 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225462.1849155, 7cf275ce-0647-43af-ad03-24cbac934b59 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:37:42 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] VM Resumed (Lifecycle Event)
Aug 16 22:37:42 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Instance spawned successfully.
Aug 16 22:37:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:37:42 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:37:42 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:37:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:37:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:37:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:37:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:37:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:37:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:37:42 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:37:42 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225462.1894307, 7cf275ce-0647-43af-ad03-24cbac934b59 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:37:42 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] VM Started (Lifecycle Event)
Aug 16 22:37:42 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:37:42 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:37:42 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:37:42 user nova-compute[72773]: INFO nova.compute.manager [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Took 6.78 seconds to spawn the instance on the hypervisor.
Aug 16 22:37:42 user nova-compute[72773]: DEBUG nova.compute.manager [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:37:42 user nova-compute[72773]: INFO nova.compute.manager [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Took 24.44 seconds to build instance.
Aug 16 22:37:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-2ec89008-a808-48bb-8432-16fc3746bdb3 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lock "7cf275ce-0647-43af-ad03-24cbac934b59" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.604s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:37:42 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225462.7807643, 23894101-2fd3-41a4-83a3-8f6869d24d97 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:37:42 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] VM Resumed (Lifecycle Event)
Aug 16 22:37:42 user nova-compute[72773]: DEBUG nova.compute.manager [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:37:42 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Instance running successfully.
Aug 16 22:37:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Failed to set time: agent not configured {{(pid=72773) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 16 22:37:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-68e4a471-3e1e-4ee1-bf14-c5eca949471d tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] finish_migration finished successfully. {{(pid=72773) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 16 22:37:42 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:37:42 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:37:42 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 22:37:42 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225462.7841167, 23894101-2fd3-41a4-83a3-8f6869d24d97 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:37:42 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] VM Started (Lifecycle Event)
Aug 16 22:37:42 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:37:42 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:37:42 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 22:37:43 user nova-compute[72773]: DEBUG nova.compute.manager [req-cb7373eb-ba44-4246-8403-cc0254fc32cf req-9c28f3f6-797b-44cc-849c-d32d6bb97557 service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Received event network-vif-plugged-5725a1df-f51f-4ba4-99f7-777975663b2e {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:37:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-cb7373eb-ba44-4246-8403-cc0254fc32cf req-9c28f3f6-797b-44cc-849c-d32d6bb97557 service nova] Acquiring lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:37:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-cb7373eb-ba44-4246-8403-cc0254fc32cf req-9c28f3f6-797b-44cc-849c-d32d6bb97557 service nova] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:37:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-cb7373eb-ba44-4246-8403-cc0254fc32cf req-9c28f3f6-797b-44cc-849c-d32d6bb97557 service nova] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:37:43 user nova-compute[72773]: DEBUG nova.compute.manager [req-cb7373eb-ba44-4246-8403-cc0254fc32cf req-9c28f3f6-797b-44cc-849c-d32d6bb97557 service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] No waiting events found dispatching network-vif-plugged-5725a1df-f51f-4ba4-99f7-777975663b2e {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:37:43 user nova-compute[72773]: WARNING nova.compute.manager [req-cb7373eb-ba44-4246-8403-cc0254fc32cf req-9c28f3f6-797b-44cc-849c-d32d6bb97557 service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Received unexpected event network-vif-plugged-5725a1df-f51f-4ba4-99f7-777975663b2e for instance with vm_state resized and task_state None.
Aug 16 22:37:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:48 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:37:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:52 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:37:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:54 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:37:54 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:37:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-9ea2a759-7a26-4ad6-9902-b8b75931b5f0" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:37:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-9ea2a759-7a26-4ad6-9902-b8b75931b5f0" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:37:54 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 22:37:54 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Updating instance_info_cache with network_info: [{"id": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "address": "fa:16:3e:e4:b7:3c", "network": {"id": "a18f2224-ffb0-4406-9c92-5dad954c3a2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1329143363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d68c72b1454d78934269042633293f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83003593-cf", "ovs_interfaceid": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:37:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-9ea2a759-7a26-4ad6-9902-b8b75931b5f0" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:37:55 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 22:37:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:37:55 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:37:55 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:37:57 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:37:57 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:37:58 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:37:58 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:37:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:00 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:38:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:00 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:38:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:01 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:38:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:01 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:38:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:38:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:38:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0f7d89-62d2-44cb-9dfc-f4e8d9285394/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0f7d89-62d2-44cb-9dfc-f4e8d9285394/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0f7d89-62d2-44cb-9dfc-f4e8d9285394/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0f7d89-62d2-44cb-9dfc-f4e8d9285394/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:04 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:38:04 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:38:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-185c81a5-a400-479f-9e56-a9c23baa3127 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Acquiring lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-185c81a5-a400-479f-9e56-a9c23baa3127 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:05 user nova-compute[72773]: INFO nova.compute.manager [None req-185c81a5-a400-479f-9e56-a9c23baa3127 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Detaching volume a4fed383-3540-45ca-9d2f-82daa2d66ad4
Aug 16 22:38:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a246c1-b2a7-4048-a6c9-235c15079d39/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:05 user nova-compute[72773]: INFO nova.virt.block_device [None req-185c81a5-a400-479f-9e56-a9c23baa3127 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Attempting to driver detach volume a4fed383-3540-45ca-9d2f-82daa2d66ad4 from mountpoint /dev/vdb
Aug 16 22:38:05 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-185c81a5-a400-479f-9e56-a9c23baa3127 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Attempting to detach device vdb from instance 9ea2a759-7a26-4ad6-9902-b8b75931b5f0 from the persistent domain config. {{(pid=72773) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 22:38:05 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-185c81a5-a400-479f-9e56-a9c23baa3127 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:38:05 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:38:05 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 22:38:05 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:38:05 user nova-compute[72773]:   <serial>a4fed383-3540-45ca-9d2f-82daa2d66ad4</serial>
Aug 16 22:38:05 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:38:05 user nova-compute[72773]: </disk>
Aug 16 22:38:05 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:38:05 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-185c81a5-a400-479f-9e56-a9c23baa3127 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Successfully detached device vdb from instance 9ea2a759-7a26-4ad6-9902-b8b75931b5f0 from the persistent domain config.
Aug 16 22:38:05 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-185c81a5-a400-479f-9e56-a9c23baa3127 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9ea2a759-7a26-4ad6-9902-b8b75931b5f0 from the live domain config. {{(pid=72773) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 22:38:05 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-185c81a5-a400-479f-9e56-a9c23baa3127 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:38:05 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:38:05 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 22:38:05 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:38:05 user nova-compute[72773]:   <serial>a4fed383-3540-45ca-9d2f-82daa2d66ad4</serial>
Aug 16 22:38:05 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:38:05 user nova-compute[72773]: </disk>
Aug 16 22:38:05 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:38:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a246c1-b2a7-4048-a6c9-235c15079d39/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a246c1-b2a7-4048-a6c9-235c15079d39/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a246c1-b2a7-4048-a6c9-235c15079d39/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Received event <DeviceRemovedEvent: 1692225485.8303194, 9ea2a759-7a26-4ad6-9902-b8b75931b5f0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72773) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-185c81a5-a400-479f-9e56-a9c23baa3127 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9ea2a759-7a26-4ad6-9902-b8b75931b5f0 {{(pid=72773) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 22:38:06 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-185c81a5-a400-479f-9e56-a9c23baa3127 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Successfully detached device vdb from instance 9ea2a759-7a26-4ad6-9902-b8b75931b5f0 from the live domain config.
Aug 16 22:38:06 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:38:06 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:38:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=6844MB free_disk=25.208160400390625GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-185c81a5-a400-479f-9e56-a9c23baa3127 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-185c81a5-a400-479f-9e56-a9c23baa3127 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeSoThVf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:38:06 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-185c81a5-a400-479f-9e56-a9c23baa3127 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:38:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-185c81a5-a400-479f-9e56-a9c23baa3127 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-185c81a5-a400-479f-9e56-a9c23baa3127 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-185c81a5-a400-479f-9e56-a9c23baa3127 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6f6fbf-0295-4f50-98ac-acacc74c8dab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3fda52-7a14-4fcd-bbd4-86b1d7f9249d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-185c81a5-a400-479f-9e56-a9c23baa3127 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:38:06 user nova-compute[72773]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)
Aug 16 22:38:06 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:38:06 user nova-compute[72773]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 (non-flash)
Aug 16 22:38:06 user nova-compute[72773]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)
Aug 16 22:38:06 user nova-compute[72773]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:38:06 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-185c81a5-a400-479f-9e56-a9c23baa3127 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:38:06 user nova-compute[72773]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 (non-flash)
Aug 16 22:38:06 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:38:06 user nova-compute[72773]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 (non-flash)
Aug 16 22:38:06 user nova-compute[72773]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)
Aug 16 22:38:06 user nova-compute[72773]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:38:06 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-185c81a5-a400-479f-9e56-a9c23baa3127 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef804088b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4'): ({'sdc'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-185c81a5-a400-479f-9e56-a9c23baa3127 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Removing single pathed devices sdc {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c158460-dc6f-4079-8b74-c566de416b14]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.032s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bd7e53-8e19-497d-aeb7-4200aaf7205f]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-185c81a5-a400-479f-9e56-a9c23baa3127 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Flushing IO for device /dev/sdc {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Applying migration context for instance 23894101-2fd3-41a4-83a3-8f6869d24d97 as it has an incoming, in-progress migration 1b92ace4-bf05-425a-9f60-0add43adbfcd. Migration status is finished {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 22:38:06 user nova-compute[72773]: INFO nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Updating resource usage from migration 1b92ace4-bf05-425a-9f60-0add43adbfcd
Aug 16 22:38:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f64d3ad-221d-4f24-ba74-368bd2a5456f]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-185c81a5-a400-479f-9e56-a9c23baa3127 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 956d334e-f190-4625-b144-ab44d2f3321a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 030d076d-5099-4236-ae31-6025017eb51e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 9ea2a759-7a26-4ad6-9902-b8b75931b5f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance ac2b49e4-59bc-46cd-b7d9-67aa68296e4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 391a6006-4fe6-4398-a1e8-ae95b5edbf2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance cf01c401-c424-4b3e-aa5b-439d62b1ae4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 5ebcd117-6765-44eb-871b-226afd58e4e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance f4210738-d01e-4408-a15c-aeccada6dd23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 63644e8f-95d4-43a7-a824-8845dd073423 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 16a246c1-b2a7-4048-a6c9-235c15079d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 2c59217c-22f8-4745-b05e-53300ca454f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Migration 1b92ace4-bf05-425a-9f60-0add43adbfcd is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 7cf275ce-0647-43af-ad03-24cbac934b59 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 23894101-2fd3-41a4-83a3-8f6869d24d97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[379b9741-5539-4ec8-8ce2-bb29b282d5b3]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-185c81a5-a400-479f-9e56-a9c23baa3127 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-185c81a5-a400-479f-9e56-a9c23baa3127 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-185c81a5-a400-479f-9e56-a9c23baa3127 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4be13a7-1767-4e31-a41e-67c0697005d5]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-185c81a5-a400-479f-9e56-a9c23baa3127 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-39e2aa00-49ef-4ffe-8e74-2ad5d062b0ec tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Acquiring lock "6f0f7d89-62d2-44cb-9dfc-f4e8d9285394" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-39e2aa00-49ef-4ffe-8e74-2ad5d062b0ec tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "6f0f7d89-62d2-44cb-9dfc-f4e8d9285394" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:06 user nova-compute[72773]: INFO nova.compute.manager [None req-39e2aa00-49ef-4ffe-8e74-2ad5d062b0ec tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Detaching volume 5fd15e45-e158-4324-b7ab-49d893d1f8e7
Aug 16 22:38:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8259741b-334b-4dbe-9e87-aaef9de28de3]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-185c81a5-a400-479f-9e56-a9c23baa3127 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4, portal: 172.16.0.220,3260]
Aug 16 22:38:06 user nova-compute[72773]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4, portal: 172.16.0.220,3260] successful.
Aug 16 22:38:06 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4fed383-3540-45ca-9d2f-82daa2d66ad4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b96311f-22e2-49a0-a1a0-06a349d58dce]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-185c81a5-a400-479f-9e56-a9c23baa3127 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-185c81a5-a400-479f-9e56-a9c23baa3127 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-185c81a5-a400-479f-9e56-a9c23baa3127 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] <== disconnect_volume: return (354ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-185c81a5-a400-479f-9e56-a9c23baa3127 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:38:06 user nova-compute[72773]: INFO nova.virt.block_device [None req-39e2aa00-49ef-4ffe-8e74-2ad5d062b0ec tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Attempting to driver detach volume 5fd15e45-e158-4324-b7ab-49d893d1f8e7 from mountpoint /dev/vdb
Aug 16 22:38:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-39e2aa00-49ef-4ffe-8e74-2ad5d062b0ec tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Attempting to detach device vdb from instance 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394 from the persistent domain config. {{(pid=72773) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-39e2aa00-49ef-4ffe-8e74-2ad5d062b0ec tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:38:06 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:38:06 user nova-compute[72773]:   <source dev="/dev/sde"/>
Aug 16 22:38:06 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:38:06 user nova-compute[72773]:   <serial>5fd15e45-e158-4324-b7ab-49d893d1f8e7</serial>
Aug 16 22:38:06 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:38:06 user nova-compute[72773]: </disk>
Aug 16 22:38:06 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Acquiring lock "6f0f7d89-62d2-44cb-9dfc-f4e8d9285394" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:06 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-39e2aa00-49ef-4ffe-8e74-2ad5d062b0ec tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Successfully detached device vdb from instance 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394 from the persistent domain config.
Aug 16 22:38:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-39e2aa00-49ef-4ffe-8e74-2ad5d062b0ec tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394 from the live domain config. {{(pid=72773) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-39e2aa00-49ef-4ffe-8e74-2ad5d062b0ec tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:38:06 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:38:06 user nova-compute[72773]:   <source dev="/dev/sde"/>
Aug 16 22:38:06 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:38:06 user nova-compute[72773]:   <serial>5fd15e45-e158-4324-b7ab-49d893d1f8e7</serial>
Aug 16 22:38:06 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:38:06 user nova-compute[72773]: </disk>
Aug 16 22:38:06 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:38:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.652s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Received event <DeviceRemovedEvent: 1692225487.1563015, 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72773) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-39e2aa00-49ef-4ffe-8e74-2ad5d062b0ec tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394 {{(pid=72773) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 22:38:07 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-39e2aa00-49ef-4ffe-8e74-2ad5d062b0ec tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Successfully detached device vdb from instance 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394 from the live domain config.
Aug 16 22:38:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39e2aa00-49ef-4ffe-8e74-2ad5d062b0ec tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e2aa00-49ef-4ffe-8e74-2ad5d062b0ec tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wgJvjPec', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:38:07 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-39e2aa00-49ef-4ffe-8e74-2ad5d062b0ec tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:38:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-39e2aa00-49ef-4ffe-8e74-2ad5d062b0ec tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-39e2aa00-49ef-4ffe-8e74-2ad5d062b0ec tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e2aa00-49ef-4ffe-8e74-2ad5d062b0ec tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a588ffc5-9c44-46df-8976-5ae6a12f0069]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f33c1d-5e0f-45f3-af21-70d871024cf7]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e2aa00-49ef-4ffe-8e74-2ad5d062b0ec tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:38:07 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:38:07 user nova-compute[72773]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 (non-flash)
Aug 16 22:38:07 user nova-compute[72773]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)
Aug 16 22:38:07 user nova-compute[72773]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:38:07 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e2aa00-49ef-4ffe-8e74-2ad5d062b0ec tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:38:07 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:38:07 user nova-compute[72773]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 (non-flash)
Aug 16 22:38:07 user nova-compute[72773]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)
Aug 16 22:38:07 user nova-compute[72773]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:38:07 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e2aa00-49ef-4ffe-8e74-2ad5d062b0ec tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef8040bd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7'): ({'sde'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-39e2aa00-49ef-4ffe-8e74-2ad5d062b0ec tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Removing single pathed devices sde {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fbb5c1-2b96-4a1d-8257-e138af877aed]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c76b98-67d9-469e-8b14-21ecadf002ec]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-39e2aa00-49ef-4ffe-8e74-2ad5d062b0ec tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Flushing IO for device /dev/sde {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e19406-f67e-494a-a933-cd044d593c64]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-39e2aa00-49ef-4ffe-8e74-2ad5d062b0ec tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4199debe-eebe-4b26-9a5b-06f30e948248]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-39e2aa00-49ef-4ffe-8e74-2ad5d062b0ec tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-39e2aa00-49ef-4ffe-8e74-2ad5d062b0ec tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] SCSI volumes sde have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e2aa00-49ef-4ffe-8e74-2ad5d062b0ec tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9759d9-4d42-42ec-9463-9dddb33309b9]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e2aa00-49ef-4ffe-8e74-2ad5d062b0ec tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4e9212-5bd6-4869-bd5e-addc05670378]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e2aa00-49ef-4ffe-8e74-2ad5d062b0ec tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7, portal: 172.16.0.220,3260]
Aug 16 22:38:07 user nova-compute[72773]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7, portal: 172.16.0.220,3260] successful.
Aug 16 22:38:07 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ac482a-a433-408d-b5b7-d5ec0171ddab]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e2aa00-49ef-4ffe-8e74-2ad5d062b0ec tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-39e2aa00-49ef-4ffe-8e74-2ad5d062b0ec tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e2aa00-49ef-4ffe-8e74-2ad5d062b0ec tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] <== disconnect_volume: return (309ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39e2aa00-49ef-4ffe-8e74-2ad5d062b0ec tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG nova.objects.instance [None req-185c81a5-a400-479f-9e56-a9c23baa3127 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lazy-loading 'flavor' on Instance uuid 9ea2a759-7a26-4ad6-9902-b8b75931b5f0 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:38:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-185c81a5-a400-479f-9e56-a9c23baa3127 tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.407s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:08 user nova-compute[72773]: DEBUG nova.objects.instance [None req-39e2aa00-49ef-4ffe-8e74-2ad5d062b0ec tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lazy-loading 'flavor' on Instance uuid 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:38:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-39e2aa00-49ef-4ffe-8e74-2ad5d062b0ec tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "6f0f7d89-62d2-44cb-9dfc-f4e8d9285394" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.727s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "6f0f7d89-62d2-44cb-9dfc-f4e8d9285394" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.614s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Acquiring lock "6f0f7d89-62d2-44cb-9dfc-f4e8d9285394-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "6f0f7d89-62d2-44cb-9dfc-f4e8d9285394-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "6f0f7d89-62d2-44cb-9dfc-f4e8d9285394-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:08 user nova-compute[72773]: INFO nova.compute.manager [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Terminating instance
Aug 16 22:38:08 user nova-compute[72773]: DEBUG nova.compute.manager [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:38:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:08 user nova-compute[72773]: DEBUG nova.compute.manager [req-23f8324f-9b77-4e5d-96ec-e5b17e47f46e req-d2ef90dc-6975-494b-809a-4be1dd8ddc73 service nova] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Received event network-vif-unplugged-41910b89-24df-459d-8f24-0a012a999f1a {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:38:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-23f8324f-9b77-4e5d-96ec-e5b17e47f46e req-d2ef90dc-6975-494b-809a-4be1dd8ddc73 service nova] Acquiring lock "6f0f7d89-62d2-44cb-9dfc-f4e8d9285394-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-23f8324f-9b77-4e5d-96ec-e5b17e47f46e req-d2ef90dc-6975-494b-809a-4be1dd8ddc73 service nova] Lock "6f0f7d89-62d2-44cb-9dfc-f4e8d9285394-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-23f8324f-9b77-4e5d-96ec-e5b17e47f46e req-d2ef90dc-6975-494b-809a-4be1dd8ddc73 service nova] Lock "6f0f7d89-62d2-44cb-9dfc-f4e8d9285394-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:08 user nova-compute[72773]: DEBUG nova.compute.manager [req-23f8324f-9b77-4e5d-96ec-e5b17e47f46e req-d2ef90dc-6975-494b-809a-4be1dd8ddc73 service nova] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] No waiting events found dispatching network-vif-unplugged-41910b89-24df-459d-8f24-0a012a999f1a {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:38:08 user nova-compute[72773]: DEBUG nova.compute.manager [req-23f8324f-9b77-4e5d-96ec-e5b17e47f46e req-d2ef90dc-6975-494b-809a-4be1dd8ddc73 service nova] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Received event network-vif-unplugged-41910b89-24df-459d-8f24-0a012a999f1a for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:38:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:09 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Instance destroyed successfully.
Aug 16 22:38:09 user nova-compute[72773]: DEBUG nova.objects.instance [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lazy-loading 'resources' on Instance uuid 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:38:09 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:35:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2031018238',display_name='tempest-VolumesSnapshotTestJSON-instance-2031018238',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2031018238',id=30,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2LMNpdundDZgxPmQpsT/j4Gsjc/CUagJj2G1Fe5NDZ0jPgnzc7BpiaYOb9h1e35Mg+0PgZzl5oVIAq80gkhg7WgqoGWayRh0hGyqE2NumwZqFNZsUw9xUGH2/GGt127Q==',key_name='tempest-keypair-2048764813',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:35:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59b8417e50ee41e89fedf55e7134fecd',ramdisk_id='',reservation_id='r-0v94usbw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-671770143',owner_user_name='tempest-VolumesSnapshotTestJSON-671770143-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:35:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='432dc5daebf442fba54be7f62f6bb09c',uuid=6f0f7d89-62d2-44cb-9dfc-f4e8d9285394,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41910b89-24df-459d-8f24-0a012a999f1a", "address": "fa:16:3e:cd:8e:28", "network": {"id": "6194759c-ac83-4c8f-8604-c30c22e3ce5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-161254247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b8417e50ee41e89fedf55e7134fecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41910b89-24", "ovs_interfaceid": "41910b89-24df-459d-8f24-0a012a999f1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:38:09 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Converting VIF {"id": "41910b89-24df-459d-8f24-0a012a999f1a", "address": "fa:16:3e:cd:8e:28", "network": {"id": "6194759c-ac83-4c8f-8604-c30c22e3ce5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-161254247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b8417e50ee41e89fedf55e7134fecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41910b89-24", "ovs_interfaceid": "41910b89-24df-459d-8f24-0a012a999f1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:38:09 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:8e:28,bridge_name='br-int',has_traffic_filtering=True,id=41910b89-24df-459d-8f24-0a012a999f1a,network=Network(6194759c-ac83-4c8f-8604-c30c22e3ce5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41910b89-24') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:38:09 user nova-compute[72773]: DEBUG os_vif [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:8e:28,bridge_name='br-int',has_traffic_filtering=True,id=41910b89-24df-459d-8f24-0a012a999f1a,network=Network(6194759c-ac83-4c8f-8604-c30c22e3ce5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41910b89-24') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:38:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41910b89-24, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:38:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:09 user nova-compute[72773]: INFO os_vif [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:8e:28,bridge_name='br-int',has_traffic_filtering=True,id=41910b89-24df-459d-8f24-0a012a999f1a,network=Network(6194759c-ac83-4c8f-8604-c30c22e3ce5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41910b89-24')
Aug 16 22:38:09 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:38:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wgJvjPec', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:38:09 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:38:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:38:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:38:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fd15e45-e158-4324-b7ab-49d893d1f8e7', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:38:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:09 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[436d588e-f4a5-4942-b0ad-111c165a7322]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:09 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e5b038-275c-42ee-a529-90d91702ccf6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:38:09 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:38:09 user nova-compute[72773]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)
Aug 16 22:38:09 user nova-compute[72773]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:38:09 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:38:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:38:09 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:38:09 user nova-compute[72773]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)
Aug 16 22:38:09 user nova-compute[72773]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:38:09 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:38:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef5c348430>, {}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:38:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Disconnecting from: [] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:38:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.052s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:38:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] <== disconnect_volume: return (53ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:38:09 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:38:09 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Deleting instance files /opt/stack/data/nova/instances/6f0f7d89-62d2-44cb-9dfc-f4e8d9285394_del
Aug 16 22:38:09 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Deletion of /opt/stack/data/nova/instances/6f0f7d89-62d2-44cb-9dfc-f4e8d9285394_del complete
Aug 16 22:38:09 user nova-compute[72773]: INFO nova.compute.manager [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 16 22:38:09 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:38:09 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:38:09 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:38:10 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:38:10 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Took 0.90 seconds to deallocate network for instance.
Aug 16 22:38:10 user nova-compute[72773]: DEBUG nova.compute.manager [req-0c4955f4-bacd-49da-b49d-0d830fac5695 req-05898f5e-3cb8-4e5c-851a-8ab09025be56 service nova] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Received event network-vif-deleted-41910b89-24df-459d-8f24-0a012a999f1a {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:38:10 user nova-compute[72773]: WARNING nova.volume.cinder [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Attachment e93770d3-6d81-4252-b2b3-f2efc1a567d7 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = e93770d3-6d81-4252-b2b3-f2efc1a567d7. (HTTP 404) (Request-ID: req-dc215ccc-30a6-442d-b2ba-e8fe61c1b0fa)
Aug 16 22:38:10 user nova-compute[72773]: INFO nova.compute.manager [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Took 0.02 seconds to detach 1 volumes for instance.
Aug 16 22:38:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1ba37b8d-430b-4e3b-aaaf-8412d3173025 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "63644e8f-95d4-43a7-a824-8845dd073423" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1ba37b8d-430b-4e3b-aaaf-8412d3173025 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "63644e8f-95d4-43a7-a824-8845dd073423" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1ba37b8d-430b-4e3b-aaaf-8412d3173025 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "63644e8f-95d4-43a7-a824-8845dd073423-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1ba37b8d-430b-4e3b-aaaf-8412d3173025 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "63644e8f-95d4-43a7-a824-8845dd073423-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1ba37b8d-430b-4e3b-aaaf-8412d3173025 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "63644e8f-95d4-43a7-a824-8845dd073423-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:10 user nova-compute[72773]: INFO nova.compute.manager [None req-1ba37b8d-430b-4e3b-aaaf-8412d3173025 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Terminating instance
Aug 16 22:38:10 user nova-compute[72773]: DEBUG nova.compute.manager [None req-1ba37b8d-430b-4e3b-aaaf-8412d3173025 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:38:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:10 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:38:10 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:38:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.454s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:10 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Deleted allocations for instance 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394
Aug 16 22:38:10 user nova-compute[72773]: DEBUG nova.compute.manager [req-0869c2ee-8137-49b2-b291-6169d1ab32ae req-11db7e4e-5c2e-460b-8b89-467f0128ff15 service nova] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Received event network-vif-plugged-41910b89-24df-459d-8f24-0a012a999f1a {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:38:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0869c2ee-8137-49b2-b291-6169d1ab32ae req-11db7e4e-5c2e-460b-8b89-467f0128ff15 service nova] Acquiring lock "6f0f7d89-62d2-44cb-9dfc-f4e8d9285394-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0869c2ee-8137-49b2-b291-6169d1ab32ae req-11db7e4e-5c2e-460b-8b89-467f0128ff15 service nova] Lock "6f0f7d89-62d2-44cb-9dfc-f4e8d9285394-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0869c2ee-8137-49b2-b291-6169d1ab32ae req-11db7e4e-5c2e-460b-8b89-467f0128ff15 service nova] Lock "6f0f7d89-62d2-44cb-9dfc-f4e8d9285394-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:10 user nova-compute[72773]: DEBUG nova.compute.manager [req-0869c2ee-8137-49b2-b291-6169d1ab32ae req-11db7e4e-5c2e-460b-8b89-467f0128ff15 service nova] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] No waiting events found dispatching network-vif-plugged-41910b89-24df-459d-8f24-0a012a999f1a {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:38:10 user nova-compute[72773]: WARNING nova.compute.manager [req-0869c2ee-8137-49b2-b291-6169d1ab32ae req-11db7e4e-5c2e-460b-8b89-467f0128ff15 service nova] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Received unexpected event network-vif-plugged-41910b89-24df-459d-8f24-0a012a999f1a for instance with vm_state deleted and task_state None.
Aug 16 22:38:10 user nova-compute[72773]: DEBUG nova.compute.manager [req-0869c2ee-8137-49b2-b291-6169d1ab32ae req-11db7e4e-5c2e-460b-8b89-467f0128ff15 service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Received event network-vif-unplugged-eae4e0ec-3105-463d-9c92-0e2f63192bb6 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:38:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0869c2ee-8137-49b2-b291-6169d1ab32ae req-11db7e4e-5c2e-460b-8b89-467f0128ff15 service nova] Acquiring lock "63644e8f-95d4-43a7-a824-8845dd073423-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0869c2ee-8137-49b2-b291-6169d1ab32ae req-11db7e4e-5c2e-460b-8b89-467f0128ff15 service nova] Lock "63644e8f-95d4-43a7-a824-8845dd073423-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0869c2ee-8137-49b2-b291-6169d1ab32ae req-11db7e4e-5c2e-460b-8b89-467f0128ff15 service nova] Lock "63644e8f-95d4-43a7-a824-8845dd073423-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:10 user nova-compute[72773]: DEBUG nova.compute.manager [req-0869c2ee-8137-49b2-b291-6169d1ab32ae req-11db7e4e-5c2e-460b-8b89-467f0128ff15 service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] No waiting events found dispatching network-vif-unplugged-eae4e0ec-3105-463d-9c92-0e2f63192bb6 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:38:10 user nova-compute[72773]: DEBUG nova.compute.manager [req-0869c2ee-8137-49b2-b291-6169d1ab32ae req-11db7e4e-5c2e-460b-8b89-467f0128ff15 service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Received event network-vif-unplugged-eae4e0ec-3105-463d-9c92-0e2f63192bb6 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:38:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-bc9201a9-9d29-4975-a815-2495b080326f tempest-VolumesSnapshotTestJSON-671770143 tempest-VolumesSnapshotTestJSON-671770143-project-member] Lock "6f0f7d89-62d2-44cb-9dfc-f4e8d9285394" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.505s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:11 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Instance destroyed successfully.
Aug 16 22:38:11 user nova-compute[72773]: DEBUG nova.objects.instance [None req-1ba37b8d-430b-4e3b-aaaf-8412d3173025 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lazy-loading 'resources' on Instance uuid 63644e8f-95d4-43a7-a824-8845dd073423 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:38:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-1ba37b8d-430b-4e3b-aaaf-8412d3173025 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T22:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-420565271',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-420565271',id=25,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5I2uvRkVSVEy6vMpomgaGv1BP4PwD8mI6gyaqaKNq6pYg6WVSuIAZUhQwYqmeXo8qz9fImN1pgAPS2h8i/SzT9e/Y2ha9ZdnmTjkz+NM4xFhm+OZ2EL14lH7cAaBxfMw==',key_name='tempest-keypair-126270933',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:36:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2ef6a37d79341d7a94e5b314efddab4',ramdisk_id='',reservation_id='r-ixfawem0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-488184195',owner_user_name='tempest-AttachVolumeShelveTestJSON-488184195-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:36:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71cd9d1142ec45e792219e8b789cf2a0',uuid=63644e8f-95d4-43a7-a824-8845dd073423,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "address": "fa:16:3e:0b:c6:49", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeae4e0ec-31", "ovs_interfaceid": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:38:11 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-1ba37b8d-430b-4e3b-aaaf-8412d3173025 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Converting VIF {"id": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "address": "fa:16:3e:0b:c6:49", "network": {"id": "9aa7e6bf-5a47-422d-b638-cff5a8429391", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604163168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ef6a37d79341d7a94e5b314efddab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeae4e0ec-31", "ovs_interfaceid": "eae4e0ec-3105-463d-9c92-0e2f63192bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:38:11 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-1ba37b8d-430b-4e3b-aaaf-8412d3173025 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c6:49,bridge_name='br-int',has_traffic_filtering=True,id=eae4e0ec-3105-463d-9c92-0e2f63192bb6,network=Network(9aa7e6bf-5a47-422d-b638-cff5a8429391),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeae4e0ec-31') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:38:11 user nova-compute[72773]: DEBUG os_vif [None req-1ba37b8d-430b-4e3b-aaaf-8412d3173025 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c6:49,bridge_name='br-int',has_traffic_filtering=True,id=eae4e0ec-3105-463d-9c92-0e2f63192bb6,network=Network(9aa7e6bf-5a47-422d-b638-cff5a8429391),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeae4e0ec-31') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:38:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeae4e0ec-31, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:38:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:38:11 user nova-compute[72773]: INFO os_vif [None req-1ba37b8d-430b-4e3b-aaaf-8412d3173025 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c6:49,bridge_name='br-int',has_traffic_filtering=True,id=eae4e0ec-3105-463d-9c92-0e2f63192bb6,network=Network(9aa7e6bf-5a47-422d-b638-cff5a8429391),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeae4e0ec-31')
Aug 16 22:38:11 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-1ba37b8d-430b-4e3b-aaaf-8412d3173025 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Deleting instance files /opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423_del
Aug 16 22:38:11 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-1ba37b8d-430b-4e3b-aaaf-8412d3173025 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Deletion of /opt/stack/data/nova/instances/63644e8f-95d4-43a7-a824-8845dd073423_del complete
Aug 16 22:38:11 user nova-compute[72773]: INFO nova.compute.manager [None req-1ba37b8d-430b-4e3b-aaaf-8412d3173025 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 16 22:38:11 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-1ba37b8d-430b-4e3b-aaaf-8412d3173025 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:38:11 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:38:11 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:38:11 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:38:11 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Took 0.77 seconds to deallocate network for instance.
Aug 16 22:38:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1ba37b8d-430b-4e3b-aaaf-8412d3173025 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1ba37b8d-430b-4e3b-aaaf-8412d3173025 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:12 user nova-compute[72773]: DEBUG nova.compute.manager [req-c20c188e-159e-4dab-8b19-d593ea5f1643 req-50fb5ddc-7f54-4e2b-a5d8-91fd5c9d2633 service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Received event network-vif-deleted-eae4e0ec-3105-463d-9c92-0e2f63192bb6 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:38:12 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-1ba37b8d-430b-4e3b-aaaf-8412d3173025 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:38:12 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-1ba37b8d-430b-4e3b-aaaf-8412d3173025 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:38:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1ba37b8d-430b-4e3b-aaaf-8412d3173025 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:12 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-1ba37b8d-430b-4e3b-aaaf-8412d3173025 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Deleted allocations for instance 63644e8f-95d4-43a7-a824-8845dd073423
Aug 16 22:38:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1ba37b8d-430b-4e3b-aaaf-8412d3173025 tempest-AttachVolumeShelveTestJSON-488184195 tempest-AttachVolumeShelveTestJSON-488184195-project-member] Lock "63644e8f-95d4-43a7-a824-8845dd073423" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.205s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:12 user nova-compute[72773]: DEBUG nova.compute.manager [req-87899ee9-bfef-442a-9b49-3135f85276b2 req-e92a9935-4437-43a6-b679-5b12ecdae94d service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Received event network-vif-plugged-eae4e0ec-3105-463d-9c92-0e2f63192bb6 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:38:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-87899ee9-bfef-442a-9b49-3135f85276b2 req-e92a9935-4437-43a6-b679-5b12ecdae94d service nova] Acquiring lock "63644e8f-95d4-43a7-a824-8845dd073423-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-87899ee9-bfef-442a-9b49-3135f85276b2 req-e92a9935-4437-43a6-b679-5b12ecdae94d service nova] Lock "63644e8f-95d4-43a7-a824-8845dd073423-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-87899ee9-bfef-442a-9b49-3135f85276b2 req-e92a9935-4437-43a6-b679-5b12ecdae94d service nova] Lock "63644e8f-95d4-43a7-a824-8845dd073423-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:12 user nova-compute[72773]: DEBUG nova.compute.manager [req-87899ee9-bfef-442a-9b49-3135f85276b2 req-e92a9935-4437-43a6-b679-5b12ecdae94d service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] No waiting events found dispatching network-vif-plugged-eae4e0ec-3105-463d-9c92-0e2f63192bb6 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:38:12 user nova-compute[72773]: WARNING nova.compute.manager [req-87899ee9-bfef-442a-9b49-3135f85276b2 req-e92a9935-4437-43a6-b679-5b12ecdae94d service nova] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Received unexpected event network-vif-plugged-eae4e0ec-3105-463d-9c92-0e2f63192bb6 for instance with vm_state deleted and task_state None.
Aug 16 22:38:14 user nova-compute[72773]: DEBUG nova.compute.manager [req-6c450ca8-b1df-4b8f-9504-ad01df6349ce req-d4cb11bb-d511-4bc8-904d-c55b8bbda4a7 service nova] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Received event network-changed-1741e52a-4fe9-4496-9c8b-56f3e1816fc3 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:38:14 user nova-compute[72773]: DEBUG nova.compute.manager [req-6c450ca8-b1df-4b8f-9504-ad01df6349ce req-d4cb11bb-d511-4bc8-904d-c55b8bbda4a7 service nova] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Refreshing instance network info cache due to event network-changed-1741e52a-4fe9-4496-9c8b-56f3e1816fc3. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:38:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6c450ca8-b1df-4b8f-9504-ad01df6349ce req-d4cb11bb-d511-4bc8-904d-c55b8bbda4a7 service nova] Acquiring lock "refresh_cache-16a246c1-b2a7-4048-a6c9-235c15079d39" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:38:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6c450ca8-b1df-4b8f-9504-ad01df6349ce req-d4cb11bb-d511-4bc8-904d-c55b8bbda4a7 service nova] Acquired lock "refresh_cache-16a246c1-b2a7-4048-a6c9-235c15079d39" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:38:14 user nova-compute[72773]: DEBUG nova.network.neutron [req-6c450ca8-b1df-4b8f-9504-ad01df6349ce req-d4cb11bb-d511-4bc8-904d-c55b8bbda4a7 service nova] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Refreshing network info cache for port 1741e52a-4fe9-4496-9c8b-56f3e1816fc3 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:38:14 user nova-compute[72773]: DEBUG nova.network.neutron [req-6c450ca8-b1df-4b8f-9504-ad01df6349ce req-d4cb11bb-d511-4bc8-904d-c55b8bbda4a7 service nova] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Updated VIF entry in instance network info cache for port 1741e52a-4fe9-4496-9c8b-56f3e1816fc3. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:38:14 user nova-compute[72773]: DEBUG nova.network.neutron [req-6c450ca8-b1df-4b8f-9504-ad01df6349ce req-d4cb11bb-d511-4bc8-904d-c55b8bbda4a7 service nova] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Updating instance_info_cache with network_info: [{"id": "1741e52a-4fe9-4496-9c8b-56f3e1816fc3", "address": "fa:16:3e:7d:dd:e5", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1741e52a-4f", "ovs_interfaceid": "1741e52a-4fe9-4496-9c8b-56f3e1816fc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:38:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6c450ca8-b1df-4b8f-9504-ad01df6349ce req-d4cb11bb-d511-4bc8-904d-c55b8bbda4a7 service nova] Releasing lock "refresh_cache-16a246c1-b2a7-4048-a6c9-235c15079d39" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:38:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "16a246c1-b2a7-4048-a6c9-235c15079d39" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "16a246c1-b2a7-4048-a6c9-235c15079d39" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:17 user nova-compute[72773]: DEBUG nova.objects.instance [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lazy-loading 'flavor' on Instance uuid 16a246c1-b2a7-4048-a6c9-235c15079d39 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:38:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "16a246c1-b2a7-4048-a6c9-235c15079d39" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.169s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "16a246c1-b2a7-4048-a6c9-235c15079d39" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "16a246c1-b2a7-4048-a6c9-235c15079d39" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:18 user nova-compute[72773]: INFO nova.compute.manager [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Attaching volume adb873d0-5106-4e05-9bf2-0a67541b24dc to /dev/vdb
Aug 16 22:38:18 user nova-compute[72773]: DEBUG os_brick.utils [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:38:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:18 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee6a8e4-1899-47ab-ae04-4ba0483359b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:18 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe4eb85-3101-4164-b7f9-ad96beb52fad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:18 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[868052c9-0d03-45c1-955a-99684a271a0e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:18 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a667c87e-8775-4ec7-8859-cf65ff4185eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:38:18 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:38:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:38:18 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:38:18 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8dbefbf-cabe-4853-bfe6-a9958b79f1d1]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:18 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:38:18 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:38:18 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:38:18 user nova-compute[72773]: DEBUG os_brick.utils [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:38:18 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Updating existing volume attachment record: 9eb04f91-879c-45f7-8c18-dc6515593094 {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:38:18 user nova-compute[72773]: INFO nova.compute.manager [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Rescuing
Aug 16 22:38:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "refresh_cache-2c59217c-22f8-4745-b05e-53300ca454f2" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:38:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquired lock "refresh_cache-2c59217c-22f8-4745-b05e-53300ca454f2" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:38:18 user nova-compute[72773]: DEBUG nova.network.neutron [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:38:19 user nova-compute[72773]: DEBUG nova.network.neutron [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Updating instance_info_cache with network_info: [{"id": "068f02fa-b6b9-4148-b9b2-737d79b6c82e", "address": "fa:16:3e:6b:7c:d2", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068f02fa-b6", "ovs_interfaceid": "068f02fa-b6b9-4148-b9b2-737d79b6c82e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:38:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Releasing lock "refresh_cache-2c59217c-22f8-4745-b05e-53300ca454f2" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:38:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:19 user nova-compute[72773]: DEBUG nova.compute.manager [req-ceeb8a20-5e78-49b8-9dff-0db446754d95 req-5b0d10a6-94b3-43a9-9451-15e6afd7476d service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Received event network-vif-unplugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:38:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ceeb8a20-5e78-49b8-9dff-0db446754d95 req-5b0d10a6-94b3-43a9-9451-15e6afd7476d service nova] Acquiring lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ceeb8a20-5e78-49b8-9dff-0db446754d95 req-5b0d10a6-94b3-43a9-9451-15e6afd7476d service nova] Lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ceeb8a20-5e78-49b8-9dff-0db446754d95 req-5b0d10a6-94b3-43a9-9451-15e6afd7476d service nova] Lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:19 user nova-compute[72773]: DEBUG nova.compute.manager [req-ceeb8a20-5e78-49b8-9dff-0db446754d95 req-5b0d10a6-94b3-43a9-9451-15e6afd7476d service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] No waiting events found dispatching network-vif-unplugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:38:19 user nova-compute[72773]: WARNING nova.compute.manager [req-ceeb8a20-5e78-49b8-9dff-0db446754d95 req-5b0d10a6-94b3-43a9-9451-15e6afd7476d service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Received unexpected event network-vif-unplugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e for instance with vm_state active and task_state rescuing.
Aug 16 22:38:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:19 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Instance destroyed successfully.
Aug 16 22:38:19 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Attempting a stable device rescue
Aug 16 22:38:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72773) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 22:38:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Instance directory exists: not creating {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 22:38:19 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Creating image(s)
Aug 16 22:38:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "/opt/stack/data/nova/instances/2c59217c-22f8-4745-b05e-53300ca454f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "/opt/stack/data/nova/instances/2c59217c-22f8-4745-b05e-53300ca454f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "/opt/stack/data/nova/instances/2c59217c-22f8-4745-b05e-53300ca454f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:19 user nova-compute[72773]: DEBUG nova.objects.instance [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2c59217c-22f8-4745-b05e-53300ca454f2 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:38:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "085bd8ad901e45dc23b33542fe35a78ff43c5f0a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "085bd8ad901e45dc23b33542fe35a78ff43c5f0a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/085bd8ad901e45dc23b33542fe35a78ff43c5f0a.part --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/085bd8ad901e45dc23b33542fe35a78ff43c5f0a.part --force-share --output=json" returned: 0 in 0.181s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:21 user nova-compute[72773]: DEBUG nova.virt.images [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] 33862898-a054-447d-9062-e51b392dc3da was qcow2, converting to raw {{(pid=72773) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 22:38:21 user nova-compute[72773]: DEBUG nova.privsep.utils [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72773) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 22:38:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/085bd8ad901e45dc23b33542fe35a78ff43c5f0a.part /opt/stack/data/nova/instances/_base/085bd8ad901e45dc23b33542fe35a78ff43c5f0a.converted {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:21 user nova-compute[72773]: DEBUG nova.compute.manager [req-a48a7359-33b2-4878-b1a6-6864242b0d63 req-62ef50fc-e424-4eb9-bba5-1f613c1f7cde service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Received event network-vif-plugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:38:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a48a7359-33b2-4878-b1a6-6864242b0d63 req-62ef50fc-e424-4eb9-bba5-1f613c1f7cde service nova] Acquiring lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a48a7359-33b2-4878-b1a6-6864242b0d63 req-62ef50fc-e424-4eb9-bba5-1f613c1f7cde service nova] Lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a48a7359-33b2-4878-b1a6-6864242b0d63 req-62ef50fc-e424-4eb9-bba5-1f613c1f7cde service nova] Lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:21 user nova-compute[72773]: DEBUG nova.compute.manager [req-a48a7359-33b2-4878-b1a6-6864242b0d63 req-62ef50fc-e424-4eb9-bba5-1f613c1f7cde service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] No waiting events found dispatching network-vif-plugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:38:21 user nova-compute[72773]: WARNING nova.compute.manager [req-a48a7359-33b2-4878-b1a6-6864242b0d63 req-62ef50fc-e424-4eb9-bba5-1f613c1f7cde service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Received unexpected event network-vif-plugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e for instance with vm_state active and task_state rescuing.
Aug 16 22:38:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/085bd8ad901e45dc23b33542fe35a78ff43c5f0a.part /opt/stack/data/nova/instances/_base/085bd8ad901e45dc23b33542fe35a78ff43c5f0a.converted" returned: 0 in 0.598s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/085bd8ad901e45dc23b33542fe35a78ff43c5f0a.converted --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/085bd8ad901e45dc23b33542fe35a78ff43c5f0a.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "085bd8ad901e45dc23b33542fe35a78ff43c5f0a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.046s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "085bd8ad901e45dc23b33542fe35a78ff43c5f0a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "085bd8ad901e45dc23b33542fe35a78ff43c5f0a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/085bd8ad901e45dc23b33542fe35a78ff43c5f0a --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/085bd8ad901e45dc23b33542fe35a78ff43c5f0a --force-share --output=json" returned: 0 in 0.169s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/085bd8ad901e45dc23b33542fe35a78ff43c5f0a,backing_fmt=raw /opt/stack/data/nova/instances/2c59217c-22f8-4745-b05e-53300ca454f2/disk.rescue {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/085bd8ad901e45dc23b33542fe35a78ff43c5f0a,backing_fmt=raw /opt/stack/data/nova/instances/2c59217c-22f8-4745-b05e-53300ca454f2/disk.rescue" returned: 0 in 0.046s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "085bd8ad901e45dc23b33542fe35a78ff43c5f0a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG nova.objects.instance [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lazy-loading 'migration_context' on Instance uuid 2c59217c-22f8-4745-b05e-53300ca454f2 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Start _get_guest_xml network_info=[{"id": "068f02fa-b6b9-4148-b9b2-737d79b6c82e", "address": "fa:16:3e:6b:7c:d2", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "vif_mac": "fa:16:3e:6b:7c:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068f02fa-b6", "ovs_interfaceid": "068f02fa-b6b9-4148-b9b2-737d79b6c82e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '33862898-a054-447d-9062-e51b392dc3da', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '022261dd-bc65-4e4d-bc79-fe3da273e302', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yplbNxGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '2c59217c-22f8-4745-b05e-53300ca454f2', 'attached_at': '', 'detached_at': '', 'volume_id': 'b853e2cd-8117-4231-bb70-cfc6469d3fad', 'serial': 'b853e2cd-8117-4231-bb70-cfc6469d3fad'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG nova.objects.instance [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lazy-loading 'resources' on Instance uuid 2c59217c-22f8-4745-b05e-53300ca454f2 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG nova.objects.instance [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lazy-loading 'numa_topology' on Instance uuid 2c59217c-22f8-4745-b05e-53300ca454f2 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:38:22 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:38:22 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:38:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG nova.objects.instance [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2c59217c-22f8-4745-b05e-53300ca454f2 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yplbNxGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:38:22 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:38:22 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:38:22 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:38:22 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:38:22 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:38:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8377e97-2c26-4435-83c4-95645eff38cf]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = yplbNxGO\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 16 22:38:22 user nova-compute[72773]: node.name = iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad
Aug 16 22:38:22 user nova-compute[72773]: node.tpgt = -1
Aug 16 22:38:22 user nova-compute[72773]: node.startup = automatic
Aug 16 22:38:22 user nova-compute[72773]: node.leading_login = No
Aug 16 22:38:22 user nova-compute[72773]: iface.iscsi_ifacename = default
Aug 16 22:38:22 user nova-compute[72773]: iface.net_ifacename = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.ipaddress = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.prefix_len = 0
Aug 16 22:38:22 user nova-compute[72773]: iface.hwaddress = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.transport_name = tcp
Aug 16 22:38:22 user nova-compute[72773]: iface.initiatorname = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.state = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.vlan_id = 0
Aug 16 22:38:22 user nova-compute[72773]: iface.vlan_priority = 0
Aug 16 22:38:22 user nova-compute[72773]: iface.vlan_state = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.iface_num = 0
Aug 16 22:38:22 user nova-compute[72773]: iface.mtu = 0
Aug 16 22:38:22 user nova-compute[72773]: iface.port = 0
Aug 16 22:38:22 user nova-compute[72773]: iface.bootproto = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.subnet_mask = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.gateway = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.dhcp_alt_client_id_state = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.dhcp_alt_client_id = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.dhcp_dns = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.dhcp_learn_iqn = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.dhcp_req_vendor_id_state = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.dhcp_vendor_id_state = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.dhcp_vendor_id = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.dhcp_slp_da = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.fragmentation = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.gratuitous_arp = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.incoming_forwarding = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.tos_state = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.tos = 0
Aug 16 22:38:22 user nova-compute[72773]: iface.ttl = 0
Aug 16 22:38:22 user nova-compute[72773]: iface.delayed_ack = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.tcp_nagle = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.tcp_wsf_state = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.tcp_wsf = 0
Aug 16 22:38:22 user nova-compute[72773]: iface.tcp_timer_scale = 0
Aug 16 22:38:22 user nova-compute[72773]: iface.tcp_timestamp = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.redirect = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.def_task_mgmt_timeout = 0
Aug 16 22:38:22 user nova-compute[72773]: iface.header_digest = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.data_digest = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.immediate_data = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.initial_r2t = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.data_seq_inorder = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.data_pdu_inorder = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.erl = 0
Aug 16 22:38:22 user nova-compute[72773]: iface.max_receive_data_len = 0
Aug 16 22:38:22 user nova-compute[72773]: iface.first_burst_len = 0
Aug 16 22:38:22 user nova-compute[72773]: iface.max_outstanding_r2t = 0
Aug 16 22:38:22 user nova-compute[72773]: iface.max_burst_len = 0
Aug 16 22:38:22 user nova-compute[72773]: iface.chap_auth = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.bidi_chap = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.strict_login_compliance = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.discovery_auth = <empty>
Aug 16 22:38:22 user nova-compute[72773]: iface.discovery_logout = <empty>
Aug 16 22:38:22 user nova-compute[72773]: node.discovery_address = <empty>
Aug 16 22:38:22 user nova-compute[72773]: node.discovery_port = 0
Aug 16 22:38:22 user nova-compute[72773]: node.discovery_type = static
Aug 16 22:38:22 user nova-compute[72773]: node.session.initial_cmdsn = 0
Aug 16 22:38:22 user nova-compute[72773]: node.session.initial_login_retry_max = 8
Aug 16 22:38:22 user nova-compute[72773]: node.session.xmit_thread_priority = -20
Aug 16 22:38:22 user nova-compute[72773]: node.session.cmds_max = 128
Aug 16 22:38:22 user nova-compute[72773]: node.session.queue_depth = 32
Aug 16 22:38:22 user nova-compute[72773]: node.session.nr_sessions = 1
Aug 16 22:38:22 user nova-compute[72773]: node.session.auth.authmethod = CHAP
Aug 16 22:38:22 user nova-compute[72773]: node.session.auth.username = yplbNxGO
Aug 16 22:38:22 user nova-compute[72773]: node.session.auth.password = ***
Aug 16 22:38:22 user nova-compute[72773]: node.session.auth.username_in = <empty>
Aug 16 22:38:22 user nova-compute[72773]: node.session.auth.password_in = <empty>
Aug 16 22:38:22 user nova-compute[72773]: node.session.auth.chap_algs = MD5
Aug 16 22:38:22 user nova-compute[72773]: node.session.timeo.replacement_timeout = 120
Aug 16 22:38:22 user nova-compute[72773]: node.session.err_timeo.abort_timeout = 15
Aug 16 22:38:22 user nova-compute[72773]: node.session.err_timeo.lu_reset_timeout = 30
Aug 16 22:38:22 user nova-compute[72773]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 16 22:38:22 user nova-compute[72773]: node.session.err_timeo.host_reset_timeout = 60
Aug 16 22:38:22 user nova-compute[72773]: node.session.iscsi.FastAbort = Yes
Aug 16 22:38:22 user nova-compute[72773]: node.session.iscsi.InitialR2T = No
Aug 16 22:38:22 user nova-compute[72773]: node.session.iscsi.ImmediateData = Yes
Aug 16 22:38:22 user nova-compute[72773]: node.session.iscsi.FirstBurstLength = 262144
Aug 16 22:38:22 user nova-compute[72773]: node.session.iscsi.MaxBurstLength = 16776192
Aug 16 22:38:22 user nova-compute[72773]: node.session.iscsi.DefaultTime2Retain = 0
Aug 16 22:38:22 user nova-compute[72773]: node.session.iscsi.DefaultTime2Wait = 2
Aug 16 22:38:22 user nova-compute[72773]: node.session.iscsi.MaxConnections = 1
Aug 16 22:38:22 user nova-compute[72773]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 16 22:38:22 user nova-compute[72773]: node.session.iscsi.ERL = 0
Aug 16 22:38:22 user nova-compute[72773]: node.session.scan = manual
Aug 16 22:38:22 user nova-compute[72773]: node.session.reopen_max = 0
Aug 16 22:38:22 user nova-compute[72773]: node.conn[0].address = 172.16.0.220
Aug 16 22:38:22 user nova-compute[72773]: node.conn[0].port = 3260
Aug 16 22:38:22 user nova-compute[72773]: node.conn[0].startup = manual
Aug 16 22:38:22 user nova-compute[72773]: node.conn[0].tcp.window_size = 524288
Aug 16 22:38:22 user nova-compute[72773]: node.conn[0].tcp.type_of_service = 0
Aug 16 22:38:22 user nova-compute[72773]: node.conn[0].timeo.logout_timeout = 15
Aug 16 22:38:22 user nova-compute[72773]: node.conn[0].timeo.login_timeout = 15
Aug 16 22:38:22 user nova-compute[72773]: node.conn[0].timeo.auth_timeout = 45
Aug 16 22:38:22 user nova-compute[72773]: node.conn[0].timeo.noop_out_interval = 5
Aug 16 22:38:22 user nova-compute[72773]: node.conn[0].timeo.noop_out_timeout = 5
Aug 16 22:38:22 user nova-compute[72773]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 16 22:38:22 user nova-compute[72773]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 16 22:38:22 user nova-compute[72773]: node.conn[0].iscsi.HeaderDigest = None
Aug 16 22:38:22 user nova-compute[72773]: node.conn[0].iscsi.DataDigest = None
Aug 16 22:38:22 user nova-compute[72773]: node.conn[0].iscsi.IFMarker = No
Aug 16 22:38:22 user nova-compute[72773]: node.conn[0].iscsi.OFMarker = No
Aug 16 22:38:22 user nova-compute[72773]: # END RECORD
Aug 16 22:38:22 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[faef4c3f-da22-4bb0-98a6-6934b1232c23]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c84cac-8b45-4fb1-85d4-04cdd391381c]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yplbNxGO {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yplbNxGO" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea3f337-0c66-4f74-af19-64b4073dffe9]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yplbNxGO'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[58417e41-4561-46a9-a7fc-6c68aa5dd75c]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[51657192-3565-4ff8-92ac-4dd971b4602f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:38:22 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:38:22 user nova-compute[72773]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)
Aug 16 22:38:22 user nova-compute[72773]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:38:22 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:38:22 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:38:22 user nova-compute[72773]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)
Aug 16 22:38:22 user nova-compute[72773]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:38:22 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.157s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] HCTL ('35', '0', '0', 0) found on session 29 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d44f4d-6bc4-40a8-8a47-342106e90bd0]: (4, ('0 0 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Searching for a device in session 29 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yplbNxGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.181s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] <== connect_volume: return (184ms) {'type': 'block', 'scsi_wwn': '26365303239303034', 'path': '/dev/sdd'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365303239303034', 'path': '/dev/sdd'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:36:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-886465728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-886465728',id=32,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:36:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f496354017e467e9b7a537c73248fe2',ramdisk_id='',reservation_id='r-qolg41tm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648946443',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:36:59Z,user_data=None,user_id='42e8c8d0806e45ed9d1126aad24a034b',uuid=2c59217c-22f8-4745-b05e-53300ca454f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "068f02fa-b6b9-4148-b9b2-737d79b6c82e", "address": "fa:16:3e:6b:7c:d2", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "vif_mac": "fa:16:3e:6b:7c:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068f02fa-b6", "ovs_interfaceid": "068f02fa-b6b9-4148-b9b2-737d79b6c82e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Converting VIF {"id": "068f02fa-b6b9-4148-b9b2-737d79b6c82e", "address": "fa:16:3e:6b:7c:d2", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "vif_mac": "fa:16:3e:6b:7c:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068f02fa-b6", "ovs_interfaceid": "068f02fa-b6b9-4148-b9b2-737d79b6c82e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=068f02fa-b6b9-4148-b9b2-737d79b6c82e,network=Network(0a6ec813-28f9-4716-bf41-20722c69fe20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068f02fa-b6') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG nova.objects.instance [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c59217c-22f8-4745-b05e-53300ca454f2 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:38:22 user nova-compute[72773]:   <uuid>2c59217c-22f8-4745-b05e-53300ca454f2</uuid>
Aug 16 22:38:22 user nova-compute[72773]:   <name>instance-00000020</name>
Aug 16 22:38:22 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:38:22 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:38:22 user nova-compute[72773]:   <metadata>
Aug 16 22:38:22 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:38:22 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:38:22 user nova-compute[72773]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-886465728</nova:name>
Aug 16 22:38:22 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:38:22</nova:creationTime>
Aug 16 22:38:22 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:38:22 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:38:22 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:38:22 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:38:22 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:38:22 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:38:22 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:38:22 user nova-compute[72773]:       <nova:owner>
Aug 16 22:38:22 user nova-compute[72773]:         <nova:user uuid="42e8c8d0806e45ed9d1126aad24a034b">tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member</nova:user>
Aug 16 22:38:22 user nova-compute[72773]:         <nova:project uuid="4f496354017e467e9b7a537c73248fe2">tempest-ServerBootFromVolumeStableRescueTest-1648946443</nova:project>
Aug 16 22:38:22 user nova-compute[72773]:       </nova:owner>
Aug 16 22:38:22 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:38:22 user nova-compute[72773]:       <nova:ports>
Aug 16 22:38:22 user nova-compute[72773]:         <nova:port uuid="068f02fa-b6b9-4148-b9b2-737d79b6c82e">
Aug 16 22:38:22 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 22:38:22 user nova-compute[72773]:         </nova:port>
Aug 16 22:38:22 user nova-compute[72773]:       </nova:ports>
Aug 16 22:38:22 user nova-compute[72773]:     </nova:instance>
Aug 16 22:38:22 user nova-compute[72773]:   </metadata>
Aug 16 22:38:22 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:38:22 user nova-compute[72773]:     <system>
Aug 16 22:38:22 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:38:22 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:38:22 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:38:22 user nova-compute[72773]:       <entry name="serial">2c59217c-22f8-4745-b05e-53300ca454f2</entry>
Aug 16 22:38:22 user nova-compute[72773]:       <entry name="uuid">2c59217c-22f8-4745-b05e-53300ca454f2</entry>
Aug 16 22:38:22 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:38:22 user nova-compute[72773]:     </system>
Aug 16 22:38:22 user nova-compute[72773]:   </sysinfo>
Aug 16 22:38:22 user nova-compute[72773]:   <os>
Aug 16 22:38:22 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:38:22 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:38:22 user nova-compute[72773]:   </os>
Aug 16 22:38:22 user nova-compute[72773]:   <features>
Aug 16 22:38:22 user nova-compute[72773]:     <acpi/>
Aug 16 22:38:22 user nova-compute[72773]:     <apic/>
Aug 16 22:38:22 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:38:22 user nova-compute[72773]:   </features>
Aug 16 22:38:22 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:38:22 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:38:22 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:38:22 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:38:22 user nova-compute[72773]:   </clock>
Aug 16 22:38:22 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:38:22 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:38:22 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:38:22 user nova-compute[72773]:   </cpu>
Aug 16 22:38:22 user nova-compute[72773]:   <devices>
Aug 16 22:38:22 user nova-compute[72773]:     <disk type="block" device="disk">
Aug 16 22:38:22 user nova-compute[72773]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:38:22 user nova-compute[72773]:       <source dev="/dev/sdd"/>
Aug 16 22:38:22 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:38:22 user nova-compute[72773]:       <serial>b853e2cd-8117-4231-bb70-cfc6469d3fad</serial>
Aug 16 22:38:22 user nova-compute[72773]:     </disk>
Aug 16 22:38:22 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:38:22 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:38:22 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/2c59217c-22f8-4745-b05e-53300ca454f2/disk.rescue"/>
Aug 16 22:38:22 user nova-compute[72773]:       <target dev="vdb" bus="virtio"/>
Aug 16 22:38:22 user nova-compute[72773]:       <boot order="1"/>
Aug 16 22:38:22 user nova-compute[72773]:     </disk>
Aug 16 22:38:22 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:38:22 user nova-compute[72773]:       <mac address="fa:16:3e:6b:7c:d2"/>
Aug 16 22:38:22 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:38:22 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:38:22 user nova-compute[72773]:       <target dev="tap068f02fa-b6"/>
Aug 16 22:38:22 user nova-compute[72773]:     </interface>
Aug 16 22:38:22 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:38:22 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/2c59217c-22f8-4745-b05e-53300ca454f2/console.log" append="off"/>
Aug 16 22:38:22 user nova-compute[72773]:     </serial>
Aug 16 22:38:22 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:38:22 user nova-compute[72773]:     <video>
Aug 16 22:38:22 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:38:22 user nova-compute[72773]:     </video>
Aug 16 22:38:22 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:38:22 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:38:22 user nova-compute[72773]:     </rng>
Aug 16 22:38:22 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:38:22 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:38:22 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:38:22 user nova-compute[72773]:     </memballoon>
Aug 16 22:38:22 user nova-compute[72773]:   </devices>
Aug 16 22:38:22 user nova-compute[72773]: </domain>
Aug 16 22:38:22 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:38:22 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Instance destroyed successfully.
Aug 16 22:38:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:38:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] No VIF found with MAC fa:16:3e:6b:7c:d2, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:38:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:24 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692225489.0639565, 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:38:24 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] VM Stopped (Lifecycle Event)
Aug 16 22:38:24 user nova-compute[72773]: DEBUG nova.compute.manager [None req-eda5347d-0be8-41ec-8f69-4d7bded555cb None None] [instance: 6f0f7d89-62d2-44cb-9dfc-f4e8d9285394] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:38:24 user nova-compute[72773]: DEBUG nova.compute.manager [req-a21d6b90-f547-4542-865f-07eacfe25e84 req-0192c971-a84e-45a7-aaf4-37590dce78e1 service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Received event network-vif-plugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:38:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a21d6b90-f547-4542-865f-07eacfe25e84 req-0192c971-a84e-45a7-aaf4-37590dce78e1 service nova] Acquiring lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a21d6b90-f547-4542-865f-07eacfe25e84 req-0192c971-a84e-45a7-aaf4-37590dce78e1 service nova] Lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a21d6b90-f547-4542-865f-07eacfe25e84 req-0192c971-a84e-45a7-aaf4-37590dce78e1 service nova] Lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:24 user nova-compute[72773]: DEBUG nova.compute.manager [req-a21d6b90-f547-4542-865f-07eacfe25e84 req-0192c971-a84e-45a7-aaf4-37590dce78e1 service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] No waiting events found dispatching network-vif-plugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:38:24 user nova-compute[72773]: WARNING nova.compute.manager [req-a21d6b90-f547-4542-865f-07eacfe25e84 req-0192c971-a84e-45a7-aaf4-37590dce78e1 service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Received unexpected event network-vif-plugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e for instance with vm_state active and task_state rescuing.
Aug 16 22:38:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:26 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Removed pending event for 2c59217c-22f8-4745-b05e-53300ca454f2 due to event {{(pid=72773) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 22:38:26 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225506.0780056, 2c59217c-22f8-4745-b05e-53300ca454f2 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:38:26 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] VM Resumed (Lifecycle Event)
Aug 16 22:38:26 user nova-compute[72773]: DEBUG nova.compute.manager [None req-ab3cd696-c3a2-414d-9ece-80b3965fa6c7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:38:26 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:38:26 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692225491.1053429, 63644e8f-95d4-43a7-a824-8845dd073423 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:38:26 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] VM Stopped (Lifecycle Event)
Aug 16 22:38:26 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:38:26 user nova-compute[72773]: DEBUG nova.compute.manager [None req-64c1fef1-49b5-4468-8b16-62d54f705ea7 None None] [instance: 63644e8f-95d4-43a7-a824-8845dd073423] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:38:26 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 22:38:26 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225506.0798092, 2c59217c-22f8-4745-b05e-53300ca454f2 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:38:26 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] VM Started (Lifecycle Event)
Aug 16 22:38:26 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:38:26 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:38:26 user nova-compute[72773]: DEBUG nova.compute.manager [req-e3f714ae-c3d0-4cc7-82c0-6a3df89dba71 req-ec366d04-5250-41f2-857e-d8fb183e024e service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Received event network-vif-plugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:38:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e3f714ae-c3d0-4cc7-82c0-6a3df89dba71 req-ec366d04-5250-41f2-857e-d8fb183e024e service nova] Acquiring lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e3f714ae-c3d0-4cc7-82c0-6a3df89dba71 req-ec366d04-5250-41f2-857e-d8fb183e024e service nova] Lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e3f714ae-c3d0-4cc7-82c0-6a3df89dba71 req-ec366d04-5250-41f2-857e-d8fb183e024e service nova] Lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:26 user nova-compute[72773]: DEBUG nova.compute.manager [req-e3f714ae-c3d0-4cc7-82c0-6a3df89dba71 req-ec366d04-5250-41f2-857e-d8fb183e024e service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] No waiting events found dispatching network-vif-plugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:38:26 user nova-compute[72773]: WARNING nova.compute.manager [req-e3f714ae-c3d0-4cc7-82c0-6a3df89dba71 req-ec366d04-5250-41f2-857e-d8fb183e024e service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Received unexpected event network-vif-plugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e for instance with vm_state rescued and task_state None.
Aug 16 22:38:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMQHWGxT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:38:29 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:38:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:38:29 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:38:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:38:29 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:38:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[305a67bc-cb6f-4c6c-9243-a31049f39225]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:38:29 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefcfe63-54b8-49c4-b695-a9a08ebc3c9e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc] added
Aug 16 22:38:29 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4692e6ac-714a-4d98-9b6d-4059aaa73858]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a7b077-6932-4173-90e2-5b6cb6776085]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dMQHWGxT {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dMQHWGxT" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[030767bb-b4eb-437e-99f4-b6b5f1d043b8]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dMQHWGxT'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f55c72-0469-4134-807c-0c305d80c9d1]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[feea75fb-1528-4582-b8f9-13f782c38074]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:38:29 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:38:29 user nova-compute[72773]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)
Aug 16 22:38:29 user nova-compute[72773]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:38:29 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:38:29 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:38:29 user nova-compute[72773]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)
Aug 16 22:38:29 user nova-compute[72773]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:38:29 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8baebfbe-f4f7-44f5-a8ff-bdee9d37f83a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc, portal: 172.16.0.220,3260]
Aug 16 22:38:29 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc, portal: 172.16.0.220,3260] successful.
Aug 16 22:38:29 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[092acf22-179b-467e-b6c6-8397e7e8ed5f]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e34709a-55b0-40d6-ba38-99f4a31bb170]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:38:29 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:38:29 user nova-compute[72773]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)
Aug 16 22:38:29 user nova-compute[72773]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:38:29 user nova-compute[72773]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc (non-flash)
Aug 16 22:38:29 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:38:29 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:38:29 user nova-compute[72773]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)
Aug 16 22:38:29 user nova-compute[72773]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:38:29 user nova-compute[72773]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc (non-flash)
Aug 16 22:38:29 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[04297e41-35a0-4f5b-9c72-b37432e82f1f]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:29 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: None {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:38:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:30 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:38:30 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMQHWGxT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:38:30 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:38:30 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23931343864306535', 'path': '/dev/sdc'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:38:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931343864306535', 'path': '/dev/sdc'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:38:30 user nova-compute[72773]: DEBUG nova.objects.instance [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lazy-loading 'flavor' on Instance uuid 16a246c1-b2a7-4048-a6c9-235c15079d39 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:38:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 22:38:30 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:38:30 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 22:38:30 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:38:30 user nova-compute[72773]:   <serial>adb873d0-5106-4e05-9bf2-0a67541b24dc</serial>
Aug 16 22:38:30 user nova-compute[72773]: </disk>
Aug 16 22:38:30 user nova-compute[72773]:  {{(pid=72773) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 22:38:31 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:38:31 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:38:31 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] No VIF found with MAC fa:16:3e:7d:dd:e5, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:38:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-96892b21-1135-4bf8-9837-0118627bf4e4 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "16a246c1-b2a7-4048-a6c9-235c15079d39" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.150s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5a586a2c-f4e7-47cf-bc8b-f50f510854ca tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "16a246c1-b2a7-4048-a6c9-235c15079d39" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5a586a2c-f4e7-47cf-bc8b-f50f510854ca tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "16a246c1-b2a7-4048-a6c9-235c15079d39" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:32 user nova-compute[72773]: INFO nova.compute.manager [None req-5a586a2c-f4e7-47cf-bc8b-f50f510854ca tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Detaching volume adb873d0-5106-4e05-9bf2-0a67541b24dc
Aug 16 22:38:32 user nova-compute[72773]: INFO nova.virt.block_device [None req-5a586a2c-f4e7-47cf-bc8b-f50f510854ca tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Attempting to driver detach volume adb873d0-5106-4e05-9bf2-0a67541b24dc from mountpoint /dev/vdb
Aug 16 22:38:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-5a586a2c-f4e7-47cf-bc8b-f50f510854ca tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Attempting to detach device vdb from instance 16a246c1-b2a7-4048-a6c9-235c15079d39 from the persistent domain config. {{(pid=72773) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 22:38:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-5a586a2c-f4e7-47cf-bc8b-f50f510854ca tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:38:32 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:38:32 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 22:38:32 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:38:32 user nova-compute[72773]:   <serial>adb873d0-5106-4e05-9bf2-0a67541b24dc</serial>
Aug 16 22:38:32 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:38:32 user nova-compute[72773]: </disk>
Aug 16 22:38:32 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:38:32 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-5a586a2c-f4e7-47cf-bc8b-f50f510854ca tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Successfully detached device vdb from instance 16a246c1-b2a7-4048-a6c9-235c15079d39 from the persistent domain config.
Aug 16 22:38:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-5a586a2c-f4e7-47cf-bc8b-f50f510854ca tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 16a246c1-b2a7-4048-a6c9-235c15079d39 from the live domain config. {{(pid=72773) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 22:38:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-5a586a2c-f4e7-47cf-bc8b-f50f510854ca tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:38:32 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:38:32 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 22:38:32 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:38:32 user nova-compute[72773]:   <serial>adb873d0-5106-4e05-9bf2-0a67541b24dc</serial>
Aug 16 22:38:32 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:38:32 user nova-compute[72773]: </disk>
Aug 16 22:38:32 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Received event <DeviceRemovedEvent: 1692225513.0380921, 16a246c1-b2a7-4048-a6c9-235c15079d39 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72773) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-5a586a2c-f4e7-47cf-bc8b-f50f510854ca tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 16a246c1-b2a7-4048-a6c9-235c15079d39 {{(pid=72773) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 22:38:33 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-5a586a2c-f4e7-47cf-bc8b-f50f510854ca tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Successfully detached device vdb from instance 16a246c1-b2a7-4048-a6c9-235c15079d39 from the live domain config.
Aug 16 22:38:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a586a2c-f4e7-47cf-bc8b-f50f510854ca tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a586a2c-f4e7-47cf-bc8b-f50f510854ca tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMQHWGxT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:38:33 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-5a586a2c-f4e7-47cf-bc8b-f50f510854ca tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:38:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-5a586a2c-f4e7-47cf-bc8b-f50f510854ca tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-5a586a2c-f4e7-47cf-bc8b-f50f510854ca tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a586a2c-f4e7-47cf-bc8b-f50f510854ca tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e6fd92-c763-4ae9-8f0e-8ad56c566a9e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3be932-96e9-4139-97de-f9c7fb662c7e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a586a2c-f4e7-47cf-bc8b-f50f510854ca tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:38:33 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:38:33 user nova-compute[72773]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)
Aug 16 22:38:33 user nova-compute[72773]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:38:33 user nova-compute[72773]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc (non-flash)
Aug 16 22:38:33 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a586a2c-f4e7-47cf-bc8b-f50f510854ca tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:38:33 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:38:33 user nova-compute[72773]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)
Aug 16 22:38:33 user nova-compute[72773]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:38:33 user nova-compute[72773]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc (non-flash)
Aug 16 22:38:33 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a586a2c-f4e7-47cf-bc8b-f50f510854ca tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef5c34bd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc'): ({'sdc'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-5a586a2c-f4e7-47cf-bc8b-f50f510854ca tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Removing single pathed devices sdc {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e6d8dc-3e79-498c-a781-2374ee81c569]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ff8de2-e659-4b36-ba5e-cb2d1a060cc1]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-5a586a2c-f4e7-47cf-bc8b-f50f510854ca tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Flushing IO for device /dev/sdc {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb18f42-a5b9-4817-98c4-2a844ee19ca0]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-5a586a2c-f4e7-47cf-bc8b-f50f510854ca tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[242654a5-510b-4e85-8ae7-bf7eb5bdd4e1]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-5a586a2c-f4e7-47cf-bc8b-f50f510854ca tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-5a586a2c-f4e7-47cf-bc8b-f50f510854ca tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a586a2c-f4e7-47cf-bc8b-f50f510854ca tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[996b9600-68ca-404a-bf4e-b8ab9fc8f381]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a586a2c-f4e7-47cf-bc8b-f50f510854ca tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a55d30-0987-43c9-82fa-3ea19fc56b9c]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a586a2c-f4e7-47cf-bc8b-f50f510854ca tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc, portal: 172.16.0.220,3260]
Aug 16 22:38:33 user nova-compute[72773]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc, portal: 172.16.0.220,3260] successful.
Aug 16 22:38:33 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adb873d0-5106-4e05-9bf2-0a67541b24dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[290e9f39-f3c6-4f46-99be-029d330e12d0]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a586a2c-f4e7-47cf-bc8b-f50f510854ca tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-5a586a2c-f4e7-47cf-bc8b-f50f510854ca tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a586a2c-f4e7-47cf-bc8b-f50f510854ca tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] <== disconnect_volume: return (311ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:38:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a586a2c-f4e7-47cf-bc8b-f50f510854ca tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:38:34 user nova-compute[72773]: DEBUG nova.objects.instance [None req-5a586a2c-f4e7-47cf-bc8b-f50f510854ca tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lazy-loading 'flavor' on Instance uuid 16a246c1-b2a7-4048-a6c9-235c15079d39 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:38:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5a586a2c-f4e7-47cf-bc8b-f50f510854ca tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "16a246c1-b2a7-4048-a6c9-235c15079d39" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.808s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:36 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:38:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:41 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "05f47c14-f17f-43d9-b607-bccc9a0c3957" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "05f47c14-f17f-43d9-b607-bccc9a0c3957" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:41 user nova-compute[72773]: DEBUG nova.compute.manager [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:38:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:42 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:38:42 user nova-compute[72773]: INFO nova.compute.claims [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Claim successful on node user
Aug 16 22:38:42 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:38:42 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:38:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:42 user nova-compute[72773]: DEBUG nova.compute.manager [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:38:42 user nova-compute[72773]: DEBUG nova.compute.manager [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:38:42 user nova-compute[72773]: DEBUG nova.network.neutron [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:38:42 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:38:42 user nova-compute[72773]: DEBUG nova.compute.manager [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:38:42 user nova-compute[72773]: DEBUG nova.policy [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '02982f15d1a640a5bc77069a906f3e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3dc03400ff4448682ebba991a7e8af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:38:42 user nova-compute[72773]: DEBUG nova.compute.manager [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:38:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:38:42 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Creating image(s)
Aug 16 22:38:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "/opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "/opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "/opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:42 user nova-compute[72773]: INFO nova.compute.manager [None req-d27460fb-1ff6-47f8-ac44-2d158c02b415 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Unrescuing
Aug 16 22:38:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d27460fb-1ff6-47f8-ac44-2d158c02b415 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "refresh_cache-391a6006-4fe6-4398-a1e8-ae95b5edbf2b" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:38:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d27460fb-1ff6-47f8-ac44-2d158c02b415 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquired lock "refresh_cache-391a6006-4fe6-4398-a1e8-ae95b5edbf2b" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:38:42 user nova-compute[72773]: DEBUG nova.network.neutron [None req-d27460fb-1ff6-47f8-ac44-2d158c02b415 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:38:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.179s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.188s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk 1073741824" returned: 0 in 0.064s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:43 user nova-compute[72773]: DEBUG nova.network.neutron [None req-d27460fb-1ff6-47f8-ac44-2d158c02b415 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Updating instance_info_cache with network_info: [{"id": "6961298d-d62e-4f7b-b97e-4198a325816c", "address": "fa:16:3e:2d:58:d4", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6961298d-d6", "ovs_interfaceid": "6961298d-d62e-4f7b-b97e-4198a325816c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:38:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d27460fb-1ff6-47f8-ac44-2d158c02b415 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Releasing lock "refresh_cache-391a6006-4fe6-4398-a1e8-ae95b5edbf2b" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:38:43 user nova-compute[72773]: DEBUG nova.objects.instance [None req-d27460fb-1ff6-47f8-ac44-2d158c02b415 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lazy-loading 'flavor' on Instance uuid 391a6006-4fe6-4398-a1e8-ae95b5edbf2b {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:38:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.190s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:43 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Checking if we can resize image /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:38:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:38:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:38:43 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Cannot resize image /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:38:43 user nova-compute[72773]: DEBUG nova.objects.instance [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lazy-loading 'migration_context' on Instance uuid 05f47c14-f17f-43d9-b607-bccc9a0c3957 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:38:43 user nova-compute[72773]: DEBUG nova.compute.manager [req-4c5520a9-66c8-4e49-8bef-a5c6f0d22b1e req-d1c68838-00be-495d-8162-b9f1eb2d7d43 service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Received event network-vif-unplugged-6961298d-d62e-4f7b-b97e-4198a325816c {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:38:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4c5520a9-66c8-4e49-8bef-a5c6f0d22b1e req-d1c68838-00be-495d-8162-b9f1eb2d7d43 service nova] Acquiring lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4c5520a9-66c8-4e49-8bef-a5c6f0d22b1e req-d1c68838-00be-495d-8162-b9f1eb2d7d43 service nova] Lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4c5520a9-66c8-4e49-8bef-a5c6f0d22b1e req-d1c68838-00be-495d-8162-b9f1eb2d7d43 service nova] Lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:43 user nova-compute[72773]: DEBUG nova.compute.manager [req-4c5520a9-66c8-4e49-8bef-a5c6f0d22b1e req-d1c68838-00be-495d-8162-b9f1eb2d7d43 service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] No waiting events found dispatching network-vif-unplugged-6961298d-d62e-4f7b-b97e-4198a325816c {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:38:43 user nova-compute[72773]: WARNING nova.compute.manager [req-4c5520a9-66c8-4e49-8bef-a5c6f0d22b1e req-d1c68838-00be-495d-8162-b9f1eb2d7d43 service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Received unexpected event network-vif-unplugged-6961298d-d62e-4f7b-b97e-4198a325816c for instance with vm_state rescued and task_state unrescuing.
Aug 16 22:38:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:38:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Ensure instance console log exists: /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:38:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:44 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Instance destroyed successfully.
Aug 16 22:38:44 user nova-compute[72773]: DEBUG nova.network.neutron [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Successfully created port: 0b3b8e24-f9dc-4d52-9f47-8505706c1457 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:38:44 user nova-compute[72773]: DEBUG nova.network.neutron [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Successfully updated port: 0b3b8e24-f9dc-4d52-9f47-8505706c1457 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "refresh_cache-05f47c14-f17f-43d9-b607-bccc9a0c3957" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquired lock "refresh_cache-05f47c14-f17f-43d9-b607-bccc9a0c3957" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.network.neutron [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.compute.manager [req-7e0bc527-6935-42e0-ac44-0ea4f3582c74 req-e616fac8-a377-463c-974d-028233aaf5b2 service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Received event network-changed-0b3b8e24-f9dc-4d52-9f47-8505706c1457 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.compute.manager [req-7e0bc527-6935-42e0-ac44-0ea4f3582c74 req-e616fac8-a377-463c-974d-028233aaf5b2 service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Refreshing instance network info cache due to event network-changed-0b3b8e24-f9dc-4d52-9f47-8505706c1457. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-7e0bc527-6935-42e0-ac44-0ea4f3582c74 req-e616fac8-a377-463c-974d-028233aaf5b2 service nova] Acquiring lock "refresh_cache-05f47c14-f17f-43d9-b607-bccc9a0c3957" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.network.neutron [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.network.neutron [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Updating instance_info_cache with network_info: [{"id": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "address": "fa:16:3e:73:0f:a0", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3b8e24-f9", "ovs_interfaceid": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Releasing lock "refresh_cache-05f47c14-f17f-43d9-b607-bccc9a0c3957" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.compute.manager [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Instance network_info: |[{"id": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "address": "fa:16:3e:73:0f:a0", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3b8e24-f9", "ovs_interfaceid": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-7e0bc527-6935-42e0-ac44-0ea4f3582c74 req-e616fac8-a377-463c-974d-028233aaf5b2 service nova] Acquired lock "refresh_cache-05f47c14-f17f-43d9-b607-bccc9a0c3957" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.network.neutron [req-7e0bc527-6935-42e0-ac44-0ea4f3582c74 req-e616fac8-a377-463c-974d-028233aaf5b2 service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Refreshing network info cache for port 0b3b8e24-f9dc-4d52-9f47-8505706c1457 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Start _get_guest_xml network_info=[{"id": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "address": "fa:16:3e:73:0f:a0", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3b8e24-f9", "ovs_interfaceid": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:38:45 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:38:45 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1640374506',display_name='tempest-tempest.common.compute-instance-1640374506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1640374506',id=34,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBzvtDCwVci75U1rhvQ1Z9tY7UhERzUXkVpq7AVmjX8jpuQ8EldOLMxDXCgz1AaMzVkstK/rHc9w+j5Cm539WNo3fmDL3Nm1hTQWdxZWqybvyBt+XNmwDqSnz7VNnsE+g==',key_name='tempest-keypair-821177163',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3dc03400ff4448682ebba991a7e8af6',ramdisk_id='',reservation_id='r-t8bd36d0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1807466388',owner_user_name='tempest-ServerActionsTestOtherA-1807466388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:38:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02982f15d1a640a5bc77069a906f3e9a',uuid=05f47c14-f17f-43d9-b607-bccc9a0c3957,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "address": "fa:16:3e:73:0f:a0", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3b8e24-f9", "ovs_interfaceid": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Converting VIF {"id": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "address": "fa:16:3e:73:0f:a0", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3b8e24-f9", "ovs_interfaceid": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:0f:a0,bridge_name='br-int',has_traffic_filtering=True,id=0b3b8e24-f9dc-4d52-9f47-8505706c1457,network=Network(1a1a40b0-631c-4f41-9ece-17cd713adfd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b3b8e24-f9') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.objects.instance [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lazy-loading 'pci_devices' on Instance uuid 05f47c14-f17f-43d9-b607-bccc9a0c3957 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:38:45 user nova-compute[72773]:   <uuid>05f47c14-f17f-43d9-b607-bccc9a0c3957</uuid>
Aug 16 22:38:45 user nova-compute[72773]:   <name>instance-00000022</name>
Aug 16 22:38:45 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:38:45 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:38:45 user nova-compute[72773]:   <metadata>
Aug 16 22:38:45 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:38:45 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:38:45 user nova-compute[72773]:       <nova:name>tempest-tempest.common.compute-instance-1640374506</nova:name>
Aug 16 22:38:45 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:38:45</nova:creationTime>
Aug 16 22:38:45 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:38:45 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:38:45 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:38:45 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:38:45 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:38:45 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:38:45 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:38:45 user nova-compute[72773]:       <nova:owner>
Aug 16 22:38:45 user nova-compute[72773]:         <nova:user uuid="02982f15d1a640a5bc77069a906f3e9a">tempest-ServerActionsTestOtherA-1807466388-project-member</nova:user>
Aug 16 22:38:45 user nova-compute[72773]:         <nova:project uuid="e3dc03400ff4448682ebba991a7e8af6">tempest-ServerActionsTestOtherA-1807466388</nova:project>
Aug 16 22:38:45 user nova-compute[72773]:       </nova:owner>
Aug 16 22:38:45 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:38:45 user nova-compute[72773]:       <nova:ports>
Aug 16 22:38:45 user nova-compute[72773]:         <nova:port uuid="0b3b8e24-f9dc-4d52-9f47-8505706c1457">
Aug 16 22:38:45 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 22:38:45 user nova-compute[72773]:         </nova:port>
Aug 16 22:38:45 user nova-compute[72773]:       </nova:ports>
Aug 16 22:38:45 user nova-compute[72773]:     </nova:instance>
Aug 16 22:38:45 user nova-compute[72773]:   </metadata>
Aug 16 22:38:45 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:38:45 user nova-compute[72773]:     <system>
Aug 16 22:38:45 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:38:45 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:38:45 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:38:45 user nova-compute[72773]:       <entry name="serial">05f47c14-f17f-43d9-b607-bccc9a0c3957</entry>
Aug 16 22:38:45 user nova-compute[72773]:       <entry name="uuid">05f47c14-f17f-43d9-b607-bccc9a0c3957</entry>
Aug 16 22:38:45 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:38:45 user nova-compute[72773]:     </system>
Aug 16 22:38:45 user nova-compute[72773]:   </sysinfo>
Aug 16 22:38:45 user nova-compute[72773]:   <os>
Aug 16 22:38:45 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:38:45 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:38:45 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:38:45 user nova-compute[72773]:   </os>
Aug 16 22:38:45 user nova-compute[72773]:   <features>
Aug 16 22:38:45 user nova-compute[72773]:     <acpi/>
Aug 16 22:38:45 user nova-compute[72773]:     <apic/>
Aug 16 22:38:45 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:38:45 user nova-compute[72773]:   </features>
Aug 16 22:38:45 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:38:45 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:38:45 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:38:45 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:38:45 user nova-compute[72773]:   </clock>
Aug 16 22:38:45 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:38:45 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:38:45 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:38:45 user nova-compute[72773]:   </cpu>
Aug 16 22:38:45 user nova-compute[72773]:   <devices>
Aug 16 22:38:45 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:38:45 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:38:45 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk"/>
Aug 16 22:38:45 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:38:45 user nova-compute[72773]:     </disk>
Aug 16 22:38:45 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:38:45 user nova-compute[72773]:       <mac address="fa:16:3e:73:0f:a0"/>
Aug 16 22:38:45 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:38:45 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:38:45 user nova-compute[72773]:       <target dev="tap0b3b8e24-f9"/>
Aug 16 22:38:45 user nova-compute[72773]:     </interface>
Aug 16 22:38:45 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:38:45 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/console.log" append="off"/>
Aug 16 22:38:45 user nova-compute[72773]:     </serial>
Aug 16 22:38:45 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:38:45 user nova-compute[72773]:     <video>
Aug 16 22:38:45 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:38:45 user nova-compute[72773]:     </video>
Aug 16 22:38:45 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:38:45 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:38:45 user nova-compute[72773]:     </rng>
Aug 16 22:38:45 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:38:45 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:38:45 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:38:45 user nova-compute[72773]:     </memballoon>
Aug 16 22:38:45 user nova-compute[72773]:   </devices>
Aug 16 22:38:45 user nova-compute[72773]: </domain>
Aug 16 22:38:45 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1640374506',display_name='tempest-tempest.common.compute-instance-1640374506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1640374506',id=34,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBzvtDCwVci75U1rhvQ1Z9tY7UhERzUXkVpq7AVmjX8jpuQ8EldOLMxDXCgz1AaMzVkstK/rHc9w+j5Cm539WNo3fmDL3Nm1hTQWdxZWqybvyBt+XNmwDqSnz7VNnsE+g==',key_name='tempest-keypair-821177163',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3dc03400ff4448682ebba991a7e8af6',ramdisk_id='',reservation_id='r-t8bd36d0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1807466388',owner_user_name='tempest-ServerActionsTestOtherA-1807466388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:38:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02982f15d1a640a5bc77069a906f3e9a',uuid=05f47c14-f17f-43d9-b607-bccc9a0c3957,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "address": "fa:16:3e:73:0f:a0", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3b8e24-f9", "ovs_interfaceid": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Converting VIF {"id": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "address": "fa:16:3e:73:0f:a0", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3b8e24-f9", "ovs_interfaceid": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:0f:a0,bridge_name='br-int',has_traffic_filtering=True,id=0b3b8e24-f9dc-4d52-9f47-8505706c1457,network=Network(1a1a40b0-631c-4f41-9ece-17cd713adfd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b3b8e24-f9') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG os_vif [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:0f:a0,bridge_name='br-int',has_traffic_filtering=True,id=0b3b8e24-f9dc-4d52-9f47-8505706c1457,network=Network(1a1a40b0-631c-4f41-9ece-17cd713adfd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b3b8e24-f9') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b3b8e24-f9, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0b3b8e24-f9, col_values=(('external_ids', {'iface-id': '0b3b8e24-f9dc-4d52-9f47-8505706c1457', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:0f:a0', 'vm-uuid': '05f47c14-f17f-43d9-b607-bccc9a0c3957'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:45 user nova-compute[72773]: INFO os_vif [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:0f:a0,bridge_name='br-int',has_traffic_filtering=True,id=0b3b8e24-f9dc-4d52-9f47-8505706c1457,network=Network(1a1a40b0-631c-4f41-9ece-17cd713adfd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b3b8e24-f9')
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] No VIF found with MAC fa:16:3e:73:0f:a0, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.compute.manager [req-37427b28-200f-451e-8f92-b48d391be3d9 req-156065ed-df3d-457b-997f-05aa70bc856e service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Received event network-vif-plugged-6961298d-d62e-4f7b-b97e-4198a325816c {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-37427b28-200f-451e-8f92-b48d391be3d9 req-156065ed-df3d-457b-997f-05aa70bc856e service nova] Acquiring lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-37427b28-200f-451e-8f92-b48d391be3d9 req-156065ed-df3d-457b-997f-05aa70bc856e service nova] Lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-37427b28-200f-451e-8f92-b48d391be3d9 req-156065ed-df3d-457b-997f-05aa70bc856e service nova] Lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.compute.manager [req-37427b28-200f-451e-8f92-b48d391be3d9 req-156065ed-df3d-457b-997f-05aa70bc856e service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] No waiting events found dispatching network-vif-plugged-6961298d-d62e-4f7b-b97e-4198a325816c {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:38:45 user nova-compute[72773]: WARNING nova.compute.manager [req-37427b28-200f-451e-8f92-b48d391be3d9 req-156065ed-df3d-457b-997f-05aa70bc856e service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Received unexpected event network-vif-plugged-6961298d-d62e-4f7b-b97e-4198a325816c for instance with vm_state rescued and task_state unrescuing.
Aug 16 22:38:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.network.neutron [req-7e0bc527-6935-42e0-ac44-0ea4f3582c74 req-e616fac8-a377-463c-974d-028233aaf5b2 service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Updated VIF entry in instance network info cache for port 0b3b8e24-f9dc-4d52-9f47-8505706c1457. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG nova.network.neutron [req-7e0bc527-6935-42e0-ac44-0ea4f3582c74 req-e616fac8-a377-463c-974d-028233aaf5b2 service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Updating instance_info_cache with network_info: [{"id": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "address": "fa:16:3e:73:0f:a0", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3b8e24-f9", "ovs_interfaceid": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:38:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-7e0bc527-6935-42e0-ac44-0ea4f3582c74 req-e616fac8-a377-463c-974d-028233aaf5b2 service nova] Releasing lock "refresh_cache-05f47c14-f17f-43d9-b607-bccc9a0c3957" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:38:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:47 user nova-compute[72773]: DEBUG nova.compute.manager [req-bb22ded4-1827-41e7-85d9-266b80112458 req-42471e9a-7559-42bc-8acc-d9024b140c6c service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Received event network-vif-plugged-0b3b8e24-f9dc-4d52-9f47-8505706c1457 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:38:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-bb22ded4-1827-41e7-85d9-266b80112458 req-42471e9a-7559-42bc-8acc-d9024b140c6c service nova] Acquiring lock "05f47c14-f17f-43d9-b607-bccc9a0c3957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-bb22ded4-1827-41e7-85d9-266b80112458 req-42471e9a-7559-42bc-8acc-d9024b140c6c service nova] Lock "05f47c14-f17f-43d9-b607-bccc9a0c3957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-bb22ded4-1827-41e7-85d9-266b80112458 req-42471e9a-7559-42bc-8acc-d9024b140c6c service nova] Lock "05f47c14-f17f-43d9-b607-bccc9a0c3957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:47 user nova-compute[72773]: DEBUG nova.compute.manager [req-bb22ded4-1827-41e7-85d9-266b80112458 req-42471e9a-7559-42bc-8acc-d9024b140c6c service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] No waiting events found dispatching network-vif-plugged-0b3b8e24-f9dc-4d52-9f47-8505706c1457 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:38:47 user nova-compute[72773]: WARNING nova.compute.manager [req-bb22ded4-1827-41e7-85d9-266b80112458 req-42471e9a-7559-42bc-8acc-d9024b140c6c service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Received unexpected event network-vif-plugged-0b3b8e24-f9dc-4d52-9f47-8505706c1457 for instance with vm_state building and task_state spawning.
Aug 16 22:38:47 user nova-compute[72773]: DEBUG nova.compute.manager [req-2d489e6a-6310-4878-81ac-01db3da8701c req-e49934a8-5125-4816-a902-5b6685567f53 service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Received event network-vif-plugged-6961298d-d62e-4f7b-b97e-4198a325816c {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:38:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2d489e6a-6310-4878-81ac-01db3da8701c req-e49934a8-5125-4816-a902-5b6685567f53 service nova] Acquiring lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2d489e6a-6310-4878-81ac-01db3da8701c req-e49934a8-5125-4816-a902-5b6685567f53 service nova] Lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2d489e6a-6310-4878-81ac-01db3da8701c req-e49934a8-5125-4816-a902-5b6685567f53 service nova] Lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:47 user nova-compute[72773]: DEBUG nova.compute.manager [req-2d489e6a-6310-4878-81ac-01db3da8701c req-e49934a8-5125-4816-a902-5b6685567f53 service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] No waiting events found dispatching network-vif-plugged-6961298d-d62e-4f7b-b97e-4198a325816c {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:38:47 user nova-compute[72773]: WARNING nova.compute.manager [req-2d489e6a-6310-4878-81ac-01db3da8701c req-e49934a8-5125-4816-a902-5b6685567f53 service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Received unexpected event network-vif-plugged-6961298d-d62e-4f7b-b97e-4198a325816c for instance with vm_state rescued and task_state unrescuing.
Aug 16 22:38:47 user nova-compute[72773]: DEBUG nova.compute.manager [req-2d489e6a-6310-4878-81ac-01db3da8701c req-e49934a8-5125-4816-a902-5b6685567f53 service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Received event network-vif-plugged-6961298d-d62e-4f7b-b97e-4198a325816c {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:38:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2d489e6a-6310-4878-81ac-01db3da8701c req-e49934a8-5125-4816-a902-5b6685567f53 service nova] Acquiring lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2d489e6a-6310-4878-81ac-01db3da8701c req-e49934a8-5125-4816-a902-5b6685567f53 service nova] Lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2d489e6a-6310-4878-81ac-01db3da8701c req-e49934a8-5125-4816-a902-5b6685567f53 service nova] Lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:47 user nova-compute[72773]: DEBUG nova.compute.manager [req-2d489e6a-6310-4878-81ac-01db3da8701c req-e49934a8-5125-4816-a902-5b6685567f53 service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] No waiting events found dispatching network-vif-plugged-6961298d-d62e-4f7b-b97e-4198a325816c {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:38:47 user nova-compute[72773]: WARNING nova.compute.manager [req-2d489e6a-6310-4878-81ac-01db3da8701c req-e49934a8-5125-4816-a902-5b6685567f53 service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Received unexpected event network-vif-plugged-6961298d-d62e-4f7b-b97e-4198a325816c for instance with vm_state rescued and task_state unrescuing.
Aug 16 22:38:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Removed pending event for 391a6006-4fe6-4398-a1e8-ae95b5edbf2b due to event {{(pid=72773) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 22:38:48 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225528.6430116, 391a6006-4fe6-4398-a1e8-ae95b5edbf2b => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:38:48 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] VM Resumed (Lifecycle Event)
Aug 16 22:38:48 user nova-compute[72773]: DEBUG nova.compute.manager [None req-d27460fb-1ff6-47f8-ac44-2d158c02b415 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:38:48 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:38:48 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:38:48 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 22:38:48 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225528.6440003, 391a6006-4fe6-4398-a1e8-ae95b5edbf2b => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:38:48 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] VM Started (Lifecycle Event)
Aug 16 22:38:48 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:38:48 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:38:48 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 22:38:49 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225529.280576, 05f47c14-f17f-43d9-b607-bccc9a0c3957 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:38:49 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] VM Resumed (Lifecycle Event)
Aug 16 22:38:49 user nova-compute[72773]: DEBUG nova.compute.manager [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:38:49 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:38:49 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Instance spawned successfully.
Aug 16 22:38:49 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:38:49 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:38:49 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:38:49 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:38:49 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225529.2810168, 05f47c14-f17f-43d9-b607-bccc9a0c3957 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:38:49 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] VM Started (Lifecycle Event)
Aug 16 22:38:49 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:38:49 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:38:49 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:38:49 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:38:49 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:38:49 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:38:49 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:38:49 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:38:49 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:38:49 user nova-compute[72773]: INFO nova.compute.manager [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Took 6.65 seconds to spawn the instance on the hypervisor.
Aug 16 22:38:49 user nova-compute[72773]: DEBUG nova.compute.manager [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:38:49 user nova-compute[72773]: INFO nova.compute.manager [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Took 7.43 seconds to build instance.
Aug 16 22:38:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3295192f-2afc-4b75-9619-4d5829f1ee62 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "05f47c14-f17f-43d9-b607-bccc9a0c3957" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.570s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:49 user nova-compute[72773]: DEBUG nova.compute.manager [req-1036fc63-8109-4fe5-a066-e21db749633a req-4c1c5fbe-68dd-4686-8085-9b49b21a2fc3 service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Received event network-vif-plugged-0b3b8e24-f9dc-4d52-9f47-8505706c1457 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:38:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-1036fc63-8109-4fe5-a066-e21db749633a req-4c1c5fbe-68dd-4686-8085-9b49b21a2fc3 service nova] Acquiring lock "05f47c14-f17f-43d9-b607-bccc9a0c3957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-1036fc63-8109-4fe5-a066-e21db749633a req-4c1c5fbe-68dd-4686-8085-9b49b21a2fc3 service nova] Lock "05f47c14-f17f-43d9-b607-bccc9a0c3957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-1036fc63-8109-4fe5-a066-e21db749633a req-4c1c5fbe-68dd-4686-8085-9b49b21a2fc3 service nova] Lock "05f47c14-f17f-43d9-b607-bccc9a0c3957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:49 user nova-compute[72773]: DEBUG nova.compute.manager [req-1036fc63-8109-4fe5-a066-e21db749633a req-4c1c5fbe-68dd-4686-8085-9b49b21a2fc3 service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] No waiting events found dispatching network-vif-plugged-0b3b8e24-f9dc-4d52-9f47-8505706c1457 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:38:49 user nova-compute[72773]: WARNING nova.compute.manager [req-1036fc63-8109-4fe5-a066-e21db749633a req-4c1c5fbe-68dd-4686-8085-9b49b21a2fc3 service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Received unexpected event network-vif-plugged-0b3b8e24-f9dc-4d52-9f47-8505706c1457 for instance with vm_state active and task_state None.
Aug 16 22:38:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5882a5ae-b526-4f3f-b846-b6ed2a96e2de tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Acquiring lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5882a5ae-b526-4f3f-b846-b6ed2a96e2de tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5882a5ae-b526-4f3f-b846-b6ed2a96e2de tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Acquiring lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5882a5ae-b526-4f3f-b846-b6ed2a96e2de tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5882a5ae-b526-4f3f-b846-b6ed2a96e2de tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:55 user nova-compute[72773]: INFO nova.compute.manager [None req-5882a5ae-b526-4f3f-b846-b6ed2a96e2de tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Terminating instance
Aug 16 22:38:55 user nova-compute[72773]: DEBUG nova.compute.manager [None req-5882a5ae-b526-4f3f-b846-b6ed2a96e2de tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:38:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:55 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:38:55 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:38:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:56 user nova-compute[72773]: DEBUG nova.compute.manager [req-dda9b1a1-b95e-448b-a50b-79fb24d491e8 req-4625b694-89a0-44ff-a2ad-9b7128085c94 service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received event network-vif-unplugged-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:38:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-dda9b1a1-b95e-448b-a50b-79fb24d491e8 req-4625b694-89a0-44ff-a2ad-9b7128085c94 service nova] Acquiring lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-dda9b1a1-b95e-448b-a50b-79fb24d491e8 req-4625b694-89a0-44ff-a2ad-9b7128085c94 service nova] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-dda9b1a1-b95e-448b-a50b-79fb24d491e8 req-4625b694-89a0-44ff-a2ad-9b7128085c94 service nova] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:56 user nova-compute[72773]: DEBUG nova.compute.manager [req-dda9b1a1-b95e-448b-a50b-79fb24d491e8 req-4625b694-89a0-44ff-a2ad-9b7128085c94 service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] No waiting events found dispatching network-vif-unplugged-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:38:56 user nova-compute[72773]: DEBUG nova.compute.manager [req-dda9b1a1-b95e-448b-a50b-79fb24d491e8 req-4625b694-89a0-44ff-a2ad-9b7128085c94 service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received event network-vif-unplugged-83003593-cfc0-44d3-94c6-4e3fb90573bd for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:38:56 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:38:56 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:38:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-ac2b49e4-59bc-46cd-b7d9-67aa68296e4e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:38:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-ac2b49e4-59bc-46cd-b7d9-67aa68296e4e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:38:56 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 22:38:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:56 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Instance destroyed successfully.
Aug 16 22:38:56 user nova-compute[72773]: DEBUG nova.objects.instance [None req-5882a5ae-b526-4f3f-b846-b6ed2a96e2de tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lazy-loading 'resources' on Instance uuid 9ea2a759-7a26-4ad6-9902-b8b75931b5f0 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:38:56 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-5882a5ae-b526-4f3f-b846-b6ed2a96e2de tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:31:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-738184949',display_name='tempest-ServerStableDeviceRescueTest-server-738184949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-738184949',id=19,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdDs0qSvSZ6qEmvaVSSkiC4v5VB61+2JkRBiyKREBlAfJAmOwhbAu0s7p7884ybaAUHg4xbKZuXPFC0FkwnafltxzeE+Ad+yovVfqAeD9IMpKRqI2/X3YGc2Onpir2t3A==',key_name='tempest-keypair-261024075',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:35:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2d68c72b1454d78934269042633293f',ramdisk_id='',reservation_id='r-1sapniu7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1505608702',owner_user_name='tempest-ServerStableDeviceRescueTest-1505608702-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:37:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38a5ab8690e4428e8f047081cdbd4a1e',uuid=9ea2a759-7a26-4ad6-9902-b8b75931b5f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "address": "fa:16:3e:e4:b7:3c", "network": {"id": "a18f2224-ffb0-4406-9c92-5dad954c3a2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1329143363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d68c72b1454d78934269042633293f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83003593-cf", "ovs_interfaceid": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:38:56 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-5882a5ae-b526-4f3f-b846-b6ed2a96e2de tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Converting VIF {"id": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "address": "fa:16:3e:e4:b7:3c", "network": {"id": "a18f2224-ffb0-4406-9c92-5dad954c3a2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1329143363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d68c72b1454d78934269042633293f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83003593-cf", "ovs_interfaceid": "83003593-cfc0-44d3-94c6-4e3fb90573bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:38:56 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-5882a5ae-b526-4f3f-b846-b6ed2a96e2de tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:b7:3c,bridge_name='br-int',has_traffic_filtering=True,id=83003593-cfc0-44d3-94c6-4e3fb90573bd,network=Network(a18f2224-ffb0-4406-9c92-5dad954c3a2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83003593-cf') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:38:56 user nova-compute[72773]: DEBUG os_vif [None req-5882a5ae-b526-4f3f-b846-b6ed2a96e2de tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:b7:3c,bridge_name='br-int',has_traffic_filtering=True,id=83003593-cfc0-44d3-94c6-4e3fb90573bd,network=Network(a18f2224-ffb0-4406-9c92-5dad954c3a2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83003593-cf') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:38:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83003593-cf, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:38:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:38:56 user nova-compute[72773]: INFO os_vif [None req-5882a5ae-b526-4f3f-b846-b6ed2a96e2de tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:b7:3c,bridge_name='br-int',has_traffic_filtering=True,id=83003593-cfc0-44d3-94c6-4e3fb90573bd,network=Network(a18f2224-ffb0-4406-9c92-5dad954c3a2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83003593-cf')
Aug 16 22:38:56 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-5882a5ae-b526-4f3f-b846-b6ed2a96e2de tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Deleting instance files /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0_del
Aug 16 22:38:56 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-5882a5ae-b526-4f3f-b846-b6ed2a96e2de tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Deletion of /opt/stack/data/nova/instances/9ea2a759-7a26-4ad6-9902-b8b75931b5f0_del complete
Aug 16 22:38:56 user nova-compute[72773]: INFO nova.compute.manager [None req-5882a5ae-b526-4f3f-b846-b6ed2a96e2de tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 16 22:38:56 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-5882a5ae-b526-4f3f-b846-b6ed2a96e2de tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:38:56 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:38:56 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:38:57 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Updating instance_info_cache with network_info: [{"id": "aa173151-ed37-4416-97d6-4bb197ad7396", "address": "fa:16:3e:f3:88:89", "network": {"id": "0567b846-3f19-403c-9ec6-ac2a82af5f4a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-290484898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a20f7a479ca4dbebe1ef08f466d2e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa173151-ed", "ovs_interfaceid": "aa173151-ed37-4416-97d6-4bb197ad7396", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:38:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-ac2b49e4-59bc-46cd-b7d9-67aa68296e4e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:38:57 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 22:38:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:57 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:38:57 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:38:57 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:38:57 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:38:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:38:57 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:38:57 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Took 1.04 seconds to deallocate network for instance.
Aug 16 22:38:57 user nova-compute[72773]: DEBUG nova.compute.manager [req-c1148919-27dc-47eb-99ef-c0e544f8b422 req-ca2f47c8-8fcd-4b6d-b4d2-0c3811712f7f service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received event network-vif-deleted-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:38:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5882a5ae-b526-4f3f-b846-b6ed2a96e2de tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5882a5ae-b526-4f3f-b846-b6ed2a96e2de tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-6dac34dc-cfbc-4809-949a-319570dc0334 req-9f4ed160-0b96-40e1-9f83-533f906c3cb7 service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received event network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:38:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6dac34dc-cfbc-4809-949a-319570dc0334 req-9f4ed160-0b96-40e1-9f83-533f906c3cb7 service nova] Acquiring lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6dac34dc-cfbc-4809-949a-319570dc0334 req-9f4ed160-0b96-40e1-9f83-533f906c3cb7 service nova] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6dac34dc-cfbc-4809-949a-319570dc0334 req-9f4ed160-0b96-40e1-9f83-533f906c3cb7 service nova] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-6dac34dc-cfbc-4809-949a-319570dc0334 req-9f4ed160-0b96-40e1-9f83-533f906c3cb7 service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] No waiting events found dispatching network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:38:58 user nova-compute[72773]: WARNING nova.compute.manager [req-6dac34dc-cfbc-4809-949a-319570dc0334 req-9f4ed160-0b96-40e1-9f83-533f906c3cb7 service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received unexpected event network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd for instance with vm_state deleted and task_state None.
Aug 16 22:38:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-6dac34dc-cfbc-4809-949a-319570dc0334 req-9f4ed160-0b96-40e1-9f83-533f906c3cb7 service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received event network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:38:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6dac34dc-cfbc-4809-949a-319570dc0334 req-9f4ed160-0b96-40e1-9f83-533f906c3cb7 service nova] Acquiring lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6dac34dc-cfbc-4809-949a-319570dc0334 req-9f4ed160-0b96-40e1-9f83-533f906c3cb7 service nova] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6dac34dc-cfbc-4809-949a-319570dc0334 req-9f4ed160-0b96-40e1-9f83-533f906c3cb7 service nova] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-6dac34dc-cfbc-4809-949a-319570dc0334 req-9f4ed160-0b96-40e1-9f83-533f906c3cb7 service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] No waiting events found dispatching network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:38:58 user nova-compute[72773]: WARNING nova.compute.manager [req-6dac34dc-cfbc-4809-949a-319570dc0334 req-9f4ed160-0b96-40e1-9f83-533f906c3cb7 service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received unexpected event network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd for instance with vm_state deleted and task_state None.
Aug 16 22:38:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-6dac34dc-cfbc-4809-949a-319570dc0334 req-9f4ed160-0b96-40e1-9f83-533f906c3cb7 service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received event network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:38:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6dac34dc-cfbc-4809-949a-319570dc0334 req-9f4ed160-0b96-40e1-9f83-533f906c3cb7 service nova] Acquiring lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6dac34dc-cfbc-4809-949a-319570dc0334 req-9f4ed160-0b96-40e1-9f83-533f906c3cb7 service nova] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6dac34dc-cfbc-4809-949a-319570dc0334 req-9f4ed160-0b96-40e1-9f83-533f906c3cb7 service nova] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-6dac34dc-cfbc-4809-949a-319570dc0334 req-9f4ed160-0b96-40e1-9f83-533f906c3cb7 service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] No waiting events found dispatching network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:38:58 user nova-compute[72773]: WARNING nova.compute.manager [req-6dac34dc-cfbc-4809-949a-319570dc0334 req-9f4ed160-0b96-40e1-9f83-533f906c3cb7 service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received unexpected event network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd for instance with vm_state deleted and task_state None.
Aug 16 22:38:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-6dac34dc-cfbc-4809-949a-319570dc0334 req-9f4ed160-0b96-40e1-9f83-533f906c3cb7 service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received event network-vif-unplugged-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:38:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6dac34dc-cfbc-4809-949a-319570dc0334 req-9f4ed160-0b96-40e1-9f83-533f906c3cb7 service nova] Acquiring lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6dac34dc-cfbc-4809-949a-319570dc0334 req-9f4ed160-0b96-40e1-9f83-533f906c3cb7 service nova] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6dac34dc-cfbc-4809-949a-319570dc0334 req-9f4ed160-0b96-40e1-9f83-533f906c3cb7 service nova] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-6dac34dc-cfbc-4809-949a-319570dc0334 req-9f4ed160-0b96-40e1-9f83-533f906c3cb7 service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] No waiting events found dispatching network-vif-unplugged-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:38:58 user nova-compute[72773]: WARNING nova.compute.manager [req-6dac34dc-cfbc-4809-949a-319570dc0334 req-9f4ed160-0b96-40e1-9f83-533f906c3cb7 service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received unexpected event network-vif-unplugged-83003593-cfc0-44d3-94c6-4e3fb90573bd for instance with vm_state deleted and task_state None.
Aug 16 22:38:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-6dac34dc-cfbc-4809-949a-319570dc0334 req-9f4ed160-0b96-40e1-9f83-533f906c3cb7 service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received event network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:38:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6dac34dc-cfbc-4809-949a-319570dc0334 req-9f4ed160-0b96-40e1-9f83-533f906c3cb7 service nova] Acquiring lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:38:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6dac34dc-cfbc-4809-949a-319570dc0334 req-9f4ed160-0b96-40e1-9f83-533f906c3cb7 service nova] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:38:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6dac34dc-cfbc-4809-949a-319570dc0334 req-9f4ed160-0b96-40e1-9f83-533f906c3cb7 service nova] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-6dac34dc-cfbc-4809-949a-319570dc0334 req-9f4ed160-0b96-40e1-9f83-533f906c3cb7 service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] No waiting events found dispatching network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:38:58 user nova-compute[72773]: WARNING nova.compute.manager [req-6dac34dc-cfbc-4809-949a-319570dc0334 req-9f4ed160-0b96-40e1-9f83-533f906c3cb7 service nova] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Received unexpected event network-vif-plugged-83003593-cfc0-44d3-94c6-4e3fb90573bd for instance with vm_state deleted and task_state None.
Aug 16 22:38:58 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-5882a5ae-b526-4f3f-b846-b6ed2a96e2de tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:38:58 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-5882a5ae-b526-4f3f-b846-b6ed2a96e2de tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:38:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5882a5ae-b526-4f3f-b846-b6ed2a96e2de tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.509s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:58 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-5882a5ae-b526-4f3f-b846-b6ed2a96e2de tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Deleted allocations for instance 9ea2a759-7a26-4ad6-9902-b8b75931b5f0
Aug 16 22:38:58 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:38:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5882a5ae-b526-4f3f-b846-b6ed2a96e2de tempest-ServerStableDeviceRescueTest-1505608702 tempest-ServerStableDeviceRescueTest-1505608702-project-member] Lock "9ea2a759-7a26-4ad6-9902-b8b75931b5f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.671s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:38:59 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:39:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:00 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:39:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:39:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:39:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:39:00 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:39:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:01 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:39:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:01 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:39:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c59217c-22f8-4745-b05e-53300ca454f2/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c59217c-22f8-4745-b05e-53300ca454f2/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c59217c-22f8-4745-b05e-53300ca454f2/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c59217c-22f8-4745-b05e-53300ca454f2/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:39:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:04 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:39:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a246c1-b2a7-4048-a6c9-235c15079d39/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a246c1-b2a7-4048-a6c9-235c15079d39/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a246c1-b2a7-4048-a6c9-235c15079d39/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a246c1-b2a7-4048-a6c9-235c15079d39/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:05 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:39:05 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:39:05 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=7044MB free_disk=25.281051635742188GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:39:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:39:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:39:05 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Applying migration context for instance 23894101-2fd3-41a4-83a3-8f6869d24d97 as it has an incoming, in-progress migration 1b92ace4-bf05-425a-9f60-0add43adbfcd. Migration status is finished {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 22:39:05 user nova-compute[72773]: INFO nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Updating resource usage from migration 1b92ace4-bf05-425a-9f60-0add43adbfcd
Aug 16 22:39:05 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 956d334e-f190-4625-b144-ab44d2f3321a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:39:05 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 030d076d-5099-4236-ae31-6025017eb51e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:39:05 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance ac2b49e4-59bc-46cd-b7d9-67aa68296e4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:39:05 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 391a6006-4fe6-4398-a1e8-ae95b5edbf2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:39:05 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance cf01c401-c424-4b3e-aa5b-439d62b1ae4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:39:05 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 5ebcd117-6765-44eb-871b-226afd58e4e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:39:05 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance f4210738-d01e-4408-a15c-aeccada6dd23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:39:05 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 16a246c1-b2a7-4048-a6c9-235c15079d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:39:05 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 2c59217c-22f8-4745-b05e-53300ca454f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:39:05 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Migration 1b92ace4-bf05-425a-9f60-0add43adbfcd is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 22:39:05 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 7cf275ce-0647-43af-ad03-24cbac934b59 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:39:05 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 23894101-2fd3-41a4-83a3-8f6869d24d97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:39:05 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 05f47c14-f17f-43d9-b607-bccc9a0c3957 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:39:05 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:39:05 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:39:05 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:39:05 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:39:05 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:39:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.554s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:39:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:08 user nova-compute[72773]: DEBUG nova.network.neutron [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Port 5725a1df-f51f-4ba4-99f7-777975663b2e binding to destination host user is already ACTIVE {{(pid=72773) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 16 22:39:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Acquiring lock "refresh_cache-23894101-2fd3-41a4-83a3-8f6869d24d97" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:39:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Acquired lock "refresh_cache-23894101-2fd3-41a4-83a3-8f6869d24d97" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:39:08 user nova-compute[72773]: DEBUG nova.network.neutron [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:39:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:10 user nova-compute[72773]: DEBUG nova.network.neutron [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Updating instance_info_cache with network_info: [{"id": "5725a1df-f51f-4ba4-99f7-777975663b2e", "address": "fa:16:3e:98:fa:bf", "network": {"id": "00744c2a-d566-47bc-abeb-8e9bc9ab312d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-384143120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cafc1d829ed749c2bfe35f7bc58e331c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5725a1df-f5", "ovs_interfaceid": "5725a1df-f51f-4ba4-99f7-777975663b2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:39:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Releasing lock "refresh_cache-23894101-2fd3-41a4-83a3-8f6869d24d97" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:39:10 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Creating tmpfile /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/tmpyeca9cuj to verify with other compute node that the instance is on the same shared storage. {{(pid=72773) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 16 22:39:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:10 user nova-compute[72773]: DEBUG nova.compute.manager [req-82a235b5-c01e-4a44-8432-58d94fceb389 req-706d7e4f-2067-4502-ac84-2d1fd46ec526 service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Received event network-vif-unplugged-5725a1df-f51f-4ba4-99f7-777975663b2e {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:39:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-82a235b5-c01e-4a44-8432-58d94fceb389 req-706d7e4f-2067-4502-ac84-2d1fd46ec526 service nova] Acquiring lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:39:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-82a235b5-c01e-4a44-8432-58d94fceb389 req-706d7e4f-2067-4502-ac84-2d1fd46ec526 service nova] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:39:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-82a235b5-c01e-4a44-8432-58d94fceb389 req-706d7e4f-2067-4502-ac84-2d1fd46ec526 service nova] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:39:10 user nova-compute[72773]: DEBUG nova.compute.manager [req-82a235b5-c01e-4a44-8432-58d94fceb389 req-706d7e4f-2067-4502-ac84-2d1fd46ec526 service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] No waiting events found dispatching network-vif-unplugged-5725a1df-f51f-4ba4-99f7-777975663b2e {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:39:10 user nova-compute[72773]: WARNING nova.compute.manager [req-82a235b5-c01e-4a44-8432-58d94fceb389 req-706d7e4f-2067-4502-ac84-2d1fd46ec526 service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Received unexpected event network-vif-unplugged-5725a1df-f51f-4ba4-99f7-777975663b2e for instance with vm_state resized and task_state resize_reverting.
Aug 16 22:39:11 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Instance destroyed successfully.
Aug 16 22:39:11 user nova-compute[72773]: DEBUG nova.objects.instance [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lazy-loading 'resources' on Instance uuid 23894101-2fd3-41a4-83a3-8f6869d24d97 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:33:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2107689448',display_name='tempest-ServerActionsTestOtherB-server-2107689448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2107689448',id=26,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh1GymZbw24IcnH5dONTb6loGV9Z6Plyeb2rJeaUseM4wpzMr4OTPGkSKihakM6H3XgBNMxcd+thJYbV9RDvja0dJb4k7n+wBitov4O9EMqeBt9unfmT2aB8P/P3aCmCA==',key_name='tempest-keypair-1176159006',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:37:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cafc1d829ed749c2bfe35f7bc58e331c',ramdisk_id='',reservation_id='r-sdzz0nnk',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1140735028',owner_user_name='tempest-ServerActionsTestOtherB-1140735028-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:37:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cdb4ae56354496ab9e3f71461bd9d6d',uuid=23894101-2fd3-41a4-83a3-8f6869d24d97,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "5725a1df-f51f-4ba4-99f7-777975663b2e", "address": "fa:16:3e:98:fa:bf", "network": {"id": "00744c2a-d566-47bc-abeb-8e9bc9ab312d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-384143120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cafc1d829ed749c2bfe35f7bc58e331c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5725a1df-f5", "ovs_interfaceid": "5725a1df-f51f-4ba4-99f7-777975663b2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Converting VIF {"id": "5725a1df-f51f-4ba4-99f7-777975663b2e", "address": "fa:16:3e:98:fa:bf", "network": {"id": "00744c2a-d566-47bc-abeb-8e9bc9ab312d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-384143120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cafc1d829ed749c2bfe35f7bc58e331c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5725a1df-f5", "ovs_interfaceid": "5725a1df-f51f-4ba4-99f7-777975663b2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:fa:bf,bridge_name='br-int',has_traffic_filtering=True,id=5725a1df-f51f-4ba4-99f7-777975663b2e,network=Network(00744c2a-d566-47bc-abeb-8e9bc9ab312d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5725a1df-f5') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG os_vif [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:fa:bf,bridge_name='br-int',has_traffic_filtering=True,id=5725a1df-f51f-4ba4-99f7-777975663b2e,network=Network(00744c2a-d566-47bc-abeb-8e9bc9ab312d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5725a1df-f5') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5725a1df-f5, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:39:11 user nova-compute[72773]: INFO os_vif [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:fa:bf,bridge_name='br-int',has_traffic_filtering=True,id=5725a1df-f51f-4ba4-99f7-777975663b2e,network=Network(00744c2a-d566-47bc-abeb-8e9bc9ab312d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5725a1df-f5')
Aug 16 22:39:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yDKPldmU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:39:11 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:39:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff315c5-d2f7-4418-b2e2-d368715454fd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b0cebe-275e-4a0e-99a5-36822886008d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:39:11 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:39:11 user nova-compute[72773]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)
Aug 16 22:39:11 user nova-compute[72773]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:39:11 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:39:11 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:39:11 user nova-compute[72773]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)
Aug 16 22:39:11 user nova-compute[72773]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:39:11 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef802bb2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d'): ({'sdg'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Removing single pathed devices sdg {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bb7655-01e5-4b3c-ab7e-fe6cbd860476]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG nova.compute.manager [req-03adce42-72cd-4cf8-85cf-0da67d3b316f req-f3792659-a1b9-48f4-9fce-4f823055f49a service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Received event network-changed-ef9aad5b-2373-47b5-910b-8664d08e5df5 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG nova.compute.manager [req-03adce42-72cd-4cf8-85cf-0da67d3b316f req-f3792659-a1b9-48f4-9fce-4f823055f49a service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Refreshing instance network info cache due to event network-changed-ef9aad5b-2373-47b5-910b-8664d08e5df5. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-03adce42-72cd-4cf8-85cf-0da67d3b316f req-f3792659-a1b9-48f4-9fce-4f823055f49a service nova] Acquiring lock "refresh_cache-7cf275ce-0647-43af-ad03-24cbac934b59" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-03adce42-72cd-4cf8-85cf-0da67d3b316f req-f3792659-a1b9-48f4-9fce-4f823055f49a service nova] Acquired lock "refresh_cache-7cf275ce-0647-43af-ad03-24cbac934b59" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG nova.network.neutron [req-03adce42-72cd-4cf8-85cf-0da67d3b316f req-f3792659-a1b9-48f4-9fce-4f823055f49a service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Refreshing network info cache for port ef9aad5b-2373-47b5-910b-8664d08e5df5 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.031s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[656d9536-677e-4b04-b957-92210b088ac2]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Flushing IO for device /dev/sdg {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd4db84-7d83-49d9-824d-6189b404fab4]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.058s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f96f97-d90a-43e0-8d42-2c0f75169a23]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] SCSI volumes sdg have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a3660c-b796-4ce9-922b-0d92787b5bca]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692225536.590238, 9ea2a759-7a26-4ad6-9902-b8b75931b5f0 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:39:11 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] VM Stopped (Lifecycle Event)
Aug 16 22:39:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a853e914-ad6e-4926-b83d-7ed3f93585d1]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d, portal: 172.16.0.220,3260]
Aug 16 22:39:11 user nova-compute[72773]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d, portal: 172.16.0.220,3260] successful.
Aug 16 22:39:11 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG nova.compute.manager [None req-058a6cf4-5e1f-43d5-9cf7-9b8caca8a9d7 None None] [instance: 9ea2a759-7a26-4ad6-9902-b8b75931b5f0] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f68bce2-5e0e-46ab-b9fc-222a38cbd97b]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] <== disconnect_volume: return (405ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG nova.network.neutron [req-03adce42-72cd-4cf8-85cf-0da67d3b316f req-f3792659-a1b9-48f4-9fce-4f823055f49a service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Updated VIF entry in instance network info cache for port ef9aad5b-2373-47b5-910b-8664d08e5df5. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG nova.network.neutron [req-03adce42-72cd-4cf8-85cf-0da67d3b316f req-f3792659-a1b9-48f4-9fce-4f823055f49a service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Updating instance_info_cache with network_info: [{"id": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "address": "fa:16:3e:11:03:33", "network": {"id": "09f1ea90-9baf-4dc6-965e-30b89fa0557d", "bridge": "br-int", "label": "tempest-TestShelveInstance-375734384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "128365b541d848b4a369bdb73a357786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9aad5b-23", "ovs_interfaceid": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-03adce42-72cd-4cf8-85cf-0da67d3b316f req-f3792659-a1b9-48f4-9fce-4f823055f49a service nova] Releasing lock "refresh_cache-7cf275ce-0647-43af-ad03-24cbac934b59" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:39:11 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:39:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Acquiring lock "7cf275ce-0647-43af-ad03-24cbac934b59" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:39:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lock "7cf275ce-0647-43af-ad03-24cbac934b59" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:39:12 user nova-compute[72773]: INFO nova.compute.manager [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Shelve offloading
Aug 16 22:39:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:12 user nova-compute[72773]: DEBUG nova.compute.manager [req-290c23e2-d268-4f69-82b3-508d5b8b13d8 req-bbd91b0a-a043-4a76-8fd0-71e06ace8781 service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Received event network-vif-plugged-5725a1df-f51f-4ba4-99f7-777975663b2e {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:39:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-290c23e2-d268-4f69-82b3-508d5b8b13d8 req-bbd91b0a-a043-4a76-8fd0-71e06ace8781 service nova] Acquiring lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:39:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-290c23e2-d268-4f69-82b3-508d5b8b13d8 req-bbd91b0a-a043-4a76-8fd0-71e06ace8781 service nova] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:39:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-290c23e2-d268-4f69-82b3-508d5b8b13d8 req-bbd91b0a-a043-4a76-8fd0-71e06ace8781 service nova] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:39:12 user nova-compute[72773]: DEBUG nova.compute.manager [req-290c23e2-d268-4f69-82b3-508d5b8b13d8 req-bbd91b0a-a043-4a76-8fd0-71e06ace8781 service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] No waiting events found dispatching network-vif-plugged-5725a1df-f51f-4ba4-99f7-777975663b2e {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:39:12 user nova-compute[72773]: WARNING nova.compute.manager [req-290c23e2-d268-4f69-82b3-508d5b8b13d8 req-bbd91b0a-a043-4a76-8fd0-71e06ace8781 service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Received unexpected event network-vif-plugged-5725a1df-f51f-4ba4-99f7-777975663b2e for instance with vm_state resized and task_state resize_reverting.
Aug 16 22:39:12 user nova-compute[72773]: DEBUG nova.compute.manager [req-290c23e2-d268-4f69-82b3-508d5b8b13d8 req-bbd91b0a-a043-4a76-8fd0-71e06ace8781 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Received event network-vif-unplugged-ef9aad5b-2373-47b5-910b-8664d08e5df5 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:39:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-290c23e2-d268-4f69-82b3-508d5b8b13d8 req-bbd91b0a-a043-4a76-8fd0-71e06ace8781 service nova] Acquiring lock "7cf275ce-0647-43af-ad03-24cbac934b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:39:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-290c23e2-d268-4f69-82b3-508d5b8b13d8 req-bbd91b0a-a043-4a76-8fd0-71e06ace8781 service nova] Lock "7cf275ce-0647-43af-ad03-24cbac934b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:39:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-290c23e2-d268-4f69-82b3-508d5b8b13d8 req-bbd91b0a-a043-4a76-8fd0-71e06ace8781 service nova] Lock "7cf275ce-0647-43af-ad03-24cbac934b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:39:12 user nova-compute[72773]: DEBUG nova.compute.manager [req-290c23e2-d268-4f69-82b3-508d5b8b13d8 req-bbd91b0a-a043-4a76-8fd0-71e06ace8781 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] No waiting events found dispatching network-vif-unplugged-ef9aad5b-2373-47b5-910b-8664d08e5df5 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:39:12 user nova-compute[72773]: WARNING nova.compute.manager [req-290c23e2-d268-4f69-82b3-508d5b8b13d8 req-bbd91b0a-a043-4a76-8fd0-71e06ace8781 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Received unexpected event network-vif-unplugged-ef9aad5b-2373-47b5-910b-8664d08e5df5 for instance with vm_state active and task_state shelving.
Aug 16 22:39:12 user nova-compute[72773]: DEBUG nova.compute.manager [req-290c23e2-d268-4f69-82b3-508d5b8b13d8 req-bbd91b0a-a043-4a76-8fd0-71e06ace8781 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Received event network-vif-plugged-ef9aad5b-2373-47b5-910b-8664d08e5df5 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:39:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-290c23e2-d268-4f69-82b3-508d5b8b13d8 req-bbd91b0a-a043-4a76-8fd0-71e06ace8781 service nova] Acquiring lock "7cf275ce-0647-43af-ad03-24cbac934b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:39:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-290c23e2-d268-4f69-82b3-508d5b8b13d8 req-bbd91b0a-a043-4a76-8fd0-71e06ace8781 service nova] Lock "7cf275ce-0647-43af-ad03-24cbac934b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:39:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-290c23e2-d268-4f69-82b3-508d5b8b13d8 req-bbd91b0a-a043-4a76-8fd0-71e06ace8781 service nova] Lock "7cf275ce-0647-43af-ad03-24cbac934b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:39:12 user nova-compute[72773]: DEBUG nova.compute.manager [req-290c23e2-d268-4f69-82b3-508d5b8b13d8 req-bbd91b0a-a043-4a76-8fd0-71e06ace8781 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] No waiting events found dispatching network-vif-plugged-ef9aad5b-2373-47b5-910b-8664d08e5df5 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:39:12 user nova-compute[72773]: WARNING nova.compute.manager [req-290c23e2-d268-4f69-82b3-508d5b8b13d8 req-bbd91b0a-a043-4a76-8fd0-71e06ace8781 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Received unexpected event network-vif-plugged-ef9aad5b-2373-47b5-910b-8664d08e5df5 for instance with vm_state active and task_state shelving.
Aug 16 22:39:12 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Instance destroyed successfully.
Aug 16 22:39:12 user nova-compute[72773]: DEBUG nova.compute.manager [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:39:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Acquiring lock "refresh_cache-7cf275ce-0647-43af-ad03-24cbac934b59" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:39:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Acquired lock "refresh_cache-7cf275ce-0647-43af-ad03-24cbac934b59" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:39:12 user nova-compute[72773]: DEBUG nova.network.neutron [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:39:13 user nova-compute[72773]: DEBUG nova.network.neutron [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Updating instance_info_cache with network_info: [{"id": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "address": "fa:16:3e:11:03:33", "network": {"id": "09f1ea90-9baf-4dc6-965e-30b89fa0557d", "bridge": "br-int", "label": "tempest-TestShelveInstance-375734384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "128365b541d848b4a369bdb73a357786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9aad5b-23", "ovs_interfaceid": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:39:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Releasing lock "refresh_cache-7cf275ce-0647-43af-ad03-24cbac934b59" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:39:14 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Instance destroyed successfully.
Aug 16 22:39:14 user nova-compute[72773]: DEBUG nova.objects.instance [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lazy-loading 'resources' on Instance uuid 7cf275ce-0647-43af-ad03-24cbac934b59 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:37:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1525734974',display_name='tempest-TestShelveInstance-server-1525734974',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1525734974',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXQBASS0jXrxI3OGcv7vu4DdfXzpmoqsRvSbmQ6vxACy0aQ5iheigPnMtUaevvjo5jGI3reLnnhACND3PPyJAWWWf8sEZP9M76YWibt3G9R/QtnNRpsjmPAUnUPnW3dlQ==',key_name='tempest-TestShelveInstance-631846690',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:37:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='128365b541d848b4a369bdb73a357786',ramdisk_id='',reservation_id='r-ppxqqatm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1515246832',owner_user_name='tempest-TestShelveInstance-1515246832-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:37:42Z,user_data=None,user_id='6e5f5ea155144f91886018bc0057e13b',uuid=7cf275ce-0647-43af-ad03-24cbac934b59,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "address": "fa:16:3e:11:03:33", "network": {"id": "09f1ea90-9baf-4dc6-965e-30b89fa0557d", "bridge": "br-int", "label": "tempest-TestShelveInstance-375734384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "128365b541d848b4a369bdb73a357786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9aad5b-23", "ovs_interfaceid": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Converting VIF {"id": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "address": "fa:16:3e:11:03:33", "network": {"id": "09f1ea90-9baf-4dc6-965e-30b89fa0557d", "bridge": "br-int", "label": "tempest-TestShelveInstance-375734384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "128365b541d848b4a369bdb73a357786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9aad5b-23", "ovs_interfaceid": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:03:33,bridge_name='br-int',has_traffic_filtering=True,id=ef9aad5b-2373-47b5-910b-8664d08e5df5,network=Network(09f1ea90-9baf-4dc6-965e-30b89fa0557d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef9aad5b-23') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG os_vif [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:03:33,bridge_name='br-int',has_traffic_filtering=True,id=ef9aad5b-2373-47b5-910b-8664d08e5df5,network=Network(09f1ea90-9baf-4dc6-965e-30b89fa0557d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef9aad5b-23') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG nova.compute.manager [req-6bdb61c2-8be9-4a9a-b8eb-85b81a2342db req-d4fdc211-e225-41d9-b7bb-4aa21719a715 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Received event network-changed-ef9aad5b-2373-47b5-910b-8664d08e5df5 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG nova.compute.manager [req-6bdb61c2-8be9-4a9a-b8eb-85b81a2342db req-d4fdc211-e225-41d9-b7bb-4aa21719a715 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Refreshing instance network info cache due to event network-changed-ef9aad5b-2373-47b5-910b-8664d08e5df5. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6bdb61c2-8be9-4a9a-b8eb-85b81a2342db req-d4fdc211-e225-41d9-b7bb-4aa21719a715 service nova] Acquiring lock "refresh_cache-7cf275ce-0647-43af-ad03-24cbac934b59" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6bdb61c2-8be9-4a9a-b8eb-85b81a2342db req-d4fdc211-e225-41d9-b7bb-4aa21719a715 service nova] Acquired lock "refresh_cache-7cf275ce-0647-43af-ad03-24cbac934b59" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG nova.network.neutron [req-6bdb61c2-8be9-4a9a-b8eb-85b81a2342db req-d4fdc211-e225-41d9-b7bb-4aa21719a715 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Refreshing network info cache for port ef9aad5b-2373-47b5-910b-8664d08e5df5 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef9aad5b-23, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:39:14 user nova-compute[72773]: INFO os_vif [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:03:33,bridge_name='br-int',has_traffic_filtering=True,id=ef9aad5b-2373-47b5-910b-8664d08e5df5,network=Network(09f1ea90-9baf-4dc6-965e-30b89fa0557d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef9aad5b-23')
Aug 16 22:39:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YszrhEio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:39:14 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:39:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c344de-dca8-4f4c-baa4-91079b7aa7ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa1bef0-1ba3-488e-bb88-756d0ebb8008]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:39:14 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:39:14 user nova-compute[72773]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)
Aug 16 22:39:14 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:39:14 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:39:14 user nova-compute[72773]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)
Aug 16 22:39:14 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef5c3e1ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca'): ({'sdf'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Removing single pathed devices sdf {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2806a5a4-8471-476d-b767-1fe95f517acd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.033s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b752700d-8461-4be6-b995-da653f5c0f56]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Flushing IO for device /dev/sdf {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ad9b9b-0ae1-4ea9-b801-1f41892ce84e]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb4f92d-f513-4a41-a736-5bcc561c651f]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] SCSI volumes sdf have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[284ff29e-5830-43b5-aa16-cd86e720378e]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf356a4a-0771-4459-b7e2-01756ab6d35d]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca, portal: 172.16.0.220,3260]
Aug 16 22:39:14 user nova-compute[72773]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca, portal: 172.16.0.220,3260] successful.
Aug 16 22:39:14 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb58c24-f7ad-409c-8b63-bb5e6ded4d46]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] <== disconnect_volume: return (314ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:39:14 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Deleting instance files /opt/stack/data/nova/instances/7cf275ce-0647-43af-ad03-24cbac934b59_del
Aug 16 22:39:14 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Deletion of /opt/stack/data/nova/instances/7cf275ce-0647-43af-ad03-24cbac934b59_del complete
Aug 16 22:39:14 user nova-compute[72773]: DEBUG nova.network.neutron [req-6bdb61c2-8be9-4a9a-b8eb-85b81a2342db req-d4fdc211-e225-41d9-b7bb-4aa21719a715 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Updated VIF entry in instance network info cache for port ef9aad5b-2373-47b5-910b-8664d08e5df5. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG nova.network.neutron [req-6bdb61c2-8be9-4a9a-b8eb-85b81a2342db req-d4fdc211-e225-41d9-b7bb-4aa21719a715 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Updating instance_info_cache with network_info: [{"id": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "address": "fa:16:3e:11:03:33", "network": {"id": "09f1ea90-9baf-4dc6-965e-30b89fa0557d", "bridge": null, "label": "tempest-TestShelveInstance-375734384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "128365b541d848b4a369bdb73a357786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapef9aad5b-23", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:39:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6bdb61c2-8be9-4a9a-b8eb-85b81a2342db req-d4fdc211-e225-41d9-b7bb-4aa21719a715 service nova] Releasing lock "refresh_cache-7cf275ce-0647-43af-ad03-24cbac934b59" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:39:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:15 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Deleted allocations for instance 7cf275ce-0647-43af-ad03-24cbac934b59
Aug 16 22:39:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:39:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:39:15 user nova-compute[72773]: DEBUG nova.objects.instance [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lazy-loading 'numa_topology' on Instance uuid 7cf275ce-0647-43af-ad03-24cbac934b59 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:39:16 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:39:16 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:39:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.560s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:39:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-129639ef-a822-404a-804c-b7c280fe9dd6 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lock "7cf275ce-0647-43af-ad03-24cbac934b59" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.478s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:39:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:39:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:39:19 user nova-compute[72773]: DEBUG nova.objects.instance [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lazy-loading 'migration_context' on Instance uuid 23894101-2fd3-41a4-83a3-8f6869d24d97 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:39:20 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:39:20 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:39:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.610s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:39:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:20 user nova-compute[72773]: INFO nova.compute.manager [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Swapping old allocation on dict_keys(['03cd1900-3798-4f8f-b4d5-3eec5ac6735e']) held by migration 1b92ace4-bf05-425a-9f60-0add43adbfcd for instance
Aug 16 22:39:20 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Overwriting current allocation {'allocations': {'03cd1900-3798-4f8f-b4d5-3eec5ac6735e': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 40}}, 'project_id': 'cafc1d829ed749c2bfe35f7bc58e331c', 'user_id': '7cdb4ae56354496ab9e3f71461bd9d6d', 'consumer_generation': 1} on consumer 23894101-2fd3-41a4-83a3-8f6869d24d97 {{(pid=72773) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 16 22:39:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Acquiring lock "refresh_cache-23894101-2fd3-41a4-83a3-8f6869d24d97" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:39:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Acquired lock "refresh_cache-23894101-2fd3-41a4-83a3-8f6869d24d97" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:39:20 user nova-compute[72773]: DEBUG nova.network.neutron [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:39:21 user nova-compute[72773]: DEBUG nova.network.neutron [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Updating instance_info_cache with network_info: [{"id": "5725a1df-f51f-4ba4-99f7-777975663b2e", "address": "fa:16:3e:98:fa:bf", "network": {"id": "00744c2a-d566-47bc-abeb-8e9bc9ab312d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-384143120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cafc1d829ed749c2bfe35f7bc58e331c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5725a1df-f5", "ovs_interfaceid": "5725a1df-f51f-4ba4-99f7-777975663b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:39:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Releasing lock "refresh_cache-23894101-2fd3-41a4-83a3-8f6869d24d97" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:39:21 user nova-compute[72773]: DEBUG os_brick.utils [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:39:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd20d863-0f70-475e-a700-088168c1e4e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:39:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5ee52d-8da4-4b73-9a86-95d484458ada]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:39:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[902d3412-3b31-4fe3-9785-e8317a29cc9f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:39:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b91ce9-7e6d-41c3-bc2b-6fa8108ff86c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:39:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:39:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:39:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:39:21 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:39:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac11f9b-035f-46a3-9199-986c454bd04b]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:39:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:39:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:39:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:39:21 user nova-compute[72773]: DEBUG os_brick.utils [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:39:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7ac6d581-060d-450c-b4a4-71da7cbb1b29 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "16a246c1-b2a7-4048-a6c9-235c15079d39" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:39:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7ac6d581-060d-450c-b4a4-71da7cbb1b29 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "16a246c1-b2a7-4048-a6c9-235c15079d39" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:39:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7ac6d581-060d-450c-b4a4-71da7cbb1b29 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "16a246c1-b2a7-4048-a6c9-235c15079d39-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:39:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7ac6d581-060d-450c-b4a4-71da7cbb1b29 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "16a246c1-b2a7-4048-a6c9-235c15079d39-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:39:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7ac6d581-060d-450c-b4a4-71da7cbb1b29 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "16a246c1-b2a7-4048-a6c9-235c15079d39-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:39:22 user nova-compute[72773]: INFO nova.compute.manager [None req-7ac6d581-060d-450c-b4a4-71da7cbb1b29 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Terminating instance
Aug 16 22:39:22 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7ac6d581-060d-450c-b4a4-71da7cbb1b29 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:39:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:23 user nova-compute[72773]: DEBUG nova.compute.manager [req-ecb776d0-9dbf-419d-bc83-8d5e301da261 req-09e7bbe5-a677-4deb-af68-0dc96707f5d2 service nova] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Received event network-vif-unplugged-1741e52a-4fe9-4496-9c8b-56f3e1816fc3 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:39:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ecb776d0-9dbf-419d-bc83-8d5e301da261 req-09e7bbe5-a677-4deb-af68-0dc96707f5d2 service nova] Acquiring lock "16a246c1-b2a7-4048-a6c9-235c15079d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:39:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ecb776d0-9dbf-419d-bc83-8d5e301da261 req-09e7bbe5-a677-4deb-af68-0dc96707f5d2 service nova] Lock "16a246c1-b2a7-4048-a6c9-235c15079d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:39:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ecb776d0-9dbf-419d-bc83-8d5e301da261 req-09e7bbe5-a677-4deb-af68-0dc96707f5d2 service nova] Lock "16a246c1-b2a7-4048-a6c9-235c15079d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:39:23 user nova-compute[72773]: DEBUG nova.compute.manager [req-ecb776d0-9dbf-419d-bc83-8d5e301da261 req-09e7bbe5-a677-4deb-af68-0dc96707f5d2 service nova] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] No waiting events found dispatching network-vif-unplugged-1741e52a-4fe9-4496-9c8b-56f3e1816fc3 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:39:23 user nova-compute[72773]: DEBUG nova.compute.manager [req-ecb776d0-9dbf-419d-bc83-8d5e301da261 req-09e7bbe5-a677-4deb-af68-0dc96707f5d2 service nova] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Received event network-vif-unplugged-1741e52a-4fe9-4496-9c8b-56f3e1816fc3 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:39:23 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Instance destroyed successfully.
Aug 16 22:39:23 user nova-compute[72773]: DEBUG nova.objects.instance [None req-7ac6d581-060d-450c-b4a4-71da7cbb1b29 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lazy-loading 'resources' on Instance uuid 16a246c1-b2a7-4048-a6c9-235c15079d39 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:39:23 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-7ac6d581-060d-450c-b4a4-71da7cbb1b29 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:36:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1953913998',display_name='tempest-AttachVolumeNegativeTest-server-1953913998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1953913998',id=31,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9l9BaYSJopFVFDCOpQIaJmrA/aja2j7cOKKuESW6m+ej5Zoq5cgl+EV6ljXwb+A8w1tMOOpUty590k6uFQJJ+DIMNSddgzXX0nY/X8aPm2wNN1L8B3P10SkqEtG9nBPw==',key_name='tempest-keypair-1302603800',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:36:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc49739a140d40508ea307eedceb9aaa',ramdisk_id='',reservation_id='r-nk9y2me7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-801754299',owner_user_name='tempest-AttachVolumeNegativeTest-801754299-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:36:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3b873f599fc4a2686c154d856bd5f06',uuid=16a246c1-b2a7-4048-a6c9-235c15079d39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1741e52a-4fe9-4496-9c8b-56f3e1816fc3", "address": "fa:16:3e:7d:dd:e5", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1741e52a-4f", "ovs_interfaceid": "1741e52a-4fe9-4496-9c8b-56f3e1816fc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:39:23 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-7ac6d581-060d-450c-b4a4-71da7cbb1b29 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Converting VIF {"id": "1741e52a-4fe9-4496-9c8b-56f3e1816fc3", "address": "fa:16:3e:7d:dd:e5", "network": {"id": "e0974c13-ec74-4a35-95b4-afae254c04a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-891882692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc49739a140d40508ea307eedceb9aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1741e52a-4f", "ovs_interfaceid": "1741e52a-4fe9-4496-9c8b-56f3e1816fc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:39:23 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-7ac6d581-060d-450c-b4a4-71da7cbb1b29 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:dd:e5,bridge_name='br-int',has_traffic_filtering=True,id=1741e52a-4fe9-4496-9c8b-56f3e1816fc3,network=Network(e0974c13-ec74-4a35-95b4-afae254c04a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1741e52a-4f') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:39:23 user nova-compute[72773]: DEBUG os_vif [None req-7ac6d581-060d-450c-b4a4-71da7cbb1b29 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:dd:e5,bridge_name='br-int',has_traffic_filtering=True,id=1741e52a-4fe9-4496-9c8b-56f3e1816fc3,network=Network(e0974c13-ec74-4a35-95b4-afae254c04a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1741e52a-4f') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:39:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1741e52a-4f, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:39:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:23 user nova-compute[72773]: INFO os_vif [None req-7ac6d581-060d-450c-b4a4-71da7cbb1b29 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:dd:e5,bridge_name='br-int',has_traffic_filtering=True,id=1741e52a-4fe9-4496-9c8b-56f3e1816fc3,network=Network(e0974c13-ec74-4a35-95b4-afae254c04a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1741e52a-4f')
Aug 16 22:39:23 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-7ac6d581-060d-450c-b4a4-71da7cbb1b29 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Deleting instance files /opt/stack/data/nova/instances/16a246c1-b2a7-4048-a6c9-235c15079d39_del
Aug 16 22:39:23 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-7ac6d581-060d-450c-b4a4-71da7cbb1b29 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Deletion of /opt/stack/data/nova/instances/16a246c1-b2a7-4048-a6c9-235c15079d39_del complete
Aug 16 22:39:23 user nova-compute[72773]: INFO nova.compute.manager [None req-7ac6d581-060d-450c-b4a4-71da7cbb1b29 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 16 22:39:23 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-7ac6d581-060d-450c-b4a4-71da7cbb1b29 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:39:23 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:39:23 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:39:24 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:39:24 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Took 0.90 seconds to deallocate network for instance.
Aug 16 22:39:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7ac6d581-060d-450c-b4a4-71da7cbb1b29 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:39:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7ac6d581-060d-450c-b4a4-71da7cbb1b29 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:39:24 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-7ac6d581-060d-450c-b4a4-71da7cbb1b29 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:39:24 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-7ac6d581-060d-450c-b4a4-71da7cbb1b29 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:39:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7ac6d581-060d-450c-b4a4-71da7cbb1b29 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:39:25 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-7ac6d581-060d-450c-b4a4-71da7cbb1b29 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Deleted allocations for instance 16a246c1-b2a7-4048-a6c9-235c15079d39
Aug 16 22:39:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7ac6d581-060d-450c-b4a4-71da7cbb1b29 tempest-AttachVolumeNegativeTest-801754299 tempest-AttachVolumeNegativeTest-801754299-project-member] Lock "16a246c1-b2a7-4048-a6c9-235c15079d39" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.294s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:39:25 user nova-compute[72773]: DEBUG nova.compute.manager [req-3202e409-832f-49ee-aa95-05dee663cff6 req-dd56c242-8d51-4e63-a477-110bcbfbccbe service nova] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Received event network-vif-plugged-1741e52a-4fe9-4496-9c8b-56f3e1816fc3 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:39:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3202e409-832f-49ee-aa95-05dee663cff6 req-dd56c242-8d51-4e63-a477-110bcbfbccbe service nova] Acquiring lock "16a246c1-b2a7-4048-a6c9-235c15079d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:39:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3202e409-832f-49ee-aa95-05dee663cff6 req-dd56c242-8d51-4e63-a477-110bcbfbccbe service nova] Lock "16a246c1-b2a7-4048-a6c9-235c15079d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:39:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3202e409-832f-49ee-aa95-05dee663cff6 req-dd56c242-8d51-4e63-a477-110bcbfbccbe service nova] Lock "16a246c1-b2a7-4048-a6c9-235c15079d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:39:25 user nova-compute[72773]: DEBUG nova.compute.manager [req-3202e409-832f-49ee-aa95-05dee663cff6 req-dd56c242-8d51-4e63-a477-110bcbfbccbe service nova] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] No waiting events found dispatching network-vif-plugged-1741e52a-4fe9-4496-9c8b-56f3e1816fc3 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:39:25 user nova-compute[72773]: WARNING nova.compute.manager [req-3202e409-832f-49ee-aa95-05dee663cff6 req-dd56c242-8d51-4e63-a477-110bcbfbccbe service nova] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Received unexpected event network-vif-plugged-1741e52a-4fe9-4496-9c8b-56f3e1816fc3 for instance with vm_state deleted and task_state None.
Aug 16 22:39:25 user nova-compute[72773]: DEBUG nova.compute.manager [req-3202e409-832f-49ee-aa95-05dee663cff6 req-dd56c242-8d51-4e63-a477-110bcbfbccbe service nova] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Received event network-vif-deleted-1741e52a-4fe9-4496-9c8b-56f3e1816fc3 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:39:26 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692225551.1731439, 23894101-2fd3-41a4-83a3-8f6869d24d97 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:39:26 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] VM Stopped (Lifecycle Event)
Aug 16 22:39:26 user nova-compute[72773]: DEBUG nova.compute.manager [None req-d04696d4-5a7d-45ba-b1cc-2c1046656719 None None] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:39:27 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692225552.8304386, 7cf275ce-0647-43af-ad03-24cbac934b59 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:39:27 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] VM Stopped (Lifecycle Event)
Aug 16 22:39:27 user nova-compute[72773]: DEBUG nova.compute.manager [None req-be1ac034-b861-4686-8a60-af6627236a6d None None] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:39:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:38 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692225563.570392, 16a246c1-b2a7-4048-a6c9-235c15079d39 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:39:38 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] VM Stopped (Lifecycle Event)
Aug 16 22:39:38 user nova-compute[72773]: DEBUG nova.compute.manager [None req-06298a5c-e5ff-4f1c-935c-03e126001fe6 None None] [instance: 16a246c1-b2a7-4048-a6c9-235c15079d39] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:39:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:39:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:39:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Starting finish_revert_migration {{(pid=72773) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Start _get_guest_xml network_info=[{"id": "5725a1df-f51f-4ba4-99f7-777975663b2e", "address": "fa:16:3e:98:fa:bf", "network": {"id": "00744c2a-d566-47bc-abeb-8e9bc9ab312d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-384143120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cafc1d829ed749c2bfe35f7bc58e331c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5725a1df-f5", "ovs_interfaceid": "5725a1df-f51f-4ba4-99f7-777975663b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'dd057d72-b76d-42c3-8078-bcaaf111c5d0', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yDKPldmU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '23894101-2fd3-41a4-83a3-8f6869d24d97', 'attached_at': '2023-08-16T22:39:48.000000', 'detached_at': '', 'volume_id': '9c2e61c3-7e0d-4dec-84b6-038a4b3b175d', 'serial': '9c2e61c3-7e0d-4dec-84b6-038a4b3b175d'}, 'mount_device': '/dev/vdb', 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:39:48 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:39:48 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:39:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG nova.objects.instance [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lazy-loading 'vcpu_model' on Instance uuid 23894101-2fd3-41a4-83a3-8f6869d24d97 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yDKPldmU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:39:48 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:39:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:39:48 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:39:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:39:48 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:39:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[55affa12-626a-47a9-a4c3-39a66c479052]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:39:48 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8322a3f2-8a6c-47f5-8bf9-a2848dbc9fce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d] added
Aug 16 22:39:48 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e77fa1d-adf7-4786-9114-03100acbafe7]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbc7c93-e0ac-4230-8395-1085b6cd405b]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yDKPldmU {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yDKPldmU" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4391b655-9e10-4230-ba3a-68a155a1f249]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yDKPldmU'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6dcd6e-88c9-4be6-9046-dbd278266e16]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2359a760-e905-4b07-9415-4d9959719521]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:39:48 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:39:48 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:39:48 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:39:48 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68decd6-466f-463e-8f25-abd93a4ee897]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d, portal: 172.16.0.220,3260]
Aug 16 22:39:48 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d, portal: 172.16.0.220,3260] successful.
Aug 16 22:39:48 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8390be4a-4138-4770-86f3-f029f913ed35]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fab9b2-95f3-4b15-b919-ca2d5df42c2f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:39:48 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:39:48 user nova-compute[72773]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:39:48 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:39:48 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:39:48 user nova-compute[72773]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:39:48 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ea7e28-9a0c-4e65-95d7-d3570540aa22]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yDKPldmU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:39:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:49 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:39:49 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26335666134656639', 'path': '/dev/sdc'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:39:49 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335666134656639', 'path': '/dev/sdc'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:39:49 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:33:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2107689448',display_name='tempest-ServerActionsTestOtherB-server-2107689448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2107689448',id=26,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh1GymZbw24IcnH5dONTb6loGV9Z6Plyeb2rJeaUseM4wpzMr4OTPGkSKihakM6H3XgBNMxcd+thJYbV9RDvja0dJb4k7n+wBitov4O9EMqeBt9unfmT2aB8P/P3aCmCA==',key_name='tempest-keypair-1176159006',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:37:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cafc1d829ed749c2bfe35f7bc58e331c',ramdisk_id='',reservation_id='r-sdzz0nnk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1140735028',owner_user_name='tempest-ServerActionsTestOtherB-1140735028-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:39:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cdb4ae56354496ab9e3f71461bd9d6d',uuid=23894101-2fd3-41a4-83a3-8f6869d24d97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "5725a1df-f51f-4ba4-99f7-777975663b2e", "address": "fa:16:3e:98:fa:bf", "network": {"id": "00744c2a-d566-47bc-abeb-8e9bc9ab312d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-384143120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cafc1d829ed749c2bfe35f7bc58e331c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5725a1df-f5", "ovs_interfaceid": "5725a1df-f51f-4ba4-99f7-777975663b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:39:49 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Converting VIF {"id": "5725a1df-f51f-4ba4-99f7-777975663b2e", "address": "fa:16:3e:98:fa:bf", "network": {"id": "00744c2a-d566-47bc-abeb-8e9bc9ab312d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-384143120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cafc1d829ed749c2bfe35f7bc58e331c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5725a1df-f5", "ovs_interfaceid": "5725a1df-f51f-4ba4-99f7-777975663b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:39:49 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:fa:bf,bridge_name='br-int',has_traffic_filtering=True,id=5725a1df-f51f-4ba4-99f7-777975663b2e,network=Network(00744c2a-d566-47bc-abeb-8e9bc9ab312d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5725a1df-f5') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:39:49 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:39:49 user nova-compute[72773]:   <uuid>23894101-2fd3-41a4-83a3-8f6869d24d97</uuid>
Aug 16 22:39:49 user nova-compute[72773]:   <name>instance-0000001a</name>
Aug 16 22:39:49 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:39:49 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:39:49 user nova-compute[72773]:   <metadata>
Aug 16 22:39:49 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:39:49 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:39:49 user nova-compute[72773]:       <nova:name>tempest-ServerActionsTestOtherB-server-2107689448</nova:name>
Aug 16 22:39:49 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:39:48</nova:creationTime>
Aug 16 22:39:49 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:39:49 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:39:49 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:39:49 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:39:49 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:39:49 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:39:49 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:39:49 user nova-compute[72773]:       <nova:owner>
Aug 16 22:39:49 user nova-compute[72773]:         <nova:user uuid="7cdb4ae56354496ab9e3f71461bd9d6d">tempest-ServerActionsTestOtherB-1140735028-project-member</nova:user>
Aug 16 22:39:49 user nova-compute[72773]:         <nova:project uuid="cafc1d829ed749c2bfe35f7bc58e331c">tempest-ServerActionsTestOtherB-1140735028</nova:project>
Aug 16 22:39:49 user nova-compute[72773]:       </nova:owner>
Aug 16 22:39:49 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:39:49 user nova-compute[72773]:       <nova:ports>
Aug 16 22:39:49 user nova-compute[72773]:         <nova:port uuid="5725a1df-f51f-4ba4-99f7-777975663b2e">
Aug 16 22:39:49 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 22:39:49 user nova-compute[72773]:         </nova:port>
Aug 16 22:39:49 user nova-compute[72773]:       </nova:ports>
Aug 16 22:39:49 user nova-compute[72773]:     </nova:instance>
Aug 16 22:39:49 user nova-compute[72773]:   </metadata>
Aug 16 22:39:49 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:39:49 user nova-compute[72773]:     <system>
Aug 16 22:39:49 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:39:49 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:39:49 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:39:49 user nova-compute[72773]:       <entry name="serial">23894101-2fd3-41a4-83a3-8f6869d24d97</entry>
Aug 16 22:39:49 user nova-compute[72773]:       <entry name="uuid">23894101-2fd3-41a4-83a3-8f6869d24d97</entry>
Aug 16 22:39:49 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:39:49 user nova-compute[72773]:     </system>
Aug 16 22:39:49 user nova-compute[72773]:   </sysinfo>
Aug 16 22:39:49 user nova-compute[72773]:   <os>
Aug 16 22:39:49 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:39:49 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:39:49 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:39:49 user nova-compute[72773]:   </os>
Aug 16 22:39:49 user nova-compute[72773]:   <features>
Aug 16 22:39:49 user nova-compute[72773]:     <acpi/>
Aug 16 22:39:49 user nova-compute[72773]:     <apic/>
Aug 16 22:39:49 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:39:49 user nova-compute[72773]:   </features>
Aug 16 22:39:49 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:39:49 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:39:49 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:39:49 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:39:49 user nova-compute[72773]:   </clock>
Aug 16 22:39:49 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:39:49 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:39:49 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:39:49 user nova-compute[72773]:   </cpu>
Aug 16 22:39:49 user nova-compute[72773]:   <devices>
Aug 16 22:39:49 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:39:49 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:39:49 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk"/>
Aug 16 22:39:49 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:39:49 user nova-compute[72773]:     </disk>
Aug 16 22:39:49 user nova-compute[72773]:     <disk type="block" device="disk">
Aug 16 22:39:49 user nova-compute[72773]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:39:49 user nova-compute[72773]:       <source dev="/dev/sdc"/>
Aug 16 22:39:49 user nova-compute[72773]:       <target dev="vdb" bus="virtio"/>
Aug 16 22:39:49 user nova-compute[72773]:       <serial>9c2e61c3-7e0d-4dec-84b6-038a4b3b175d</serial>
Aug 16 22:39:49 user nova-compute[72773]:     </disk>
Aug 16 22:39:49 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:39:49 user nova-compute[72773]:       <mac address="fa:16:3e:98:fa:bf"/>
Aug 16 22:39:49 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:39:49 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:39:49 user nova-compute[72773]:       <target dev="tap5725a1df-f5"/>
Aug 16 22:39:49 user nova-compute[72773]:     </interface>
Aug 16 22:39:49 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:39:49 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/console.log" append="off"/>
Aug 16 22:39:49 user nova-compute[72773]:     </serial>
Aug 16 22:39:49 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:39:49 user nova-compute[72773]:     <video>
Aug 16 22:39:49 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:39:49 user nova-compute[72773]:     </video>
Aug 16 22:39:49 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:39:49 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:39:49 user nova-compute[72773]:     </rng>
Aug 16 22:39:49 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:39:49 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:39:49 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:39:49 user nova-compute[72773]:     </memballoon>
Aug 16 22:39:49 user nova-compute[72773]:   </devices>
Aug 16 22:39:49 user nova-compute[72773]: </domain>
Aug 16 22:39:49 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:39:49 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:33:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2107689448',display_name='tempest-ServerActionsTestOtherB-server-2107689448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2107689448',id=26,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh1GymZbw24IcnH5dONTb6loGV9Z6Plyeb2rJeaUseM4wpzMr4OTPGkSKihakM6H3XgBNMxcd+thJYbV9RDvja0dJb4k7n+wBitov4O9EMqeBt9unfmT2aB8P/P3aCmCA==',key_name='tempest-keypair-1176159006',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:37:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cafc1d829ed749c2bfe35f7bc58e331c',ramdisk_id='',reservation_id='r-sdzz0nnk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1140735028',owner_user_name='tempest-ServerActionsTestOtherB-1140735028-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:39:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cdb4ae56354496ab9e3f71461bd9d6d',uuid=23894101-2fd3-41a4-83a3-8f6869d24d97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "5725a1df-f51f-4ba4-99f7-777975663b2e", "address": "fa:16:3e:98:fa:bf", "network": {"id": "00744c2a-d566-47bc-abeb-8e9bc9ab312d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-384143120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cafc1d829ed749c2bfe35f7bc58e331c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5725a1df-f5", "ovs_interfaceid": "5725a1df-f51f-4ba4-99f7-777975663b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:39:49 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Converting VIF {"id": "5725a1df-f51f-4ba4-99f7-777975663b2e", "address": "fa:16:3e:98:fa:bf", "network": {"id": "00744c2a-d566-47bc-abeb-8e9bc9ab312d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-384143120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cafc1d829ed749c2bfe35f7bc58e331c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5725a1df-f5", "ovs_interfaceid": "5725a1df-f51f-4ba4-99f7-777975663b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:39:49 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:fa:bf,bridge_name='br-int',has_traffic_filtering=True,id=5725a1df-f51f-4ba4-99f7-777975663b2e,network=Network(00744c2a-d566-47bc-abeb-8e9bc9ab312d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5725a1df-f5') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:39:49 user nova-compute[72773]: DEBUG os_vif [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:fa:bf,bridge_name='br-int',has_traffic_filtering=True,id=5725a1df-f51f-4ba4-99f7-777975663b2e,network=Network(00744c2a-d566-47bc-abeb-8e9bc9ab312d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5725a1df-f5') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:39:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:39:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:39:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5725a1df-f5, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:39:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5725a1df-f5, col_values=(('external_ids', {'iface-id': '5725a1df-f51f-4ba4-99f7-777975663b2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:fa:bf', 'vm-uuid': '23894101-2fd3-41a4-83a3-8f6869d24d97'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:39:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:39:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:49 user nova-compute[72773]: INFO os_vif [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:fa:bf,bridge_name='br-int',has_traffic_filtering=True,id=5725a1df-f51f-4ba4-99f7-777975663b2e,network=Network(00744c2a-d566-47bc-abeb-8e9bc9ab312d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5725a1df-f5')
Aug 16 22:39:50 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:39:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:51 user nova-compute[72773]: DEBUG nova.compute.manager [req-e9e21e8e-4422-4e47-aee1-10850c40adb9 req-4b0700e4-f23e-499d-baed-550277345772 service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Received event network-vif-plugged-5725a1df-f51f-4ba4-99f7-777975663b2e {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:39:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e9e21e8e-4422-4e47-aee1-10850c40adb9 req-4b0700e4-f23e-499d-baed-550277345772 service nova] Acquiring lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:39:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e9e21e8e-4422-4e47-aee1-10850c40adb9 req-4b0700e4-f23e-499d-baed-550277345772 service nova] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:39:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e9e21e8e-4422-4e47-aee1-10850c40adb9 req-4b0700e4-f23e-499d-baed-550277345772 service nova] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:39:51 user nova-compute[72773]: DEBUG nova.compute.manager [req-e9e21e8e-4422-4e47-aee1-10850c40adb9 req-4b0700e4-f23e-499d-baed-550277345772 service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] No waiting events found dispatching network-vif-plugged-5725a1df-f51f-4ba4-99f7-777975663b2e {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:39:51 user nova-compute[72773]: WARNING nova.compute.manager [req-e9e21e8e-4422-4e47-aee1-10850c40adb9 req-4b0700e4-f23e-499d-baed-550277345772 service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Received unexpected event network-vif-plugged-5725a1df-f51f-4ba4-99f7-777975663b2e for instance with vm_state resized and task_state resize_reverting.
Aug 16 22:39:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:53 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225593.0575461, 23894101-2fd3-41a4-83a3-8f6869d24d97 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:39:53 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] VM Resumed (Lifecycle Event)
Aug 16 22:39:53 user nova-compute[72773]: DEBUG nova.compute.manager [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:39:53 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Instance running successfully.
Aug 16 22:39:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] finish_revert_migration finished successfully. {{(pid=72773) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 16 22:39:53 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:39:53 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:39:53 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 16 22:39:53 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225593.059301, 23894101-2fd3-41a4-83a3-8f6869d24d97 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:39:53 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] VM Started (Lifecycle Event)
Aug 16 22:39:53 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:39:53 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:39:53 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 16 22:39:53 user nova-compute[72773]: DEBUG nova.compute.manager [req-c7d990f5-ff92-4027-99eb-def9d21ad790 req-182392a4-f5a2-454d-83f8-08779ee3c5e9 service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Received event network-vif-plugged-5725a1df-f51f-4ba4-99f7-777975663b2e {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:39:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c7d990f5-ff92-4027-99eb-def9d21ad790 req-182392a4-f5a2-454d-83f8-08779ee3c5e9 service nova] Acquiring lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:39:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c7d990f5-ff92-4027-99eb-def9d21ad790 req-182392a4-f5a2-454d-83f8-08779ee3c5e9 service nova] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:39:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c7d990f5-ff92-4027-99eb-def9d21ad790 req-182392a4-f5a2-454d-83f8-08779ee3c5e9 service nova] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:39:53 user nova-compute[72773]: DEBUG nova.compute.manager [req-c7d990f5-ff92-4027-99eb-def9d21ad790 req-182392a4-f5a2-454d-83f8-08779ee3c5e9 service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] No waiting events found dispatching network-vif-plugged-5725a1df-f51f-4ba4-99f7-777975663b2e {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:39:53 user nova-compute[72773]: WARNING nova.compute.manager [req-c7d990f5-ff92-4027-99eb-def9d21ad790 req-182392a4-f5a2-454d-83f8-08779ee3c5e9 service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Received unexpected event network-vif-plugged-5725a1df-f51f-4ba4-99f7-777975663b2e for instance with vm_state resized and task_state resize_reverting.
Aug 16 22:39:53 user nova-compute[72773]: INFO nova.compute.manager [None req-57e9bf6d-8ede-433f-b51b-fc65afa57f88 tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Updating instance to original state: 'active'
Aug 16 22:39:54 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:56 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:39:56 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:39:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-391a6006-4fe6-4398-a1e8-ae95b5edbf2b" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:39:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-391a6006-4fe6-4398-a1e8-ae95b5edbf2b" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:39:56 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 22:39:57 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Updating instance_info_cache with network_info: [{"id": "6961298d-d62e-4f7b-b97e-4198a325816c", "address": "fa:16:3e:2d:58:d4", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6961298d-d6", "ovs_interfaceid": "6961298d-d62e-4f7b-b97e-4198a325816c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:39:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-391a6006-4fe6-4398-a1e8-ae95b5edbf2b" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:39:57 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 22:39:57 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:39:58 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:39:58 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:39:58 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:39:58 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:39:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:39:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:00 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:40:00 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:40:01 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:40:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:40:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:40:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:40:01 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:40:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:40:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:40:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:40:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c59217c-22f8-4745-b05e-53300ca454f2/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c59217c-22f8-4745-b05e-53300ca454f2/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c59217c-22f8-4745-b05e-53300ca454f2/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c59217c-22f8-4745-b05e-53300ca454f2/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:04 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:06 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:40:06 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:40:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=7590MB free_disk=25.304683685302734GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:40:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:40:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:40:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 956d334e-f190-4625-b144-ab44d2f3321a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:40:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 030d076d-5099-4236-ae31-6025017eb51e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:40:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance ac2b49e4-59bc-46cd-b7d9-67aa68296e4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:40:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 391a6006-4fe6-4398-a1e8-ae95b5edbf2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:40:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance cf01c401-c424-4b3e-aa5b-439d62b1ae4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:40:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 5ebcd117-6765-44eb-871b-226afd58e4e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:40:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance f4210738-d01e-4408-a15c-aeccada6dd23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:40:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 2c59217c-22f8-4745-b05e-53300ca454f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:40:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 23894101-2fd3-41a4-83a3-8f6869d24d97 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:40:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 05f47c14-f17f-43d9-b607-bccc9a0c3957 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:40:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:40:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:40:06 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:40:06 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:40:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:40:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.491s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:40:09 user nova-compute[72773]: INFO nova.compute.manager [None req-846d55ef-e47a-4b72-8b61-9c151f3b695f tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Unrescuing
Aug 16 22:40:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-846d55ef-e47a-4b72-8b61-9c151f3b695f tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "refresh_cache-2c59217c-22f8-4745-b05e-53300ca454f2" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:40:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-846d55ef-e47a-4b72-8b61-9c151f3b695f tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquired lock "refresh_cache-2c59217c-22f8-4745-b05e-53300ca454f2" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:40:09 user nova-compute[72773]: DEBUG nova.network.neutron [None req-846d55ef-e47a-4b72-8b61-9c151f3b695f tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:40:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:40:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 22:40:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:40:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:40:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:40:09 user nova-compute[72773]: DEBUG nova.network.neutron [None req-846d55ef-e47a-4b72-8b61-9c151f3b695f tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Updating instance_info_cache with network_info: [{"id": "068f02fa-b6b9-4148-b9b2-737d79b6c82e", "address": "fa:16:3e:6b:7c:d2", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068f02fa-b6", "ovs_interfaceid": "068f02fa-b6b9-4148-b9b2-737d79b6c82e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:40:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-846d55ef-e47a-4b72-8b61-9c151f3b695f tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Releasing lock "refresh_cache-2c59217c-22f8-4745-b05e-53300ca454f2" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:40:10 user nova-compute[72773]: DEBUG nova.objects.instance [None req-846d55ef-e47a-4b72-8b61-9c151f3b695f tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lazy-loading 'flavor' on Instance uuid 2c59217c-22f8-4745-b05e-53300ca454f2 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:40:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:10 user nova-compute[72773]: DEBUG nova.compute.manager [req-f54a42b0-dc13-4920-bac7-350cdb1ba738 req-9413fa37-cad1-495b-a4cb-45dbf3b98b75 service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Received event network-vif-unplugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:40:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f54a42b0-dc13-4920-bac7-350cdb1ba738 req-9413fa37-cad1-495b-a4cb-45dbf3b98b75 service nova] Acquiring lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:40:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f54a42b0-dc13-4920-bac7-350cdb1ba738 req-9413fa37-cad1-495b-a4cb-45dbf3b98b75 service nova] Lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:40:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f54a42b0-dc13-4920-bac7-350cdb1ba738 req-9413fa37-cad1-495b-a4cb-45dbf3b98b75 service nova] Lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:40:10 user nova-compute[72773]: DEBUG nova.compute.manager [req-f54a42b0-dc13-4920-bac7-350cdb1ba738 req-9413fa37-cad1-495b-a4cb-45dbf3b98b75 service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] No waiting events found dispatching network-vif-unplugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:40:10 user nova-compute[72773]: WARNING nova.compute.manager [req-f54a42b0-dc13-4920-bac7-350cdb1ba738 req-9413fa37-cad1-495b-a4cb-45dbf3b98b75 service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Received unexpected event network-vif-unplugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e for instance with vm_state rescued and task_state unrescuing.
Aug 16 22:40:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:10 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Instance destroyed successfully.
Aug 16 22:40:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:12 user nova-compute[72773]: DEBUG nova.compute.manager [req-b824bd69-a8ba-44fd-a168-f0d37e01d75d req-4eca8051-925c-40c3-8b08-100d245876b7 service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Received event network-vif-plugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:40:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b824bd69-a8ba-44fd-a168-f0d37e01d75d req-4eca8051-925c-40c3-8b08-100d245876b7 service nova] Acquiring lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:40:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b824bd69-a8ba-44fd-a168-f0d37e01d75d req-4eca8051-925c-40c3-8b08-100d245876b7 service nova] Lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:40:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b824bd69-a8ba-44fd-a168-f0d37e01d75d req-4eca8051-925c-40c3-8b08-100d245876b7 service nova] Lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:40:12 user nova-compute[72773]: DEBUG nova.compute.manager [req-b824bd69-a8ba-44fd-a168-f0d37e01d75d req-4eca8051-925c-40c3-8b08-100d245876b7 service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] No waiting events found dispatching network-vif-plugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:40:12 user nova-compute[72773]: WARNING nova.compute.manager [req-b824bd69-a8ba-44fd-a168-f0d37e01d75d req-4eca8051-925c-40c3-8b08-100d245876b7 service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Received unexpected event network-vif-plugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e for instance with vm_state rescued and task_state unrescuing.
Aug 16 22:40:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:14 user nova-compute[72773]: DEBUG nova.compute.manager [req-a67a96ba-f41a-4b5c-92e5-a7216ce04063 req-1d3a0552-302c-4ec8-b355-b259f95ed9a7 service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Received event network-vif-plugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:40:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a67a96ba-f41a-4b5c-92e5-a7216ce04063 req-1d3a0552-302c-4ec8-b355-b259f95ed9a7 service nova] Acquiring lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:40:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a67a96ba-f41a-4b5c-92e5-a7216ce04063 req-1d3a0552-302c-4ec8-b355-b259f95ed9a7 service nova] Lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:40:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a67a96ba-f41a-4b5c-92e5-a7216ce04063 req-1d3a0552-302c-4ec8-b355-b259f95ed9a7 service nova] Lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:40:14 user nova-compute[72773]: DEBUG nova.compute.manager [req-a67a96ba-f41a-4b5c-92e5-a7216ce04063 req-1d3a0552-302c-4ec8-b355-b259f95ed9a7 service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] No waiting events found dispatching network-vif-plugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:40:14 user nova-compute[72773]: WARNING nova.compute.manager [req-a67a96ba-f41a-4b5c-92e5-a7216ce04063 req-1d3a0552-302c-4ec8-b355-b259f95ed9a7 service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Received unexpected event network-vif-plugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e for instance with vm_state rescued and task_state unrescuing.
Aug 16 22:40:14 user nova-compute[72773]: DEBUG nova.compute.manager [req-a67a96ba-f41a-4b5c-92e5-a7216ce04063 req-1d3a0552-302c-4ec8-b355-b259f95ed9a7 service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Received event network-vif-plugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:40:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a67a96ba-f41a-4b5c-92e5-a7216ce04063 req-1d3a0552-302c-4ec8-b355-b259f95ed9a7 service nova] Acquiring lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:40:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a67a96ba-f41a-4b5c-92e5-a7216ce04063 req-1d3a0552-302c-4ec8-b355-b259f95ed9a7 service nova] Lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:40:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a67a96ba-f41a-4b5c-92e5-a7216ce04063 req-1d3a0552-302c-4ec8-b355-b259f95ed9a7 service nova] Lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:40:14 user nova-compute[72773]: DEBUG nova.compute.manager [req-a67a96ba-f41a-4b5c-92e5-a7216ce04063 req-1d3a0552-302c-4ec8-b355-b259f95ed9a7 service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] No waiting events found dispatching network-vif-plugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:40:14 user nova-compute[72773]: WARNING nova.compute.manager [req-a67a96ba-f41a-4b5c-92e5-a7216ce04063 req-1d3a0552-302c-4ec8-b355-b259f95ed9a7 service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Received unexpected event network-vif-plugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e for instance with vm_state rescued and task_state unrescuing.
Aug 16 22:40:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-846d55ef-e47a-4b72-8b61-9c151f3b695f tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:40:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Removed pending event for 2c59217c-22f8-4745-b05e-53300ca454f2 due to event {{(pid=72773) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 22:40:14 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225614.5583065, 2c59217c-22f8-4745-b05e-53300ca454f2 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:40:14 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] VM Resumed (Lifecycle Event)
Aug 16 22:40:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:40:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:40:14 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 22:40:14 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225614.5584407, 2c59217c-22f8-4745-b05e-53300ca454f2 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:40:14 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] VM Started (Lifecycle Event)
Aug 16 22:40:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:40:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:40:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:34 user nova-compute[72773]: DEBUG nova.compute.manager [req-f8cc9f47-1cdd-4f4c-9ce4-445c1c6d7ce2 req-ed8c0036-5e96-4380-ae9f-328c42f54019 service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Received event network-changed-0b3b8e24-f9dc-4d52-9f47-8505706c1457 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:40:34 user nova-compute[72773]: DEBUG nova.compute.manager [req-f8cc9f47-1cdd-4f4c-9ce4-445c1c6d7ce2 req-ed8c0036-5e96-4380-ae9f-328c42f54019 service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Refreshing instance network info cache due to event network-changed-0b3b8e24-f9dc-4d52-9f47-8505706c1457. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:40:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f8cc9f47-1cdd-4f4c-9ce4-445c1c6d7ce2 req-ed8c0036-5e96-4380-ae9f-328c42f54019 service nova] Acquiring lock "refresh_cache-05f47c14-f17f-43d9-b607-bccc9a0c3957" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:40:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f8cc9f47-1cdd-4f4c-9ce4-445c1c6d7ce2 req-ed8c0036-5e96-4380-ae9f-328c42f54019 service nova] Acquired lock "refresh_cache-05f47c14-f17f-43d9-b607-bccc9a0c3957" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:40:34 user nova-compute[72773]: DEBUG nova.network.neutron [req-f8cc9f47-1cdd-4f4c-9ce4-445c1c6d7ce2 req-ed8c0036-5e96-4380-ae9f-328c42f54019 service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Refreshing network info cache for port 0b3b8e24-f9dc-4d52-9f47-8505706c1457 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:40:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "05f47c14-f17f-43d9-b607-bccc9a0c3957" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:40:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "05f47c14-f17f-43d9-b607-bccc9a0c3957" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:40:34 user nova-compute[72773]: DEBUG nova.objects.instance [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lazy-loading 'flavor' on Instance uuid 05f47c14-f17f-43d9-b607-bccc9a0c3957 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:40:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:34 user nova-compute[72773]: DEBUG nova.network.neutron [req-f8cc9f47-1cdd-4f4c-9ce4-445c1c6d7ce2 req-ed8c0036-5e96-4380-ae9f-328c42f54019 service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Updated VIF entry in instance network info cache for port 0b3b8e24-f9dc-4d52-9f47-8505706c1457. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:40:34 user nova-compute[72773]: DEBUG nova.network.neutron [req-f8cc9f47-1cdd-4f4c-9ce4-445c1c6d7ce2 req-ed8c0036-5e96-4380-ae9f-328c42f54019 service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Updating instance_info_cache with network_info: [{"id": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "address": "fa:16:3e:73:0f:a0", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3b8e24-f9", "ovs_interfaceid": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:40:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f8cc9f47-1cdd-4f4c-9ce4-445c1c6d7ce2 req-ed8c0036-5e96-4380-ae9f-328c42f54019 service nova] Releasing lock "refresh_cache-05f47c14-f17f-43d9-b607-bccc9a0c3957" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:40:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "05f47c14-f17f-43d9-b607-bccc9a0c3957" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:40:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "05f47c14-f17f-43d9-b607-bccc9a0c3957" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:40:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "05f47c14-f17f-43d9-b607-bccc9a0c3957" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:40:34 user nova-compute[72773]: INFO nova.compute.manager [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Attaching volume 88ff5034-5a21-43b7-8086-d83b2c142296 to /dev/vdb
Aug 16 22:40:34 user nova-compute[72773]: DEBUG os_brick.utils [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:40:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b1cb98-a41b-4a6c-80f0-2ab43f3f8aae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:40:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[29961c26-4a4a-4eee-81f9-988be3da6b0a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:40:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7636ac00-7b92-4d15-a276-fd9dd22bc7a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:40:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0f2c2d-8a13-48d9-ae61-70c85709063a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:40:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:40:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:40:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:40:35 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:40:35 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6b3cd7-ac31-4092-a504-1e115df70a76]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:40:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:40:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:40:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:40:35 user nova-compute[72773]: DEBUG os_brick.utils [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:40:35 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Updating existing volume attachment record: 03e4c6cc-d946-46e5-9506-fa27ada774bc {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:40:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:40:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yspoPAQq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:40:46 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:40:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:40:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:40:46 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:40:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:40:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:40:46 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:40:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:46 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7a55f9-3d0c-4faf-bc3c-161a58667fe8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:40:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:40:46 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:40:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:46 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97628fa-ab0a-4632-99e4-9289f0fbda27]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:40:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296] added
Aug 16 22:40:46 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:40:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:46 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[26783a5c-5814-4dd5-acf0-c46452540c7e]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:40:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:40:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:46 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[321ca192-2610-4883-9e92-8ce61e9c4568]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:40:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:40:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yspoPAQq {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yspoPAQq" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:46 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[615d26d0-d737-401d-8d98-9dcc7e8a5220]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:40:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yspoPAQq'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:40:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:46 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed03080b-e88a-49f4-8a78-4b219ad016d8]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:40:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:40:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:46 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4271b2d4-e77c-4cfb-a8e9-f28150e82b93]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:40:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:40:46 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:40:46 user nova-compute[72773]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:40:46 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:40:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:40:46 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:40:46 user nova-compute[72773]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:40:46 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:40:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --login" returned: 0 in 1.073s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:47 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d07ca4-6e1f-4dc9-b829-5e7f9b7d482b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:40:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296, portal: 172.16.0.220,3260]
Aug 16 22:40:47 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296, portal: 172.16.0.220,3260] successful.
Aug 16 22:40:47 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:40:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:47 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[991bae25-43e4-471c-919a-9c3db5e15a8f]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:40:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:40:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:47 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85ef217-1c71-45bd-9854-d97ca5befc65]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:40:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:40:47 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:40:47 user nova-compute[72773]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:40:47 user nova-compute[72773]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 (non-flash)
Aug 16 22:40:47 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:40:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:40:47 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:40:47 user nova-compute[72773]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:40:47 user nova-compute[72773]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 (non-flash)
Aug 16 22:40:47 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:40:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.315s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:40:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:40:47 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:40:47 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:40:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:47 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59376f4-61c2-47f5-8174-56267120dcd3]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:40:47 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: None {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:40:48 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:40:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yspoPAQq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:40:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.348s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:40:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] <== connect_volume: return (2350ms) {'type': 'block', 'scsi_wwn': '23238623830323737', 'path': '/dev/sde'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:40:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238623830323737', 'path': '/dev/sde'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:40:48 user nova-compute[72773]: DEBUG nova.objects.instance [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lazy-loading 'flavor' on Instance uuid 05f47c14-f17f-43d9-b607-bccc9a0c3957 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:40:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 22:40:48 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:40:48 user nova-compute[72773]:   <source dev="/dev/sde"/>
Aug 16 22:40:48 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:40:48 user nova-compute[72773]:   <serial>88ff5034-5a21-43b7-8086-d83b2c142296</serial>
Aug 16 22:40:48 user nova-compute[72773]: </disk>
Aug 16 22:40:48 user nova-compute[72773]:  {{(pid=72773) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 22:40:49 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:40:49 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:40:49 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] No VIF found with MAC fa:16:3e:73:0f:a0, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:40:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f334bacb-840c-4d6b-960b-2832dace584c tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "05f47c14-f17f-43d9-b607-bccc9a0c3957" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.580s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:40:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-23eaf449-9168-4459-9eb0-ae50cea69c09 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Acquiring lock "ac2b49e4-59bc-46cd-b7d9-67aa68296e4e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:40:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-23eaf449-9168-4459-9eb0-ae50cea69c09 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lock "ac2b49e4-59bc-46cd-b7d9-67aa68296e4e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:40:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-23eaf449-9168-4459-9eb0-ae50cea69c09 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Acquiring lock "ac2b49e4-59bc-46cd-b7d9-67aa68296e4e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:40:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-23eaf449-9168-4459-9eb0-ae50cea69c09 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lock "ac2b49e4-59bc-46cd-b7d9-67aa68296e4e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:40:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-23eaf449-9168-4459-9eb0-ae50cea69c09 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lock "ac2b49e4-59bc-46cd-b7d9-67aa68296e4e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:40:49 user nova-compute[72773]: INFO nova.compute.manager [None req-23eaf449-9168-4459-9eb0-ae50cea69c09 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Terminating instance
Aug 16 22:40:49 user nova-compute[72773]: DEBUG nova.compute.manager [None req-23eaf449-9168-4459-9eb0-ae50cea69c09 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:40:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:49 user nova-compute[72773]: DEBUG nova.compute.manager [req-579aa791-3e4e-48f0-9b58-b8e058a91b06 req-8790021a-e752-4f8d-b05c-c92d9f7cb3c8 service nova] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Received event network-vif-unplugged-aa173151-ed37-4416-97d6-4bb197ad7396 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:40:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-579aa791-3e4e-48f0-9b58-b8e058a91b06 req-8790021a-e752-4f8d-b05c-c92d9f7cb3c8 service nova] Acquiring lock "ac2b49e4-59bc-46cd-b7d9-67aa68296e4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:40:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-579aa791-3e4e-48f0-9b58-b8e058a91b06 req-8790021a-e752-4f8d-b05c-c92d9f7cb3c8 service nova] Lock "ac2b49e4-59bc-46cd-b7d9-67aa68296e4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:40:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-579aa791-3e4e-48f0-9b58-b8e058a91b06 req-8790021a-e752-4f8d-b05c-c92d9f7cb3c8 service nova] Lock "ac2b49e4-59bc-46cd-b7d9-67aa68296e4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:40:49 user nova-compute[72773]: DEBUG nova.compute.manager [req-579aa791-3e4e-48f0-9b58-b8e058a91b06 req-8790021a-e752-4f8d-b05c-c92d9f7cb3c8 service nova] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] No waiting events found dispatching network-vif-unplugged-aa173151-ed37-4416-97d6-4bb197ad7396 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:40:49 user nova-compute[72773]: DEBUG nova.compute.manager [req-579aa791-3e4e-48f0-9b58-b8e058a91b06 req-8790021a-e752-4f8d-b05c-c92d9f7cb3c8 service nova] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Received event network-vif-unplugged-aa173151-ed37-4416-97d6-4bb197ad7396 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:40:50 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Instance destroyed successfully.
Aug 16 22:40:50 user nova-compute[72773]: DEBUG nova.objects.instance [None req-23eaf449-9168-4459-9eb0-ae50cea69c09 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lazy-loading 'resources' on Instance uuid ac2b49e4-59bc-46cd-b7d9-67aa68296e4e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:40:50 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-23eaf449-9168-4459-9eb0-ae50cea69c09 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:31:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1449502529',display_name='tempest-ServersNegativeTestJSON-server-1449502529',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1449502529',id=20,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:31:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a20f7a479ca4dbebe1ef08f466d2e55',ramdisk_id='',reservation_id='r-l90m3qw5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-526921722',owner_user_name='tempest-ServersNegativeTestJSON-526921722-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:31:42Z,user_data=None,user_id='0d14c71e4a9d42d886602349c6d568e8',uuid=ac2b49e4-59bc-46cd-b7d9-67aa68296e4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa173151-ed37-4416-97d6-4bb197ad7396", "address": "fa:16:3e:f3:88:89", "network": {"id": "0567b846-3f19-403c-9ec6-ac2a82af5f4a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-290484898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a20f7a479ca4dbebe1ef08f466d2e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa173151-ed", "ovs_interfaceid": "aa173151-ed37-4416-97d6-4bb197ad7396", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:40:50 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-23eaf449-9168-4459-9eb0-ae50cea69c09 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Converting VIF {"id": "aa173151-ed37-4416-97d6-4bb197ad7396", "address": "fa:16:3e:f3:88:89", "network": {"id": "0567b846-3f19-403c-9ec6-ac2a82af5f4a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-290484898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a20f7a479ca4dbebe1ef08f466d2e55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa173151-ed", "ovs_interfaceid": "aa173151-ed37-4416-97d6-4bb197ad7396", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:40:50 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-23eaf449-9168-4459-9eb0-ae50cea69c09 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:88:89,bridge_name='br-int',has_traffic_filtering=True,id=aa173151-ed37-4416-97d6-4bb197ad7396,network=Network(0567b846-3f19-403c-9ec6-ac2a82af5f4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa173151-ed') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:40:50 user nova-compute[72773]: DEBUG os_vif [None req-23eaf449-9168-4459-9eb0-ae50cea69c09 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:88:89,bridge_name='br-int',has_traffic_filtering=True,id=aa173151-ed37-4416-97d6-4bb197ad7396,network=Network(0567b846-3f19-403c-9ec6-ac2a82af5f4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa173151-ed') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:40:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa173151-ed, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:40:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:40:50 user nova-compute[72773]: INFO os_vif [None req-23eaf449-9168-4459-9eb0-ae50cea69c09 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:88:89,bridge_name='br-int',has_traffic_filtering=True,id=aa173151-ed37-4416-97d6-4bb197ad7396,network=Network(0567b846-3f19-403c-9ec6-ac2a82af5f4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa173151-ed')
Aug 16 22:40:50 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-23eaf449-9168-4459-9eb0-ae50cea69c09 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Deleting instance files /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e_del
Aug 16 22:40:50 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-23eaf449-9168-4459-9eb0-ae50cea69c09 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Deletion of /opt/stack/data/nova/instances/ac2b49e4-59bc-46cd-b7d9-67aa68296e4e_del complete
Aug 16 22:40:50 user nova-compute[72773]: INFO nova.compute.manager [None req-23eaf449-9168-4459-9eb0-ae50cea69c09 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Took 0.69 seconds to destroy the instance on the hypervisor.
Aug 16 22:40:50 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-23eaf449-9168-4459-9eb0-ae50cea69c09 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:40:50 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:40:50 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:40:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:50 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:40:50 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Took 0.55 seconds to deallocate network for instance.
Aug 16 22:40:50 user nova-compute[72773]: INFO nova.compute.manager [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Rebuilding instance
Aug 16 22:40:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-23eaf449-9168-4459-9eb0-ae50cea69c09 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:40:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-23eaf449-9168-4459-9eb0-ae50cea69c09 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:40:50 user nova-compute[72773]: DEBUG nova.compute.manager [req-2327b414-dacb-43aa-bdb1-66e63b49a32c req-3a419bf3-660e-4072-9f0b-5009769c439c service nova] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Received event network-vif-deleted-aa173151-ed37-4416-97d6-4bb197ad7396 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:40:50 user nova-compute[72773]: DEBUG nova.objects.instance [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lazy-loading 'trusted_certs' on Instance uuid 05f47c14-f17f-43d9-b607-bccc9a0c3957 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:40:50 user nova-compute[72773]: DEBUG nova.compute.manager [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:40:50 user nova-compute[72773]: DEBUG nova.objects.instance [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lazy-loading 'pci_requests' on Instance uuid 05f47c14-f17f-43d9-b607-bccc9a0c3957 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:40:50 user nova-compute[72773]: DEBUG nova.objects.instance [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lazy-loading 'pci_devices' on Instance uuid 05f47c14-f17f-43d9-b607-bccc9a0c3957 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:40:50 user nova-compute[72773]: DEBUG nova.objects.instance [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lazy-loading 'resources' on Instance uuid 05f47c14-f17f-43d9-b607-bccc9a0c3957 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:40:50 user nova-compute[72773]: DEBUG nova.objects.instance [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lazy-loading 'migration_context' on Instance uuid 05f47c14-f17f-43d9-b607-bccc9a0c3957 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:40:50 user nova-compute[72773]: DEBUG nova.objects.instance [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72773) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 22:40:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:51 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-23eaf449-9168-4459-9eb0-ae50cea69c09 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:40:51 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-23eaf449-9168-4459-9eb0-ae50cea69c09 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:40:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-23eaf449-9168-4459-9eb0-ae50cea69c09 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.399s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:40:51 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-23eaf449-9168-4459-9eb0-ae50cea69c09 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Deleted allocations for instance ac2b49e4-59bc-46cd-b7d9-67aa68296e4e
Aug 16 22:40:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-23eaf449-9168-4459-9eb0-ae50cea69c09 tempest-ServersNegativeTestJSON-526921722 tempest-ServersNegativeTestJSON-526921722-project-member] Lock "ac2b49e4-59bc-46cd-b7d9-67aa68296e4e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.847s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:40:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:51 user nova-compute[72773]: DEBUG nova.compute.manager [req-7ba7760d-df94-4186-b617-c91d0141c0a8 req-88fe17de-3471-4c0d-95f7-1b733741791e service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Received event network-vif-unplugged-0b3b8e24-f9dc-4d52-9f47-8505706c1457 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:40:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-7ba7760d-df94-4186-b617-c91d0141c0a8 req-88fe17de-3471-4c0d-95f7-1b733741791e service nova] Acquiring lock "05f47c14-f17f-43d9-b607-bccc9a0c3957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:40:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-7ba7760d-df94-4186-b617-c91d0141c0a8 req-88fe17de-3471-4c0d-95f7-1b733741791e service nova] Lock "05f47c14-f17f-43d9-b607-bccc9a0c3957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:40:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-7ba7760d-df94-4186-b617-c91d0141c0a8 req-88fe17de-3471-4c0d-95f7-1b733741791e service nova] Lock "05f47c14-f17f-43d9-b607-bccc9a0c3957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:40:51 user nova-compute[72773]: DEBUG nova.compute.manager [req-7ba7760d-df94-4186-b617-c91d0141c0a8 req-88fe17de-3471-4c0d-95f7-1b733741791e service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] No waiting events found dispatching network-vif-unplugged-0b3b8e24-f9dc-4d52-9f47-8505706c1457 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:40:51 user nova-compute[72773]: WARNING nova.compute.manager [req-7ba7760d-df94-4186-b617-c91d0141c0a8 req-88fe17de-3471-4c0d-95f7-1b733741791e service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Received unexpected event network-vif-unplugged-0b3b8e24-f9dc-4d52-9f47-8505706c1457 for instance with vm_state active and task_state rebuilding.
Aug 16 22:40:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:51 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Instance destroyed successfully.
Aug 16 22:40:51 user nova-compute[72773]: DEBUG nova.compute.manager [req-aa175017-cf25-4a6f-9744-36636a887bae req-f675f02e-fa24-4960-a0de-c0566d09e954 service nova] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Received event network-vif-plugged-aa173151-ed37-4416-97d6-4bb197ad7396 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:40:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-aa175017-cf25-4a6f-9744-36636a887bae req-f675f02e-fa24-4960-a0de-c0566d09e954 service nova] Acquiring lock "ac2b49e4-59bc-46cd-b7d9-67aa68296e4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:40:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-aa175017-cf25-4a6f-9744-36636a887bae req-f675f02e-fa24-4960-a0de-c0566d09e954 service nova] Lock "ac2b49e4-59bc-46cd-b7d9-67aa68296e4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:40:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-aa175017-cf25-4a6f-9744-36636a887bae req-f675f02e-fa24-4960-a0de-c0566d09e954 service nova] Lock "ac2b49e4-59bc-46cd-b7d9-67aa68296e4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:40:51 user nova-compute[72773]: DEBUG nova.compute.manager [req-aa175017-cf25-4a6f-9744-36636a887bae req-f675f02e-fa24-4960-a0de-c0566d09e954 service nova] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] No waiting events found dispatching network-vif-plugged-aa173151-ed37-4416-97d6-4bb197ad7396 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:40:51 user nova-compute[72773]: WARNING nova.compute.manager [req-aa175017-cf25-4a6f-9744-36636a887bae req-f675f02e-fa24-4960-a0de-c0566d09e954 service nova] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Received unexpected event network-vif-plugged-aa173151-ed37-4416-97d6-4bb197ad7396 for instance with vm_state deleted and task_state None.
Aug 16 22:40:51 user nova-compute[72773]: INFO nova.compute.manager [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Detaching volume 88ff5034-5a21-43b7-8086-d83b2c142296
Aug 16 22:40:51 user nova-compute[72773]: INFO nova.virt.block_device [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Attempting to driver detach volume 88ff5034-5a21-43b7-8086-d83b2c142296 from mountpoint /dev/vdb
Aug 16 22:40:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Attempting to detach device vdb from instance 05f47c14-f17f-43d9-b607-bccc9a0c3957 from the persistent domain config. {{(pid=72773) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 22:40:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:40:51 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:40:51 user nova-compute[72773]:   <source dev="/dev/sde"/>
Aug 16 22:40:51 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:40:51 user nova-compute[72773]:   <serial>88ff5034-5a21-43b7-8086-d83b2c142296</serial>
Aug 16 22:40:51 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:40:51 user nova-compute[72773]: </disk>
Aug 16 22:40:51 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:40:51 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Successfully detached device vdb from instance 05f47c14-f17f-43d9-b607-bccc9a0c3957 from the persistent domain config.
Aug 16 22:40:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:40:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yspoPAQq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:40:51 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 22:40:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:40:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:40:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:40:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1699c897-6b71-463f-a824-d370d15a2065]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:40:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0949451b-f110-48e1-ac54-024aaf82556e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:40:52 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:40:52 user nova-compute[72773]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:40:52 user nova-compute[72773]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 (non-flash)
Aug 16 22:40:52 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:40:52 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:40:52 user nova-compute[72773]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:40:52 user nova-compute[72773]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 (non-flash)
Aug 16 22:40:52 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef80208b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296'): ({'sde'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Removing single pathed devices sde {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d707c79-6897-4476-a4b1-efe21bb9abdb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d19beb-99e0-4ea4-a8cd-00e6b2f4322f]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Flushing IO for device /dev/sde {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39645d8-211f-4958-a81c-cd97aec76afa]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26a1500-d6f5-436e-bdf5-40a97eb2bf05]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] SCSI volumes sde have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe30b49-a7e9-49a7-80ee-57243483464e]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c20a1a-b3d6-42f9-b3e5-a6a1fb2a1a4b]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296, portal: 172.16.0.220,3260]
Aug 16 22:40:52 user nova-compute[72773]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296, portal: 172.16.0.220,3260] successful.
Aug 16 22:40:52 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1945f0f8-1d1d-4bce-b879-d5f9b8b234ce]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] <== disconnect_volume: return (318ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:40:52 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:40:53 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Instance destroyed successfully.
Aug 16 22:40:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1640374506',display_name='tempest-ServerActionsTestOtherA-server-1404163079',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1640374506',id=34,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBzvtDCwVci75U1rhvQ1Z9tY7UhERzUXkVpq7AVmjX8jpuQ8EldOLMxDXCgz1AaMzVkstK/rHc9w+j5Cm539WNo3fmDL3Nm1hTQWdxZWqybvyBt+XNmwDqSnz7VNnsE+g==',key_name='tempest-keypair-821177163',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:38:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e3dc03400ff4448682ebba991a7e8af6',ramdisk_id='',reservation_id='r-t8bd36d0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1807466388',owner_user_name='tempest-ServerActionsTestOtherA-1807466388-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:40:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02982f15d1a640a5bc77069a906f3e9a',uuid=05f47c14-f17f-43d9-b607-bccc9a0c3957,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "address": "fa:16:3e:73:0f:a0", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3b8e24-f9", "ovs_interfaceid": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Converting VIF {"id": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "address": "fa:16:3e:73:0f:a0", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3b8e24-f9", "ovs_interfaceid": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:0f:a0,bridge_name='br-int',has_traffic_filtering=True,id=0b3b8e24-f9dc-4d52-9f47-8505706c1457,network=Network(1a1a40b0-631c-4f41-9ece-17cd713adfd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b3b8e24-f9') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG os_vif [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:0f:a0,bridge_name='br-int',has_traffic_filtering=True,id=0b3b8e24-f9dc-4d52-9f47-8505706c1457,network=Network(1a1a40b0-631c-4f41-9ece-17cd713adfd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b3b8e24-f9') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b3b8e24-f9, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:40:53 user nova-compute[72773]: INFO os_vif [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:0f:a0,bridge_name='br-int',has_traffic_filtering=True,id=0b3b8e24-f9dc-4d52-9f47-8505706c1457,network=Network(1a1a40b0-631c-4f41-9ece-17cd713adfd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b3b8e24-f9')
Aug 16 22:40:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yspoPAQq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:40:53 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 22:40:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d049930c-74cc-46c6-b4e4-e82439a1e216]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a5c063-5a8d-4f2f-a3d5-8f573e2453de]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:40:53 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:40:53 user nova-compute[72773]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:40:53 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:40:53 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:40:53 user nova-compute[72773]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:40:53 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef802ed360>, {}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Disconnecting from: [] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.055s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] <== disconnect_volume: return (56ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:40:53 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Deleting instance files /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957_del
Aug 16 22:40:53 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Deletion of /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957_del complete
Aug 16 22:40:53 user nova-compute[72773]: INFO nova.virt.block_device [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Booting with volume 88ff5034-5a21-43b7-8086-d83b2c142296 at /dev/vdb
Aug 16 22:40:53 user nova-compute[72773]: DEBUG nova.compute.manager [req-0474e644-2551-4053-abd4-ff20124a391b req-3fd81dc6-76a7-47d8-9ba9-336d2c140ee6 service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Received event network-vif-plugged-0b3b8e24-f9dc-4d52-9f47-8505706c1457 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0474e644-2551-4053-abd4-ff20124a391b req-3fd81dc6-76a7-47d8-9ba9-336d2c140ee6 service nova] Acquiring lock "05f47c14-f17f-43d9-b607-bccc9a0c3957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0474e644-2551-4053-abd4-ff20124a391b req-3fd81dc6-76a7-47d8-9ba9-336d2c140ee6 service nova] Lock "05f47c14-f17f-43d9-b607-bccc9a0c3957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0474e644-2551-4053-abd4-ff20124a391b req-3fd81dc6-76a7-47d8-9ba9-336d2c140ee6 service nova] Lock "05f47c14-f17f-43d9-b607-bccc9a0c3957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG nova.compute.manager [req-0474e644-2551-4053-abd4-ff20124a391b req-3fd81dc6-76a7-47d8-9ba9-336d2c140ee6 service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] No waiting events found dispatching network-vif-plugged-0b3b8e24-f9dc-4d52-9f47-8505706c1457 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:40:53 user nova-compute[72773]: WARNING nova.compute.manager [req-0474e644-2551-4053-abd4-ff20124a391b req-3fd81dc6-76a7-47d8-9ba9-336d2c140ee6 service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Received unexpected event network-vif-plugged-0b3b8e24-f9dc-4d52-9f47-8505706c1457 for instance with vm_state active and task_state rebuild_block_device_mapping.
Aug 16 22:40:53 user nova-compute[72773]: DEBUG os_brick.utils [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19b0361-a92e-45c5-8739-0e9ba99bffc9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1423ec81-6663-4d67-adcc-a059f662b1d5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4b44b6-eebf-4557-bf12-cdd1264ea64d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c296ec26-cd71-4a2d-b9ab-0ec5fb3c42a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:40:53 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:40:53 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad196ce-b0b9-48fd-bb25-41b840372d52]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG os_brick.utils [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:40:53 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Updating existing volume attachment record: fd7fa208-26da-45c4-8cb4-557c408684b5 {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:40:57 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:40:57 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:40:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:40:58 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:40:58 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:40:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-cf01c401-c424-4b3e-aa5b-439d62b1ae4c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:40:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-cf01c401-c424-4b3e-aa5b-439d62b1ae4c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:40:58 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 22:40:58 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Updating instance_info_cache with network_info: [{"id": "96243341-8834-4a23-9bf3-964374e14014", "address": "fa:16:3e:c6:b4:53", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96243341-88", "ovs_interfaceid": "96243341-8834-4a23-9bf3-964374e14014", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:40:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-cf01c401-c424-4b3e-aa5b-439d62b1ae4c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:40:58 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 22:40:58 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:40:58 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:40:58 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Cleaning up deleted instances {{(pid=72773) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 22:40:58 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] There are 0 instances to clean {{(pid=72773) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 22:40:59 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:40:59 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:40:59 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:41:00 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:41:00 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:41:00 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:41:00 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Cleaning up deleted instances with incomplete migration  {{(pid=72773) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 22:41:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:01 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:41:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:01 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:41:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:41:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:41:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:41:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Acquiring lock "7cf275ce-0647-43af-ad03-24cbac934b59" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lock "7cf275ce-0647-43af-ad03-24cbac934b59" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:04 user nova-compute[72773]: INFO nova.compute.manager [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Unshelving
Aug 16 22:41:04 user nova-compute[72773]: INFO nova.virt.block_device [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Booting with volume c203a677-77d4-45aa-a91d-f69ed23c7dca at /dev/vda
Aug 16 22:41:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:04 user nova-compute[72773]: DEBUG os_brick.utils [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:41:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:04 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fddb036-b30a-4056-8848-acb8f0e9b364]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:41:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:04 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c744b1d-8a2f-4685-8142-9e288885ceb1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:41:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:04 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[df75560e-ba8e-44f6-b747-9a61182dbe68]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:41:04 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f58b0e-928b-4805-8257-b9da1cd1c559]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:41:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:41:04 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:41:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:41:04 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:41:04 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffa7009-d2e2-42f8-8a0f-f1a9f7ec7540]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:41:04 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:41:04 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:41:04 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:41:04 user nova-compute[72773]: DEBUG os_brick.utils [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:41:04 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Updating existing volume attachment record: 8233b16a-edf7-4512-bee2-fc1d40ff37cd {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:41:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:05 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692225649.9985304, ac2b49e4-59bc-46cd-b7d9-67aa68296e4e => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:41:05 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] VM Stopped (Lifecycle Event)
Aug 16 22:41:05 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:41:05 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:41:05 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=7722MB free_disk=25.348060607910156GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:41:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:05 user nova-compute[72773]: DEBUG nova.compute.manager [None req-810a4218-7b56-43a3-bf4b-0b838b190cfc None None] [instance: ac2b49e4-59bc-46cd-b7d9-67aa68296e4e] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:41:05 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:41:05 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Creating image(s)
Aug 16 22:41:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "/opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "/opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "/opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:05 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 956d334e-f190-4625-b144-ab44d2f3321a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:41:05 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 030d076d-5099-4236-ae31-6025017eb51e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:41:05 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 391a6006-4fe6-4398-a1e8-ae95b5edbf2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:41:05 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance cf01c401-c424-4b3e-aa5b-439d62b1ae4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:41:05 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 5ebcd117-6765-44eb-871b-226afd58e4e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:41:05 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance f4210738-d01e-4408-a15c-aeccada6dd23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:41:05 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 2c59217c-22f8-4745-b05e-53300ca454f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:41:05 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 23894101-2fd3-41a4-83a3-8f6869d24d97 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:41:05 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 05f47c14-f17f-43d9-b607-bccc9a0c3957 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:41:05 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 7cf275ce-0647-43af-ad03-24cbac934b59 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 16 22:41:05 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:41:05 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:41:05 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Refreshing inventories for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 22:41:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.185s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:05 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Updating ProviderTree inventory for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 22:41:05 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Updating inventory in ProviderTree for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 22:41:05 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Refreshing aggregate associations for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e, aggregates: None {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 22:41:05 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Refreshing trait associations for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.213s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk 1073741824" returned: 0 in 0.054s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.184s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Checking if we can resize image /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.081s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Cannot resize image /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Ensure instance console log exists: /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Start _get_guest_xml network_info=[{"id": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "address": "fa:16:3e:73:0f:a0", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3b8e24-f9", "ovs_interfaceid": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'fd7fa208-26da-45c4-8cb4-557c408684b5', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yspoPAQq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '05f47c14-f17f-43d9-b607-bccc9a0c3957', 'attached_at': '', 'detached_at': '', 'volume_id': '88ff5034-5a21-43b7-8086-d83b2c142296', 'serial': '88ff5034-5a21-43b7-8086-d83b2c142296'}, 'mount_device': '/dev/vdb', 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:41:06 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 22:41:06 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 22:41:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG nova.objects.instance [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lazy-loading 'vcpu_model' on Instance uuid 05f47c14-f17f-43d9-b607-bccc9a0c3957 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yspoPAQq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:41:06 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 22:41:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:41:06 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 22:41:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:41:06 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74a7240-e89b-4595-85a6-08397543cd15]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:41:06 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef20311-213d-4391-8224-718c3ddda686]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296] added
Aug 16 22:41:06 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2534998d-751b-4c70-8a92-f01e258a3453]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692225651.7146046, 05f47c14-f17f-43d9-b607-bccc9a0c3957 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:41:06 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] VM Stopped (Lifecycle Event)
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9275e6-381f-48bc-b14d-648b7d55cf2d]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yspoPAQq {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG nova.compute.manager [None req-6e6d0294-b3e2-465a-aac2-9aa7e7c09b8c None None] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yspoPAQq" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b943944e-93e4-42e3-b013-6a228f0e83f7]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yspoPAQq'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf54869-284b-4119-800b-abcd2688f94f]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5346acaf-4ae5-44ce-84d6-ce74bc917950]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:41:06 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:41:06 user nova-compute[72773]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:41:06 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:41:06 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:41:06 user nova-compute[72773]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:41:06 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c6051e-6eba-4acf-84ac-0a0c9850ebef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296, portal: 172.16.0.220,3260]
Aug 16 22:41:06 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296, portal: 172.16.0.220,3260] successful.
Aug 16 22:41:06 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f0e218-ddb7-4ebb-952c-71347b3fcadc]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:41:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:07 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b874965-a12d-4a65-98bd-bd80d6341b84]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:41:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:41:07 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:41:07 user nova-compute[72773]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:41:07 user nova-compute[72773]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 (non-flash)
Aug 16 22:41:07 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:41:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:41:07 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:41:07 user nova-compute[72773]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:41:07 user nova-compute[72773]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 (non-flash)
Aug 16 22:41:07 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:41:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:41:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:41:07 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:41:07 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:41:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.086s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:07 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef56b2d-f015-4f90-8d0b-b61b27ab36c9]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:41:07 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:41:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yspoPAQq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:41:08 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.439s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:41:08 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] <== connect_volume: return (1441ms) {'type': 'block', 'scsi_wwn': '23238623830323737', 'path': '/dev/sde'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:41:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238623830323737', 'path': '/dev/sde'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:41:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T22:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1640374506',display_name='tempest-ServerActionsTestOtherA-server-1404163079',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1640374506',id=34,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBzvtDCwVci75U1rhvQ1Z9tY7UhERzUXkVpq7AVmjX8jpuQ8EldOLMxDXCgz1AaMzVkstK/rHc9w+j5Cm539WNo3fmDL3Nm1hTQWdxZWqybvyBt+XNmwDqSnz7VNnsE+g==',key_name='tempest-keypair-821177163',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:38:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e3dc03400ff4448682ebba991a7e8af6',ramdisk_id='',reservation_id='r-t8bd36d0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1807466388',owner_user_name='tempest-ServerActionsTestOtherA-1807466388-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:40:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02982f15d1a640a5bc77069a906f3e9a',uuid=05f47c14-f17f-43d9-b607-bccc9a0c3957,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "address": "fa:16:3e:73:0f:a0", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3b8e24-f9", "ovs_interfaceid": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:41:08 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Converting VIF {"id": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "address": "fa:16:3e:73:0f:a0", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3b8e24-f9", "ovs_interfaceid": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:41:08 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:0f:a0,bridge_name='br-int',has_traffic_filtering=True,id=0b3b8e24-f9dc-4d52-9f47-8505706c1457,network=Network(1a1a40b0-631c-4f41-9ece-17cd713adfd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b3b8e24-f9') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:41:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:41:08 user nova-compute[72773]:   <uuid>05f47c14-f17f-43d9-b607-bccc9a0c3957</uuid>
Aug 16 22:41:08 user nova-compute[72773]:   <name>instance-00000022</name>
Aug 16 22:41:08 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:41:08 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:41:08 user nova-compute[72773]:   <metadata>
Aug 16 22:41:08 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:41:08 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:41:08 user nova-compute[72773]:       <nova:name>tempest-ServerActionsTestOtherA-server-1404163079</nova:name>
Aug 16 22:41:08 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:41:06</nova:creationTime>
Aug 16 22:41:08 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:41:08 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:41:08 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:41:08 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:41:08 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:41:08 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:41:08 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:41:08 user nova-compute[72773]:       <nova:owner>
Aug 16 22:41:08 user nova-compute[72773]:         <nova:user uuid="02982f15d1a640a5bc77069a906f3e9a">tempest-ServerActionsTestOtherA-1807466388-project-member</nova:user>
Aug 16 22:41:08 user nova-compute[72773]:         <nova:project uuid="e3dc03400ff4448682ebba991a7e8af6">tempest-ServerActionsTestOtherA-1807466388</nova:project>
Aug 16 22:41:08 user nova-compute[72773]:       </nova:owner>
Aug 16 22:41:08 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:41:08 user nova-compute[72773]:       <nova:ports>
Aug 16 22:41:08 user nova-compute[72773]:         <nova:port uuid="0b3b8e24-f9dc-4d52-9f47-8505706c1457">
Aug 16 22:41:08 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 22:41:08 user nova-compute[72773]:         </nova:port>
Aug 16 22:41:08 user nova-compute[72773]:       </nova:ports>
Aug 16 22:41:08 user nova-compute[72773]:     </nova:instance>
Aug 16 22:41:08 user nova-compute[72773]:   </metadata>
Aug 16 22:41:08 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:41:08 user nova-compute[72773]:     <system>
Aug 16 22:41:08 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:41:08 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:41:08 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:41:08 user nova-compute[72773]:       <entry name="serial">05f47c14-f17f-43d9-b607-bccc9a0c3957</entry>
Aug 16 22:41:08 user nova-compute[72773]:       <entry name="uuid">05f47c14-f17f-43d9-b607-bccc9a0c3957</entry>
Aug 16 22:41:08 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:41:08 user nova-compute[72773]:     </system>
Aug 16 22:41:08 user nova-compute[72773]:   </sysinfo>
Aug 16 22:41:08 user nova-compute[72773]:   <os>
Aug 16 22:41:08 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:41:08 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:41:08 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:41:08 user nova-compute[72773]:   </os>
Aug 16 22:41:08 user nova-compute[72773]:   <features>
Aug 16 22:41:08 user nova-compute[72773]:     <acpi/>
Aug 16 22:41:08 user nova-compute[72773]:     <apic/>
Aug 16 22:41:08 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:41:08 user nova-compute[72773]:   </features>
Aug 16 22:41:08 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:41:08 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:41:08 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:41:08 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:41:08 user nova-compute[72773]:   </clock>
Aug 16 22:41:08 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:41:08 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:41:08 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:41:08 user nova-compute[72773]:   </cpu>
Aug 16 22:41:08 user nova-compute[72773]:   <devices>
Aug 16 22:41:08 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:41:08 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:41:08 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk"/>
Aug 16 22:41:08 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:41:08 user nova-compute[72773]:     </disk>
Aug 16 22:41:08 user nova-compute[72773]:     <disk type="block" device="disk">
Aug 16 22:41:08 user nova-compute[72773]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:41:08 user nova-compute[72773]:       <source dev="/dev/sde"/>
Aug 16 22:41:08 user nova-compute[72773]:       <target dev="vdb" bus="virtio"/>
Aug 16 22:41:08 user nova-compute[72773]:       <serial>88ff5034-5a21-43b7-8086-d83b2c142296</serial>
Aug 16 22:41:08 user nova-compute[72773]:     </disk>
Aug 16 22:41:08 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:41:08 user nova-compute[72773]:       <mac address="fa:16:3e:73:0f:a0"/>
Aug 16 22:41:08 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:41:08 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:41:08 user nova-compute[72773]:       <target dev="tap0b3b8e24-f9"/>
Aug 16 22:41:08 user nova-compute[72773]:     </interface>
Aug 16 22:41:08 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:41:08 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/console.log" append="off"/>
Aug 16 22:41:08 user nova-compute[72773]:     </serial>
Aug 16 22:41:08 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:41:08 user nova-compute[72773]:     <video>
Aug 16 22:41:08 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:41:08 user nova-compute[72773]:     </video>
Aug 16 22:41:08 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:41:08 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:41:08 user nova-compute[72773]:     </rng>
Aug 16 22:41:08 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:41:08 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:41:08 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:41:08 user nova-compute[72773]:     </memballoon>
Aug 16 22:41:08 user nova-compute[72773]:   </devices>
Aug 16 22:41:08 user nova-compute[72773]: </domain>
Aug 16 22:41:08 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:41:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T22:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1640374506',display_name='tempest-ServerActionsTestOtherA-server-1404163079',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1640374506',id=34,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBzvtDCwVci75U1rhvQ1Z9tY7UhERzUXkVpq7AVmjX8jpuQ8EldOLMxDXCgz1AaMzVkstK/rHc9w+j5Cm539WNo3fmDL3Nm1hTQWdxZWqybvyBt+XNmwDqSnz7VNnsE+g==',key_name='tempest-keypair-821177163',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:38:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e3dc03400ff4448682ebba991a7e8af6',ramdisk_id='',reservation_id='r-t8bd36d0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1807466388',owner_user_name='tempest-ServerActionsTestOtherA-1807466388-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:40:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02982f15d1a640a5bc77069a906f3e9a',uuid=05f47c14-f17f-43d9-b607-bccc9a0c3957,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "address": "fa:16:3e:73:0f:a0", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3b8e24-f9", "ovs_interfaceid": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:41:08 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Converting VIF {"id": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "address": "fa:16:3e:73:0f:a0", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3b8e24-f9", "ovs_interfaceid": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:41:08 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:0f:a0,bridge_name='br-int',has_traffic_filtering=True,id=0b3b8e24-f9dc-4d52-9f47-8505706c1457,network=Network(1a1a40b0-631c-4f41-9ece-17cd713adfd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b3b8e24-f9') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:41:08 user nova-compute[72773]: DEBUG os_vif [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:0f:a0,bridge_name='br-int',has_traffic_filtering=True,id=0b3b8e24-f9dc-4d52-9f47-8505706c1457,network=Network(1a1a40b0-631c-4f41-9ece-17cd713adfd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b3b8e24-f9') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:41:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:41:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:41:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b3b8e24-f9, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:41:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0b3b8e24-f9, col_values=(('external_ids', {'iface-id': '0b3b8e24-f9dc-4d52-9f47-8505706c1457', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:0f:a0', 'vm-uuid': '05f47c14-f17f-43d9-b607-bccc9a0c3957'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:41:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:41:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:08 user nova-compute[72773]: INFO os_vif [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:0f:a0,bridge_name='br-int',has_traffic_filtering=True,id=0b3b8e24-f9dc-4d52-9f47-8505706c1457,network=Network(1a1a40b0-631c-4f41-9ece-17cd713adfd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b3b8e24-f9')
Aug 16 22:41:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:41:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:41:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] No VIF found with MAC fa:16:3e:73:0f:a0, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:41:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "60f877e9-8032-4781-8692-88853f420a3c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "60f877e9-8032-4781-8692-88853f420a3c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:08 user nova-compute[72773]: DEBUG nova.compute.manager [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:41:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:08 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:41:08 user nova-compute[72773]: INFO nova.compute.claims [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Claim successful on node user
Aug 16 22:41:08 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:41:08 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:41:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:08 user nova-compute[72773]: DEBUG nova.compute.manager [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:41:09 user nova-compute[72773]: DEBUG nova.compute.manager [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:41:09 user nova-compute[72773]: DEBUG nova.network.neutron [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:41:09 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:41:09 user nova-compute[72773]: DEBUG nova.compute.manager [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:41:09 user nova-compute[72773]: DEBUG nova.policy [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '62e5b77a149140fd8613d566f41cc23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8e068df8094356b16a6480cd231675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:41:09 user nova-compute[72773]: DEBUG nova.compute.manager [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:41:09 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:41:09 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Creating image(s)
Aug 16 22:41:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "/opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "/opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "/opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.181s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.212s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk 1073741824" returned: 0 in 0.079s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:09 user nova-compute[72773]: DEBUG nova.compute.manager [req-4c519e45-e39b-4786-bbae-748ac977168a req-59046ecb-efd8-4d6d-8400-ca7cf6681a5f service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Received event network-vif-plugged-0b3b8e24-f9dc-4d52-9f47-8505706c1457 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:41:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4c519e45-e39b-4786-bbae-748ac977168a req-59046ecb-efd8-4d6d-8400-ca7cf6681a5f service nova] Acquiring lock "05f47c14-f17f-43d9-b607-bccc9a0c3957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4c519e45-e39b-4786-bbae-748ac977168a req-59046ecb-efd8-4d6d-8400-ca7cf6681a5f service nova] Lock "05f47c14-f17f-43d9-b607-bccc9a0c3957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4c519e45-e39b-4786-bbae-748ac977168a req-59046ecb-efd8-4d6d-8400-ca7cf6681a5f service nova] Lock "05f47c14-f17f-43d9-b607-bccc9a0c3957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:09 user nova-compute[72773]: DEBUG nova.compute.manager [req-4c519e45-e39b-4786-bbae-748ac977168a req-59046ecb-efd8-4d6d-8400-ca7cf6681a5f service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] No waiting events found dispatching network-vif-plugged-0b3b8e24-f9dc-4d52-9f47-8505706c1457 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:41:09 user nova-compute[72773]: WARNING nova.compute.manager [req-4c519e45-e39b-4786-bbae-748ac977168a req-59046ecb-efd8-4d6d-8400-ca7cf6681a5f service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Received unexpected event network-vif-plugged-0b3b8e24-f9dc-4d52-9f47-8505706c1457 for instance with vm_state active and task_state rebuild_spawning.
Aug 16 22:41:09 user nova-compute[72773]: DEBUG nova.network.neutron [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Successfully created port: 39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:41:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.221s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:09 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:41:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:10 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Cannot resize image /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:41:10 user nova-compute[72773]: DEBUG nova.objects.instance [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lazy-loading 'migration_context' on Instance uuid 60f877e9-8032-4781-8692-88853f420a3c {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:41:10 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:41:10 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Ensure instance console log exists: /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:41:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Acquiring lock "b99244c8-f6df-4c60-b8be-09fc4e644733" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Lock "b99244c8-f6df-4c60-b8be-09fc4e644733" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:10 user nova-compute[72773]: DEBUG nova.compute.manager [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:41:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:10 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:41:10 user nova-compute[72773]: INFO nova.compute.claims [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Claim successful on node user
Aug 16 22:41:10 user nova-compute[72773]: DEBUG nova.network.neutron [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Successfully updated port: 39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:41:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "refresh_cache-60f877e9-8032-4781-8692-88853f420a3c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:41:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquired lock "refresh_cache-60f877e9-8032-4781-8692-88853f420a3c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:41:10 user nova-compute[72773]: DEBUG nova.network.neutron [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:41:10 user nova-compute[72773]: DEBUG nova.compute.manager [req-00acfebc-3e20-41a4-8dd1-f4b69e63ad37 req-47194f3a-eea6-4ef2-9645-9b5d7cfddfbc service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received event network-changed-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:41:10 user nova-compute[72773]: DEBUG nova.compute.manager [req-00acfebc-3e20-41a4-8dd1-f4b69e63ad37 req-47194f3a-eea6-4ef2-9645-9b5d7cfddfbc service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Refreshing instance network info cache due to event network-changed-39797b08-9184-4673-a07c-c2123736fc54. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:41:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-00acfebc-3e20-41a4-8dd1-f4b69e63ad37 req-47194f3a-eea6-4ef2-9645-9b5d7cfddfbc service nova] Acquiring lock "refresh_cache-60f877e9-8032-4781-8692-88853f420a3c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:41:10 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:41:10 user nova-compute[72773]: DEBUG nova.network.neutron [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:41:10 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:41:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:10 user nova-compute[72773]: DEBUG nova.compute.manager [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:41:10 user nova-compute[72773]: DEBUG nova.compute.manager [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:41:10 user nova-compute[72773]: DEBUG nova.network.neutron [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:41:11 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.compute.manager [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.compute.manager [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:41:11 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Creating image(s)
Aug 16 22:41:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Acquiring lock "/opt/stack/data/nova/instances/b99244c8-f6df-4c60-b8be-09fc4e644733/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Lock "/opt/stack/data/nova/instances/b99244c8-f6df-4c60-b8be-09fc4e644733/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Lock "/opt/stack/data/nova/instances/b99244c8-f6df-4c60-b8be-09fc4e644733/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.policy [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b4d716629504e8bb9cdc2c50b224f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4c3fcf849453f8e5a2f0e3e6837df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.network.neutron [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Updating instance_info_cache with network_info: [{"id": "39797b08-9184-4673-a07c-c2123736fc54", "address": "fa:16:3e:71:50:b7", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39797b08-91", "ovs_interfaceid": "39797b08-9184-4673-a07c-c2123736fc54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Releasing lock "refresh_cache-60f877e9-8032-4781-8692-88853f420a3c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.compute.manager [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Instance network_info: |[{"id": "39797b08-9184-4673-a07c-c2123736fc54", "address": "fa:16:3e:71:50:b7", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39797b08-91", "ovs_interfaceid": "39797b08-9184-4673-a07c-c2123736fc54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-00acfebc-3e20-41a4-8dd1-f4b69e63ad37 req-47194f3a-eea6-4ef2-9645-9b5d7cfddfbc service nova] Acquired lock "refresh_cache-60f877e9-8032-4781-8692-88853f420a3c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.network.neutron [req-00acfebc-3e20-41a4-8dd1-f4b69e63ad37 req-47194f3a-eea6-4ef2-9645-9b5d7cfddfbc service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Refreshing network info cache for port 39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Start _get_guest_xml network_info=[{"id": "39797b08-9184-4673-a07c-c2123736fc54", "address": "fa:16:3e:71:50:b7", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39797b08-91", "ovs_interfaceid": "39797b08-9184-4673-a07c-c2123736fc54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:41:11 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:41:11 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:41:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-827284706',display_name='tempest-ServerRescueNegativeTestJSON-server-827284706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-827284706',id=35,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7gafhwwNaFwdrqYDxUnK7qviiu8w72xziXFtmugun3TJ+ehJ6SdUX+lpAqyz9MNn0gbwOiswYPEz294I0l7FWrizeZtd/b4guqnHdCcLGRy+g1PZ0sbuxpR4sXj4MbGg==',key_name='tempest-keypair-1429512481',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f8e068df8094356b16a6480cd231675',ramdisk_id='',reservation_id='r-wbw339d1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1754829282',owner_user_name='tempest-ServerRescueNegativeTestJSON-1754829282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:41:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62e5b77a149140fd8613d566f41cc23d',uuid=60f877e9-8032-4781-8692-88853f420a3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39797b08-9184-4673-a07c-c2123736fc54", "address": "fa:16:3e:71:50:b7", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39797b08-91", "ovs_interfaceid": "39797b08-9184-4673-a07c-c2123736fc54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Converting VIF {"id": "39797b08-9184-4673-a07c-c2123736fc54", "address": "fa:16:3e:71:50:b7", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39797b08-91", "ovs_interfaceid": "39797b08-9184-4673-a07c-c2123736fc54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:50:b7,bridge_name='br-int',has_traffic_filtering=True,id=39797b08-9184-4673-a07c-c2123736fc54,network=Network(8a43bbad-aab2-44c9-a7e4-62696d908234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39797b08-91') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.objects.instance [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lazy-loading 'pci_devices' on Instance uuid 60f877e9-8032-4781-8692-88853f420a3c {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.244s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:41:11 user nova-compute[72773]:   <uuid>60f877e9-8032-4781-8692-88853f420a3c</uuid>
Aug 16 22:41:11 user nova-compute[72773]:   <name>instance-00000023</name>
Aug 16 22:41:11 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:41:11 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:41:11 user nova-compute[72773]:   <metadata>
Aug 16 22:41:11 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:41:11 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:41:11 user nova-compute[72773]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-827284706</nova:name>
Aug 16 22:41:11 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:41:11</nova:creationTime>
Aug 16 22:41:11 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:41:11 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:41:11 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:41:11 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:41:11 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:41:11 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:41:11 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:41:11 user nova-compute[72773]:       <nova:owner>
Aug 16 22:41:11 user nova-compute[72773]:         <nova:user uuid="62e5b77a149140fd8613d566f41cc23d">tempest-ServerRescueNegativeTestJSON-1754829282-project-member</nova:user>
Aug 16 22:41:11 user nova-compute[72773]:         <nova:project uuid="0f8e068df8094356b16a6480cd231675">tempest-ServerRescueNegativeTestJSON-1754829282</nova:project>
Aug 16 22:41:11 user nova-compute[72773]:       </nova:owner>
Aug 16 22:41:11 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:41:11 user nova-compute[72773]:       <nova:ports>
Aug 16 22:41:11 user nova-compute[72773]:         <nova:port uuid="39797b08-9184-4673-a07c-c2123736fc54">
Aug 16 22:41:11 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 22:41:11 user nova-compute[72773]:         </nova:port>
Aug 16 22:41:11 user nova-compute[72773]:       </nova:ports>
Aug 16 22:41:11 user nova-compute[72773]:     </nova:instance>
Aug 16 22:41:11 user nova-compute[72773]:   </metadata>
Aug 16 22:41:11 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:41:11 user nova-compute[72773]:     <system>
Aug 16 22:41:11 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:41:11 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:41:11 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:41:11 user nova-compute[72773]:       <entry name="serial">60f877e9-8032-4781-8692-88853f420a3c</entry>
Aug 16 22:41:11 user nova-compute[72773]:       <entry name="uuid">60f877e9-8032-4781-8692-88853f420a3c</entry>
Aug 16 22:41:11 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:41:11 user nova-compute[72773]:     </system>
Aug 16 22:41:11 user nova-compute[72773]:   </sysinfo>
Aug 16 22:41:11 user nova-compute[72773]:   <os>
Aug 16 22:41:11 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:41:11 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:41:11 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:41:11 user nova-compute[72773]:   </os>
Aug 16 22:41:11 user nova-compute[72773]:   <features>
Aug 16 22:41:11 user nova-compute[72773]:     <acpi/>
Aug 16 22:41:11 user nova-compute[72773]:     <apic/>
Aug 16 22:41:11 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:41:11 user nova-compute[72773]:   </features>
Aug 16 22:41:11 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:41:11 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:41:11 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:41:11 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:41:11 user nova-compute[72773]:   </clock>
Aug 16 22:41:11 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:41:11 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:41:11 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:41:11 user nova-compute[72773]:   </cpu>
Aug 16 22:41:11 user nova-compute[72773]:   <devices>
Aug 16 22:41:11 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:41:11 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:41:11 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk"/>
Aug 16 22:41:11 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:41:11 user nova-compute[72773]:     </disk>
Aug 16 22:41:11 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:41:11 user nova-compute[72773]:       <mac address="fa:16:3e:71:50:b7"/>
Aug 16 22:41:11 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:41:11 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:41:11 user nova-compute[72773]:       <target dev="tap39797b08-91"/>
Aug 16 22:41:11 user nova-compute[72773]:     </interface>
Aug 16 22:41:11 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:41:11 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/console.log" append="off"/>
Aug 16 22:41:11 user nova-compute[72773]:     </serial>
Aug 16 22:41:11 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:41:11 user nova-compute[72773]:     <video>
Aug 16 22:41:11 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:41:11 user nova-compute[72773]:     </video>
Aug 16 22:41:11 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:41:11 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:41:11 user nova-compute[72773]:     </rng>
Aug 16 22:41:11 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:41:11 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:41:11 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:41:11 user nova-compute[72773]:     </memballoon>
Aug 16 22:41:11 user nova-compute[72773]:   </devices>
Aug 16 22:41:11 user nova-compute[72773]: </domain>
Aug 16 22:41:11 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:41:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-827284706',display_name='tempest-ServerRescueNegativeTestJSON-server-827284706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-827284706',id=35,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7gafhwwNaFwdrqYDxUnK7qviiu8w72xziXFtmugun3TJ+ehJ6SdUX+lpAqyz9MNn0gbwOiswYPEz294I0l7FWrizeZtd/b4guqnHdCcLGRy+g1PZ0sbuxpR4sXj4MbGg==',key_name='tempest-keypair-1429512481',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f8e068df8094356b16a6480cd231675',ramdisk_id='',reservation_id='r-wbw339d1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1754829282',owner_user_name='tempest-ServerRescueNegativeTestJSON-1754829282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:41:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62e5b77a149140fd8613d566f41cc23d',uuid=60f877e9-8032-4781-8692-88853f420a3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39797b08-9184-4673-a07c-c2123736fc54", "address": "fa:16:3e:71:50:b7", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39797b08-91", "ovs_interfaceid": "39797b08-9184-4673-a07c-c2123736fc54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Converting VIF {"id": "39797b08-9184-4673-a07c-c2123736fc54", "address": "fa:16:3e:71:50:b7", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39797b08-91", "ovs_interfaceid": "39797b08-9184-4673-a07c-c2123736fc54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:50:b7,bridge_name='br-int',has_traffic_filtering=True,id=39797b08-9184-4673-a07c-c2123736fc54,network=Network(8a43bbad-aab2-44c9-a7e4-62696d908234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39797b08-91') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG os_vif [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:50:b7,bridge_name='br-int',has_traffic_filtering=True,id=39797b08-9184-4673-a07c-c2123736fc54,network=Network(8a43bbad-aab2-44c9-a7e4-62696d908234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39797b08-91') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39797b08-91, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap39797b08-91, col_values=(('external_ids', {'iface-id': '39797b08-9184-4673-a07c-c2123736fc54', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:50:b7', 'vm-uuid': '60f877e9-8032-4781-8692-88853f420a3c'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:11 user nova-compute[72773]: INFO os_vif [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:50:b7,bridge_name='br-int',has_traffic_filtering=True,id=39797b08-9184-4673-a07c-c2123736fc54,network=Network(8a43bbad-aab2-44c9-a7e4-62696d908234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39797b08-91')
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] No VIF found with MAC fa:16:3e:71:50:b7, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.280s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/b99244c8-f6df-4c60-b8be-09fc4e644733/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.compute.manager [req-467055bf-c637-48f3-850e-da81f6bd1819 req-73503fb8-800f-4d85-b476-e636336c2d39 service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Received event network-vif-plugged-0b3b8e24-f9dc-4d52-9f47-8505706c1457 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-467055bf-c637-48f3-850e-da81f6bd1819 req-73503fb8-800f-4d85-b476-e636336c2d39 service nova] Acquiring lock "05f47c14-f17f-43d9-b607-bccc9a0c3957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-467055bf-c637-48f3-850e-da81f6bd1819 req-73503fb8-800f-4d85-b476-e636336c2d39 service nova] Lock "05f47c14-f17f-43d9-b607-bccc9a0c3957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-467055bf-c637-48f3-850e-da81f6bd1819 req-73503fb8-800f-4d85-b476-e636336c2d39 service nova] Lock "05f47c14-f17f-43d9-b607-bccc9a0c3957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG nova.compute.manager [req-467055bf-c637-48f3-850e-da81f6bd1819 req-73503fb8-800f-4d85-b476-e636336c2d39 service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] No waiting events found dispatching network-vif-plugged-0b3b8e24-f9dc-4d52-9f47-8505706c1457 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:41:11 user nova-compute[72773]: WARNING nova.compute.manager [req-467055bf-c637-48f3-850e-da81f6bd1819 req-73503fb8-800f-4d85-b476-e636336c2d39 service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Received unexpected event network-vif-plugged-0b3b8e24-f9dc-4d52-9f47-8505706c1457 for instance with vm_state active and task_state rebuild_spawning.
Aug 16 22:41:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/b99244c8-f6df-4c60-b8be-09fc4e644733/disk 1073741824" returned: 0 in 0.063s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.347s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:12 user nova-compute[72773]: DEBUG nova.network.neutron [req-00acfebc-3e20-41a4-8dd1-f4b69e63ad37 req-47194f3a-eea6-4ef2-9645-9b5d7cfddfbc service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Updated VIF entry in instance network info cache for port 39797b08-9184-4673-a07c-c2123736fc54. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:41:12 user nova-compute[72773]: DEBUG nova.network.neutron [req-00acfebc-3e20-41a4-8dd1-f4b69e63ad37 req-47194f3a-eea6-4ef2-9645-9b5d7cfddfbc service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Updating instance_info_cache with network_info: [{"id": "39797b08-9184-4673-a07c-c2123736fc54", "address": "fa:16:3e:71:50:b7", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39797b08-91", "ovs_interfaceid": "39797b08-9184-4673-a07c-c2123736fc54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:41:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.187s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:12 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b99244c8-f6df-4c60-b8be-09fc4e644733/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:41:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b99244c8-f6df-4c60-b8be-09fc4e644733/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:12 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225672.1452272, 05f47c14-f17f-43d9-b607-bccc9a0c3957 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:41:12 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] VM Resumed (Lifecycle Event)
Aug 16 22:41:12 user nova-compute[72773]: DEBUG nova.compute.manager [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:41:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:41:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-00acfebc-3e20-41a4-8dd1-f4b69e63ad37 req-47194f3a-eea6-4ef2-9645-9b5d7cfddfbc service nova] Releasing lock "refresh_cache-60f877e9-8032-4781-8692-88853f420a3c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:41:12 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:41:12 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Instance spawned successfully.
Aug 16 22:41:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:41:12 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:41:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:41:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:41:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:41:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:41:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:41:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:41:12 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 22:41:12 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225672.1477075, 05f47c14-f17f-43d9-b607-bccc9a0c3957 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:41:12 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] VM Started (Lifecycle Event)
Aug 16 22:41:12 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:41:12 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:41:12 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 22:41:12 user nova-compute[72773]: DEBUG nova.compute.manager [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:41:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b99244c8-f6df-4c60-b8be-09fc4e644733/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:12 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Cannot resize image /opt/stack/data/nova/instances/b99244c8-f6df-4c60-b8be-09fc4e644733/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:41:12 user nova-compute[72773]: DEBUG nova.objects.instance [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Lazy-loading 'migration_context' on Instance uuid b99244c8-f6df-4c60-b8be-09fc4e644733 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:41:12 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:41:12 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:41:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:41:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Ensure instance console log exists: /opt/stack/data/nova/instances/b99244c8-f6df-4c60-b8be-09fc4e644733/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:41:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:12 user nova-compute[72773]: DEBUG nova.objects.instance [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72773) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 22:41:12 user nova-compute[72773]: DEBUG nova.network.neutron [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Successfully created port: 4977c3dd-df4f-41a3-bff7-135cccdf164e {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:41:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dba0329b-9a8f-4b78-a87b-fd47df0b4c0b tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.100s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:13 user nova-compute[72773]: DEBUG nova.network.neutron [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Successfully updated port: 4977c3dd-df4f-41a3-bff7-135cccdf164e {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:41:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Acquiring lock "refresh_cache-b99244c8-f6df-4c60-b8be-09fc4e644733" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:41:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Acquired lock "refresh_cache-b99244c8-f6df-4c60-b8be-09fc4e644733" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:41:13 user nova-compute[72773]: DEBUG nova.network.neutron [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG nova.compute.manager [req-2a374e28-aaf8-4c56-9ee1-e93f4973f6bb req-1ea0a465-e832-4ff6-a986-5b70a9882047 service nova] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Received event network-changed-4977c3dd-df4f-41a3-bff7-135cccdf164e {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG nova.compute.manager [req-2a374e28-aaf8-4c56-9ee1-e93f4973f6bb req-1ea0a465-e832-4ff6-a986-5b70a9882047 service nova] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Refreshing instance network info cache due to event network-changed-4977c3dd-df4f-41a3-bff7-135cccdf164e. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2a374e28-aaf8-4c56-9ee1-e93f4973f6bb req-1ea0a465-e832-4ff6-a986-5b70a9882047 service nova] Acquiring lock "refresh_cache-b99244c8-f6df-4c60-b8be-09fc4e644733" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG nova.compute.manager [req-03adf950-ca91-428f-ad23-9b88f7141fb0 req-28e7c847-68ef-46c5-8b51-d22a1f08c7f0 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received event network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-03adf950-ca91-428f-ad23-9b88f7141fb0 req-28e7c847-68ef-46c5-8b51-d22a1f08c7f0 service nova] Acquiring lock "60f877e9-8032-4781-8692-88853f420a3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-03adf950-ca91-428f-ad23-9b88f7141fb0 req-28e7c847-68ef-46c5-8b51-d22a1f08c7f0 service nova] Lock "60f877e9-8032-4781-8692-88853f420a3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-03adf950-ca91-428f-ad23-9b88f7141fb0 req-28e7c847-68ef-46c5-8b51-d22a1f08c7f0 service nova] Lock "60f877e9-8032-4781-8692-88853f420a3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG nova.compute.manager [req-03adf950-ca91-428f-ad23-9b88f7141fb0 req-28e7c847-68ef-46c5-8b51-d22a1f08c7f0 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] No waiting events found dispatching network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:41:14 user nova-compute[72773]: WARNING nova.compute.manager [req-03adf950-ca91-428f-ad23-9b88f7141fb0 req-28e7c847-68ef-46c5-8b51-d22a1f08c7f0 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received unexpected event network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 for instance with vm_state building and task_state spawning.
Aug 16 22:41:14 user nova-compute[72773]: DEBUG nova.network.neutron [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG nova.network.neutron [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Updating instance_info_cache with network_info: [{"id": "4977c3dd-df4f-41a3-bff7-135cccdf164e", "address": "fa:16:3e:59:f9:55", "network": {"id": "8bc4a357-d1cb-4e20-b75b-9745ca8ed924", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "271c18b5b5f546819051ae850473f6b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4977c3dd-df", "ovs_interfaceid": "4977c3dd-df4f-41a3-bff7-135cccdf164e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Releasing lock "refresh_cache-b99244c8-f6df-4c60-b8be-09fc4e644733" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Instance network_info: |[{"id": "4977c3dd-df4f-41a3-bff7-135cccdf164e", "address": "fa:16:3e:59:f9:55", "network": {"id": "8bc4a357-d1cb-4e20-b75b-9745ca8ed924", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "271c18b5b5f546819051ae850473f6b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4977c3dd-df", "ovs_interfaceid": "4977c3dd-df4f-41a3-bff7-135cccdf164e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2a374e28-aaf8-4c56-9ee1-e93f4973f6bb req-1ea0a465-e832-4ff6-a986-5b70a9882047 service nova] Acquired lock "refresh_cache-b99244c8-f6df-4c60-b8be-09fc4e644733" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG nova.network.neutron [req-2a374e28-aaf8-4c56-9ee1-e93f4973f6bb req-1ea0a465-e832-4ff6-a986-5b70a9882047 service nova] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Refreshing network info cache for port 4977c3dd-df4f-41a3-bff7-135cccdf164e {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Start _get_guest_xml network_info=[{"id": "4977c3dd-df4f-41a3-bff7-135cccdf164e", "address": "fa:16:3e:59:f9:55", "network": {"id": "8bc4a357-d1cb-4e20-b75b-9745ca8ed924", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "271c18b5b5f546819051ae850473f6b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4977c3dd-df", "ovs_interfaceid": "4977c3dd-df4f-41a3-bff7-135cccdf164e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:41:14 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:41:14 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:41:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:41:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-265416519',display_name='tempest-VolumesNegativeTest-instance-265416519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-265416519',id=36,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec4c3fcf849453f8e5a2f0e3e6837df',ramdisk_id='',reservation_id='r-zls002oq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1957090774',owner_user_name='tempest-VolumesNegativeTest-1957090774-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:41:11Z,user_data=None,user_id='3b4d716629504e8bb9cdc2c50b224f6b',uuid=b99244c8-f6df-4c60-b8be-09fc4e644733,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4977c3dd-df4f-41a3-bff7-135cccdf164e", "address": "fa:16:3e:59:f9:55", "network": {"id": "8bc4a357-d1cb-4e20-b75b-9745ca8ed924", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "271c18b5b5f546819051ae850473f6b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4977c3dd-df", "ovs_interfaceid": "4977c3dd-df4f-41a3-bff7-135cccdf164e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Converting VIF {"id": "4977c3dd-df4f-41a3-bff7-135cccdf164e", "address": "fa:16:3e:59:f9:55", "network": {"id": "8bc4a357-d1cb-4e20-b75b-9745ca8ed924", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "271c18b5b5f546819051ae850473f6b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4977c3dd-df", "ovs_interfaceid": "4977c3dd-df4f-41a3-bff7-135cccdf164e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:f9:55,bridge_name='br-int',has_traffic_filtering=True,id=4977c3dd-df4f-41a3-bff7-135cccdf164e,network=Network(8bc4a357-d1cb-4e20-b75b-9745ca8ed924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4977c3dd-df') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG nova.objects.instance [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Lazy-loading 'pci_devices' on Instance uuid b99244c8-f6df-4c60-b8be-09fc4e644733 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:41:14 user nova-compute[72773]:   <uuid>b99244c8-f6df-4c60-b8be-09fc4e644733</uuid>
Aug 16 22:41:14 user nova-compute[72773]:   <name>instance-00000024</name>
Aug 16 22:41:14 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:41:14 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:41:14 user nova-compute[72773]:   <metadata>
Aug 16 22:41:14 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:41:14 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:41:14 user nova-compute[72773]:       <nova:name>tempest-VolumesNegativeTest-instance-265416519</nova:name>
Aug 16 22:41:14 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:41:14</nova:creationTime>
Aug 16 22:41:14 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:41:14 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:41:14 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:41:14 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:41:14 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:41:14 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:41:14 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:41:14 user nova-compute[72773]:       <nova:owner>
Aug 16 22:41:14 user nova-compute[72773]:         <nova:user uuid="3b4d716629504e8bb9cdc2c50b224f6b">tempest-VolumesNegativeTest-1957090774-project-member</nova:user>
Aug 16 22:41:14 user nova-compute[72773]:         <nova:project uuid="4ec4c3fcf849453f8e5a2f0e3e6837df">tempest-VolumesNegativeTest-1957090774</nova:project>
Aug 16 22:41:14 user nova-compute[72773]:       </nova:owner>
Aug 16 22:41:14 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:41:14 user nova-compute[72773]:       <nova:ports>
Aug 16 22:41:14 user nova-compute[72773]:         <nova:port uuid="4977c3dd-df4f-41a3-bff7-135cccdf164e">
Aug 16 22:41:14 user nova-compute[72773]:           <nova:ip type="fixed" address="192.168.233.53" ipVersion="4"/>
Aug 16 22:41:14 user nova-compute[72773]:         </nova:port>
Aug 16 22:41:14 user nova-compute[72773]:       </nova:ports>
Aug 16 22:41:14 user nova-compute[72773]:     </nova:instance>
Aug 16 22:41:14 user nova-compute[72773]:   </metadata>
Aug 16 22:41:14 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:41:14 user nova-compute[72773]:     <system>
Aug 16 22:41:14 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:41:14 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:41:14 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:41:14 user nova-compute[72773]:       <entry name="serial">b99244c8-f6df-4c60-b8be-09fc4e644733</entry>
Aug 16 22:41:14 user nova-compute[72773]:       <entry name="uuid">b99244c8-f6df-4c60-b8be-09fc4e644733</entry>
Aug 16 22:41:14 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:41:14 user nova-compute[72773]:     </system>
Aug 16 22:41:14 user nova-compute[72773]:   </sysinfo>
Aug 16 22:41:14 user nova-compute[72773]:   <os>
Aug 16 22:41:14 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:41:14 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:41:14 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:41:14 user nova-compute[72773]:   </os>
Aug 16 22:41:14 user nova-compute[72773]:   <features>
Aug 16 22:41:14 user nova-compute[72773]:     <acpi/>
Aug 16 22:41:14 user nova-compute[72773]:     <apic/>
Aug 16 22:41:14 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:41:14 user nova-compute[72773]:   </features>
Aug 16 22:41:14 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:41:14 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:41:14 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:41:14 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:41:14 user nova-compute[72773]:   </clock>
Aug 16 22:41:14 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:41:14 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:41:14 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:41:14 user nova-compute[72773]:   </cpu>
Aug 16 22:41:14 user nova-compute[72773]:   <devices>
Aug 16 22:41:14 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:41:14 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:41:14 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/b99244c8-f6df-4c60-b8be-09fc4e644733/disk"/>
Aug 16 22:41:14 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:41:14 user nova-compute[72773]:     </disk>
Aug 16 22:41:14 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:41:14 user nova-compute[72773]:       <mac address="fa:16:3e:59:f9:55"/>
Aug 16 22:41:14 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:41:14 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:41:14 user nova-compute[72773]:       <target dev="tap4977c3dd-df"/>
Aug 16 22:41:14 user nova-compute[72773]:     </interface>
Aug 16 22:41:14 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:41:14 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/b99244c8-f6df-4c60-b8be-09fc4e644733/console.log" append="off"/>
Aug 16 22:41:14 user nova-compute[72773]:     </serial>
Aug 16 22:41:14 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:41:14 user nova-compute[72773]:     <video>
Aug 16 22:41:14 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:41:14 user nova-compute[72773]:     </video>
Aug 16 22:41:14 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:41:14 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:41:14 user nova-compute[72773]:     </rng>
Aug 16 22:41:14 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:41:14 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:41:14 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:41:14 user nova-compute[72773]:     </memballoon>
Aug 16 22:41:14 user nova-compute[72773]:   </devices>
Aug 16 22:41:14 user nova-compute[72773]: </domain>
Aug 16 22:41:14 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:41:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-265416519',display_name='tempest-VolumesNegativeTest-instance-265416519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-265416519',id=36,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec4c3fcf849453f8e5a2f0e3e6837df',ramdisk_id='',reservation_id='r-zls002oq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1957090774',owner_user_name='tempest-VolumesNegativeTest-1957090774-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:41:11Z,user_data=None,user_id='3b4d716629504e8bb9cdc2c50b224f6b',uuid=b99244c8-f6df-4c60-b8be-09fc4e644733,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4977c3dd-df4f-41a3-bff7-135cccdf164e", "address": "fa:16:3e:59:f9:55", "network": {"id": "8bc4a357-d1cb-4e20-b75b-9745ca8ed924", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "271c18b5b5f546819051ae850473f6b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4977c3dd-df", "ovs_interfaceid": "4977c3dd-df4f-41a3-bff7-135cccdf164e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Converting VIF {"id": "4977c3dd-df4f-41a3-bff7-135cccdf164e", "address": "fa:16:3e:59:f9:55", "network": {"id": "8bc4a357-d1cb-4e20-b75b-9745ca8ed924", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "271c18b5b5f546819051ae850473f6b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4977c3dd-df", "ovs_interfaceid": "4977c3dd-df4f-41a3-bff7-135cccdf164e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:f9:55,bridge_name='br-int',has_traffic_filtering=True,id=4977c3dd-df4f-41a3-bff7-135cccdf164e,network=Network(8bc4a357-d1cb-4e20-b75b-9745ca8ed924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4977c3dd-df') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG os_vif [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:f9:55,bridge_name='br-int',has_traffic_filtering=True,id=4977c3dd-df4f-41a3-bff7-135cccdf164e,network=Network(8bc4a357-d1cb-4e20-b75b-9745ca8ed924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4977c3dd-df') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4977c3dd-df, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4977c3dd-df, col_values=(('external_ids', {'iface-id': '4977c3dd-df4f-41a3-bff7-135cccdf164e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:f9:55', 'vm-uuid': 'b99244c8-f6df-4c60-b8be-09fc4e644733'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:14 user nova-compute[72773]: INFO os_vif [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:f9:55,bridge_name='br-int',has_traffic_filtering=True,id=4977c3dd-df4f-41a3-bff7-135cccdf164e,network=Network(8bc4a357-d1cb-4e20-b75b-9745ca8ed924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4977c3dd-df')
Aug 16 22:41:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:41:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] No VIF found with MAC fa:16:3e:59:f9:55, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:41:15 user nova-compute[72773]: DEBUG nova.network.neutron [req-2a374e28-aaf8-4c56-9ee1-e93f4973f6bb req-1ea0a465-e832-4ff6-a986-5b70a9882047 service nova] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Updated VIF entry in instance network info cache for port 4977c3dd-df4f-41a3-bff7-135cccdf164e. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:41:15 user nova-compute[72773]: DEBUG nova.network.neutron [req-2a374e28-aaf8-4c56-9ee1-e93f4973f6bb req-1ea0a465-e832-4ff6-a986-5b70a9882047 service nova] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Updating instance_info_cache with network_info: [{"id": "4977c3dd-df4f-41a3-bff7-135cccdf164e", "address": "fa:16:3e:59:f9:55", "network": {"id": "8bc4a357-d1cb-4e20-b75b-9745ca8ed924", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "271c18b5b5f546819051ae850473f6b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4977c3dd-df", "ovs_interfaceid": "4977c3dd-df4f-41a3-bff7-135cccdf164e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:41:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2a374e28-aaf8-4c56-9ee1-e93f4973f6bb req-1ea0a465-e832-4ff6-a986-5b70a9882047 service nova] Releasing lock "refresh_cache-b99244c8-f6df-4c60-b8be-09fc4e644733" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:41:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:15 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225675.990446, 60f877e9-8032-4781-8692-88853f420a3c => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:41:15 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 60f877e9-8032-4781-8692-88853f420a3c] VM Resumed (Lifecycle Event)
Aug 16 22:41:16 user nova-compute[72773]: DEBUG nova.compute.manager [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:41:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:41:16 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Instance spawned successfully.
Aug 16 22:41:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:41:16 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:41:16 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:41:16 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 60f877e9-8032-4781-8692-88853f420a3c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:41:16 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225675.9984388, 60f877e9-8032-4781-8692-88853f420a3c => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:41:16 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 60f877e9-8032-4781-8692-88853f420a3c] VM Started (Lifecycle Event)
Aug 16 22:41:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:41:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:41:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:41:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:41:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:41:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:41:16 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:41:16 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:41:16 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 60f877e9-8032-4781-8692-88853f420a3c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:41:16 user nova-compute[72773]: DEBUG nova.compute.manager [req-ae60dfad-4f8c-4322-bc69-7f1f75394691 req-94f0bcec-ef1a-4914-b44d-a1e0da37be63 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received event network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:41:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ae60dfad-4f8c-4322-bc69-7f1f75394691 req-94f0bcec-ef1a-4914-b44d-a1e0da37be63 service nova] Acquiring lock "60f877e9-8032-4781-8692-88853f420a3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ae60dfad-4f8c-4322-bc69-7f1f75394691 req-94f0bcec-ef1a-4914-b44d-a1e0da37be63 service nova] Lock "60f877e9-8032-4781-8692-88853f420a3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ae60dfad-4f8c-4322-bc69-7f1f75394691 req-94f0bcec-ef1a-4914-b44d-a1e0da37be63 service nova] Lock "60f877e9-8032-4781-8692-88853f420a3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:16 user nova-compute[72773]: DEBUG nova.compute.manager [req-ae60dfad-4f8c-4322-bc69-7f1f75394691 req-94f0bcec-ef1a-4914-b44d-a1e0da37be63 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] No waiting events found dispatching network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:41:16 user nova-compute[72773]: WARNING nova.compute.manager [req-ae60dfad-4f8c-4322-bc69-7f1f75394691 req-94f0bcec-ef1a-4914-b44d-a1e0da37be63 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received unexpected event network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 for instance with vm_state building and task_state spawning.
Aug 16 22:41:16 user nova-compute[72773]: INFO nova.compute.manager [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Took 6.98 seconds to spawn the instance on the hypervisor.
Aug 16 22:41:16 user nova-compute[72773]: DEBUG nova.compute.manager [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:41:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:16 user nova-compute[72773]: INFO nova.compute.manager [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Took 7.93 seconds to build instance.
Aug 16 22:41:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-617752dd-e997-4149-91b6-ca3214d86dca tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "60f877e9-8032-4781-8692-88853f420a3c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.053s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:18 user nova-compute[72773]: DEBUG nova.compute.manager [req-9c598787-0e1b-4b24-8e96-12b959e72cfe req-b2a02ecf-6887-49d9-8bcf-be2090743e5f service nova] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Received event network-vif-plugged-4977c3dd-df4f-41a3-bff7-135cccdf164e {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:41:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9c598787-0e1b-4b24-8e96-12b959e72cfe req-b2a02ecf-6887-49d9-8bcf-be2090743e5f service nova] Acquiring lock "b99244c8-f6df-4c60-b8be-09fc4e644733-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9c598787-0e1b-4b24-8e96-12b959e72cfe req-b2a02ecf-6887-49d9-8bcf-be2090743e5f service nova] Lock "b99244c8-f6df-4c60-b8be-09fc4e644733-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9c598787-0e1b-4b24-8e96-12b959e72cfe req-b2a02ecf-6887-49d9-8bcf-be2090743e5f service nova] Lock "b99244c8-f6df-4c60-b8be-09fc4e644733-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:18 user nova-compute[72773]: DEBUG nova.compute.manager [req-9c598787-0e1b-4b24-8e96-12b959e72cfe req-b2a02ecf-6887-49d9-8bcf-be2090743e5f service nova] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] No waiting events found dispatching network-vif-plugged-4977c3dd-df4f-41a3-bff7-135cccdf164e {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:41:18 user nova-compute[72773]: WARNING nova.compute.manager [req-9c598787-0e1b-4b24-8e96-12b959e72cfe req-b2a02ecf-6887-49d9-8bcf-be2090743e5f service nova] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Received unexpected event network-vif-plugged-4977c3dd-df4f-41a3-bff7-135cccdf164e for instance with vm_state building and task_state spawning.
Aug 16 22:41:18 user nova-compute[72773]: DEBUG nova.compute.manager [req-9c598787-0e1b-4b24-8e96-12b959e72cfe req-b2a02ecf-6887-49d9-8bcf-be2090743e5f service nova] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Received event network-vif-plugged-4977c3dd-df4f-41a3-bff7-135cccdf164e {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:41:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9c598787-0e1b-4b24-8e96-12b959e72cfe req-b2a02ecf-6887-49d9-8bcf-be2090743e5f service nova] Acquiring lock "b99244c8-f6df-4c60-b8be-09fc4e644733-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9c598787-0e1b-4b24-8e96-12b959e72cfe req-b2a02ecf-6887-49d9-8bcf-be2090743e5f service nova] Lock "b99244c8-f6df-4c60-b8be-09fc4e644733-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9c598787-0e1b-4b24-8e96-12b959e72cfe req-b2a02ecf-6887-49d9-8bcf-be2090743e5f service nova] Lock "b99244c8-f6df-4c60-b8be-09fc4e644733-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:18 user nova-compute[72773]: DEBUG nova.compute.manager [req-9c598787-0e1b-4b24-8e96-12b959e72cfe req-b2a02ecf-6887-49d9-8bcf-be2090743e5f service nova] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] No waiting events found dispatching network-vif-plugged-4977c3dd-df4f-41a3-bff7-135cccdf164e {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:41:18 user nova-compute[72773]: WARNING nova.compute.manager [req-9c598787-0e1b-4b24-8e96-12b959e72cfe req-b2a02ecf-6887-49d9-8bcf-be2090743e5f service nova] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Received unexpected event network-vif-plugged-4977c3dd-df4f-41a3-bff7-135cccdf164e for instance with vm_state building and task_state spawning.
Aug 16 22:41:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:18 user nova-compute[72773]: DEBUG nova.objects.instance [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lazy-loading 'pci_requests' on Instance uuid 7cf275ce-0647-43af-ad03-24cbac934b59 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:41:18 user nova-compute[72773]: DEBUG nova.objects.instance [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lazy-loading 'numa_topology' on Instance uuid 7cf275ce-0647-43af-ad03-24cbac934b59 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:41:18 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:41:18 user nova-compute[72773]: INFO nova.compute.claims [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Claim successful on node user
Aug 16 22:41:18 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:41:18 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:41:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.607s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:19 user nova-compute[72773]: INFO nova.network.neutron [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Updating port ef9aad5b-2373-47b5-910b-8664d08e5df5 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 16 22:41:19 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225679.103078, b99244c8-f6df-4c60-b8be-09fc4e644733 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:41:19 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] VM Resumed (Lifecycle Event)
Aug 16 22:41:19 user nova-compute[72773]: DEBUG nova.compute.manager [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:41:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:41:19 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Instance spawned successfully.
Aug 16 22:41:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:41:19 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:41:19 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:41:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:41:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:41:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:41:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:41:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:41:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:41:19 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:41:19 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225679.1054945, b99244c8-f6df-4c60-b8be-09fc4e644733 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:41:19 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] VM Started (Lifecycle Event)
Aug 16 22:41:19 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:41:19 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:41:19 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:41:19 user nova-compute[72773]: INFO nova.compute.manager [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Took 7.93 seconds to spawn the instance on the hypervisor.
Aug 16 22:41:19 user nova-compute[72773]: DEBUG nova.compute.manager [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:41:19 user nova-compute[72773]: INFO nova.compute.manager [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Took 9.04 seconds to build instance.
Aug 16 22:41:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5589c0ae-0153-4f09-9358-99f92d450b5d tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Lock "b99244c8-f6df-4c60-b8be-09fc4e644733" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.154s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Acquiring lock "refresh_cache-7cf275ce-0647-43af-ad03-24cbac934b59" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Acquired lock "refresh_cache-7cf275ce-0647-43af-ad03-24cbac934b59" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG nova.network.neutron [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-87e92203-b084-4992-95f6-fa5bea0a3486 req-a2efdfb0-3d77-4a34-bd8a-1bb4619117c3 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Received event network-changed-ef9aad5b-2373-47b5-910b-8664d08e5df5 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-87e92203-b084-4992-95f6-fa5bea0a3486 req-a2efdfb0-3d77-4a34-bd8a-1bb4619117c3 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Refreshing instance network info cache due to event network-changed-ef9aad5b-2373-47b5-910b-8664d08e5df5. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-87e92203-b084-4992-95f6-fa5bea0a3486 req-a2efdfb0-3d77-4a34-bd8a-1bb4619117c3 service nova] Acquiring lock "refresh_cache-7cf275ce-0647-43af-ad03-24cbac934b59" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG nova.network.neutron [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Updating instance_info_cache with network_info: [{"id": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "address": "fa:16:3e:11:03:33", "network": {"id": "09f1ea90-9baf-4dc6-965e-30b89fa0557d", "bridge": "br-int", "label": "tempest-TestShelveInstance-375734384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "128365b541d848b4a369bdb73a357786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9aad5b-23", "ovs_interfaceid": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Releasing lock "refresh_cache-7cf275ce-0647-43af-ad03-24cbac934b59" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:41:20 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Creating image(s)
Aug 16 22:41:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Did not create local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Ensure instance console log exists: /opt/stack/data/nova/instances/7cf275ce-0647-43af-ad03-24cbac934b59/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Start _get_guest_xml network_info=[{"id": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "address": "fa:16:3e:11:03:33", "network": {"id": "09f1ea90-9baf-4dc6-965e-30b89fa0557d", "bridge": "br-int", "label": "tempest-TestShelveInstance-375734384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "128365b541d848b4a369bdb73a357786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9aad5b-23", "ovs_interfaceid": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8233b16a-edf7-4512-bee2-fc1d40ff37cd', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YszrhEio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7cf275ce-0647-43af-ad03-24cbac934b59', 'attached_at': '', 'detached_at': '', 'volume_id': 'c203a677-77d4-45aa-a91d-f69ed23c7dca', 'serial': 'c203a677-77d4-45aa-a91d-f69ed23c7dca'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-87e92203-b084-4992-95f6-fa5bea0a3486 req-a2efdfb0-3d77-4a34-bd8a-1bb4619117c3 service nova] Acquired lock "refresh_cache-7cf275ce-0647-43af-ad03-24cbac934b59" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG nova.network.neutron [req-87e92203-b084-4992-95f6-fa5bea0a3486 req-a2efdfb0-3d77-4a34-bd8a-1bb4619117c3 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Refreshing network info cache for port ef9aad5b-2373-47b5-910b-8664d08e5df5 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:41:20 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:41:20 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:41:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG nova.objects.instance [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7cf275ce-0647-43af-ad03-24cbac934b59 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YszrhEio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:41:20 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:41:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.007s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:41:20 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:41:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:41:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:41:20 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:41:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07f3b66-f019-4f49-8de2-eaf56b372953]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:41:21 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ddb370-ee59-457f-8805-67cb62c92f84]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca] added
Aug 16 22:41:21 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b04b258-9cfe-4fb8-b77e-ea1be8328905]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bb56cd-3117-4c3f-9c29-0b484caccd15]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YszrhEio {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YszrhEio" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfaa15e-d722-4603-815d-bcd22b861102]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YszrhEio'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8924c6c2-c789-4941-b9c5-15a8cc42e7f1]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99e742b-4e25-4493-af59-7985e01dda82]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:41:21 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:41:21 user nova-compute[72773]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:41:21 user nova-compute[72773]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 (non-flash)
Aug 16 22:41:21 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:41:21 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:41:21 user nova-compute[72773]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:41:21 user nova-compute[72773]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 (non-flash)
Aug 16 22:41:21 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad51617d-8ea8-445b-b574-53a56e9623d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca, portal: 172.16.0.220,3260]
Aug 16 22:41:21 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca, portal: 172.16.0.220,3260] successful.
Aug 16 22:41:21 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52380fe-7fe8-4787-907c-66fddfadffc9]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edf0798-04e2-457f-9456-bed66447fa78]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:41:21 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:41:21 user nova-compute[72773]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:41:21 user nova-compute[72773]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 (non-flash)
Aug 16 22:41:21 user nova-compute[72773]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)
Aug 16 22:41:21 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:41:21 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:41:21 user nova-compute[72773]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:41:21 user nova-compute[72773]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 (non-flash)
Aug 16 22:41:21 user nova-compute[72773]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)
Aug 16 22:41:21 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] HCTL ('37', '-', '-', 0) found on session 38 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1d5ed6-95ff-4b3a-9c62-e6fd42fc30d3]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YszrhEio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG nova.network.neutron [req-87e92203-b084-4992-95f6-fa5bea0a3486 req-a2efdfb0-3d77-4a34-bd8a-1bb4619117c3 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Updated VIF entry in instance network info cache for port ef9aad5b-2373-47b5-910b-8664d08e5df5. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG nova.network.neutron [req-87e92203-b084-4992-95f6-fa5bea0a3486 req-a2efdfb0-3d77-4a34-bd8a-1bb4619117c3 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Updating instance_info_cache with network_info: [{"id": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "address": "fa:16:3e:11:03:33", "network": {"id": "09f1ea90-9baf-4dc6-965e-30b89fa0557d", "bridge": "br-int", "label": "tempest-TestShelveInstance-375734384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "128365b541d848b4a369bdb73a357786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9aad5b-23", "ovs_interfaceid": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:41:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-87e92203-b084-4992-95f6-fa5bea0a3486 req-a2efdfb0-3d77-4a34-bd8a-1bb4619117c3 service nova] Releasing lock "refresh_cache-7cf275ce-0647-43af-ad03-24cbac934b59" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:41:22 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:41:22 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] <== connect_volume: return (1435ms) {'type': 'block', 'scsi_wwn': '23033396563376432', 'path': '/dev/sdf'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:41:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033396563376432', 'path': '/dev/sdf'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:41:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T22:37:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1525734974',display_name='tempest-TestShelveInstance-server-1525734974',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1525734974',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-631846690',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:37:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='128365b541d848b4a369bdb73a357786',ramdisk_id='',reservation_id='r-ppxqqatm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1515246832',owner_user_name='tempest-TestShelveInstance-1515246832-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:41:04Z,user_data=None,user_id='6e5f5ea155144f91886018bc0057e13b',uuid=7cf275ce-0647-43af-ad03-24cbac934b59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "address": "fa:16:3e:11:03:33", "network": {"id": "09f1ea90-9baf-4dc6-965e-30b89fa0557d", "bridge": "br-int", "label": "tempest-TestShelveInstance-375734384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "128365b541d848b4a369bdb73a357786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9aad5b-23", "ovs_interfaceid": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:41:22 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Converting VIF {"id": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "address": "fa:16:3e:11:03:33", "network": {"id": "09f1ea90-9baf-4dc6-965e-30b89fa0557d", "bridge": "br-int", "label": "tempest-TestShelveInstance-375734384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "128365b541d848b4a369bdb73a357786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9aad5b-23", "ovs_interfaceid": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:41:22 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:03:33,bridge_name='br-int',has_traffic_filtering=True,id=ef9aad5b-2373-47b5-910b-8664d08e5df5,network=Network(09f1ea90-9baf-4dc6-965e-30b89fa0557d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef9aad5b-23') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:41:22 user nova-compute[72773]: DEBUG nova.objects.instance [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lazy-loading 'pci_devices' on Instance uuid 7cf275ce-0647-43af-ad03-24cbac934b59 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:41:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:41:22 user nova-compute[72773]:   <uuid>7cf275ce-0647-43af-ad03-24cbac934b59</uuid>
Aug 16 22:41:22 user nova-compute[72773]:   <name>instance-00000021</name>
Aug 16 22:41:22 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:41:22 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:41:22 user nova-compute[72773]:   <metadata>
Aug 16 22:41:22 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:41:22 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:41:22 user nova-compute[72773]:       <nova:name>tempest-TestShelveInstance-server-1525734974</nova:name>
Aug 16 22:41:22 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:41:20</nova:creationTime>
Aug 16 22:41:22 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:41:22 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:41:22 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:41:22 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:41:22 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:41:22 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:41:22 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:41:22 user nova-compute[72773]:       <nova:owner>
Aug 16 22:41:22 user nova-compute[72773]:         <nova:user uuid="6e5f5ea155144f91886018bc0057e13b">tempest-TestShelveInstance-1515246832-project-member</nova:user>
Aug 16 22:41:22 user nova-compute[72773]:         <nova:project uuid="128365b541d848b4a369bdb73a357786">tempest-TestShelveInstance-1515246832</nova:project>
Aug 16 22:41:22 user nova-compute[72773]:       </nova:owner>
Aug 16 22:41:22 user nova-compute[72773]:       <nova:ports>
Aug 16 22:41:22 user nova-compute[72773]:         <nova:port uuid="ef9aad5b-2373-47b5-910b-8664d08e5df5">
Aug 16 22:41:22 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 22:41:22 user nova-compute[72773]:         </nova:port>
Aug 16 22:41:22 user nova-compute[72773]:       </nova:ports>
Aug 16 22:41:22 user nova-compute[72773]:     </nova:instance>
Aug 16 22:41:22 user nova-compute[72773]:   </metadata>
Aug 16 22:41:22 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:41:22 user nova-compute[72773]:     <system>
Aug 16 22:41:22 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:41:22 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:41:22 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:41:22 user nova-compute[72773]:       <entry name="serial">7cf275ce-0647-43af-ad03-24cbac934b59</entry>
Aug 16 22:41:22 user nova-compute[72773]:       <entry name="uuid">7cf275ce-0647-43af-ad03-24cbac934b59</entry>
Aug 16 22:41:22 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:41:22 user nova-compute[72773]:     </system>
Aug 16 22:41:22 user nova-compute[72773]:   </sysinfo>
Aug 16 22:41:22 user nova-compute[72773]:   <os>
Aug 16 22:41:22 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:41:22 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:41:22 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:41:22 user nova-compute[72773]:   </os>
Aug 16 22:41:22 user nova-compute[72773]:   <features>
Aug 16 22:41:22 user nova-compute[72773]:     <acpi/>
Aug 16 22:41:22 user nova-compute[72773]:     <apic/>
Aug 16 22:41:22 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:41:22 user nova-compute[72773]:   </features>
Aug 16 22:41:22 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:41:22 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:41:22 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:41:22 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:41:22 user nova-compute[72773]:   </clock>
Aug 16 22:41:22 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:41:22 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:41:22 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:41:22 user nova-compute[72773]:   </cpu>
Aug 16 22:41:22 user nova-compute[72773]:   <devices>
Aug 16 22:41:22 user nova-compute[72773]:     <disk type="block" device="disk">
Aug 16 22:41:22 user nova-compute[72773]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:41:22 user nova-compute[72773]:       <source dev="/dev/sdf"/>
Aug 16 22:41:22 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:41:22 user nova-compute[72773]:       <serial>c203a677-77d4-45aa-a91d-f69ed23c7dca</serial>
Aug 16 22:41:22 user nova-compute[72773]:     </disk>
Aug 16 22:41:22 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:41:22 user nova-compute[72773]:       <mac address="fa:16:3e:11:03:33"/>
Aug 16 22:41:22 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:41:22 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:41:22 user nova-compute[72773]:       <target dev="tapef9aad5b-23"/>
Aug 16 22:41:22 user nova-compute[72773]:     </interface>
Aug 16 22:41:22 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:41:22 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/7cf275ce-0647-43af-ad03-24cbac934b59/console.log" append="off"/>
Aug 16 22:41:22 user nova-compute[72773]:     </serial>
Aug 16 22:41:22 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:41:22 user nova-compute[72773]:     <video>
Aug 16 22:41:22 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:41:22 user nova-compute[72773]:     </video>
Aug 16 22:41:22 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:41:22 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:41:22 user nova-compute[72773]:     </rng>
Aug 16 22:41:22 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:41:22 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:41:22 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:41:22 user nova-compute[72773]:     </memballoon>
Aug 16 22:41:22 user nova-compute[72773]:   </devices>
Aug 16 22:41:22 user nova-compute[72773]: </domain>
Aug 16 22:41:22 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:41:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T22:37:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1525734974',display_name='tempest-TestShelveInstance-server-1525734974',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1525734974',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-631846690',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:37:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='128365b541d848b4a369bdb73a357786',ramdisk_id='',reservation_id='r-ppxqqatm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1515246832',owner_user_name='tempest-TestShelveInstance-1515246832-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:41:04Z,user_data=None,user_id='6e5f5ea155144f91886018bc0057e13b',uuid=7cf275ce-0647-43af-ad03-24cbac934b59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "address": "fa:16:3e:11:03:33", "network": {"id": "09f1ea90-9baf-4dc6-965e-30b89fa0557d", "bridge": "br-int", "label": "tempest-TestShelveInstance-375734384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "128365b541d848b4a369bdb73a357786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9aad5b-23", "ovs_interfaceid": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:41:22 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Converting VIF {"id": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "address": "fa:16:3e:11:03:33", "network": {"id": "09f1ea90-9baf-4dc6-965e-30b89fa0557d", "bridge": "br-int", "label": "tempest-TestShelveInstance-375734384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "128365b541d848b4a369bdb73a357786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9aad5b-23", "ovs_interfaceid": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:41:22 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:03:33,bridge_name='br-int',has_traffic_filtering=True,id=ef9aad5b-2373-47b5-910b-8664d08e5df5,network=Network(09f1ea90-9baf-4dc6-965e-30b89fa0557d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef9aad5b-23') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:41:22 user nova-compute[72773]: DEBUG os_vif [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:03:33,bridge_name='br-int',has_traffic_filtering=True,id=ef9aad5b-2373-47b5-910b-8664d08e5df5,network=Network(09f1ea90-9baf-4dc6-965e-30b89fa0557d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef9aad5b-23') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:41:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:41:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:41:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef9aad5b-23, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:41:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapef9aad5b-23, col_values=(('external_ids', {'iface-id': 'ef9aad5b-2373-47b5-910b-8664d08e5df5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:03:33', 'vm-uuid': '7cf275ce-0647-43af-ad03-24cbac934b59'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:41:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:41:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:22 user nova-compute[72773]: INFO os_vif [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:03:33,bridge_name='br-int',has_traffic_filtering=True,id=ef9aad5b-2373-47b5-910b-8664d08e5df5,network=Network(09f1ea90-9baf-4dc6-965e-30b89fa0557d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef9aad5b-23')
Aug 16 22:41:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:41:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] No VIF found with MAC fa:16:3e:11:03:33, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:41:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:24 user nova-compute[72773]: DEBUG nova.compute.manager [req-f6f41a53-5711-4863-b98b-7fd7e7b252e9 req-fb2e5cd5-fcd7-4913-922c-247f70f609a5 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Received event network-vif-plugged-ef9aad5b-2373-47b5-910b-8664d08e5df5 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:41:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f6f41a53-5711-4863-b98b-7fd7e7b252e9 req-fb2e5cd5-fcd7-4913-922c-247f70f609a5 service nova] Acquiring lock "7cf275ce-0647-43af-ad03-24cbac934b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f6f41a53-5711-4863-b98b-7fd7e7b252e9 req-fb2e5cd5-fcd7-4913-922c-247f70f609a5 service nova] Lock "7cf275ce-0647-43af-ad03-24cbac934b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f6f41a53-5711-4863-b98b-7fd7e7b252e9 req-fb2e5cd5-fcd7-4913-922c-247f70f609a5 service nova] Lock "7cf275ce-0647-43af-ad03-24cbac934b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:24 user nova-compute[72773]: DEBUG nova.compute.manager [req-f6f41a53-5711-4863-b98b-7fd7e7b252e9 req-fb2e5cd5-fcd7-4913-922c-247f70f609a5 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] No waiting events found dispatching network-vif-plugged-ef9aad5b-2373-47b5-910b-8664d08e5df5 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:41:24 user nova-compute[72773]: WARNING nova.compute.manager [req-f6f41a53-5711-4863-b98b-7fd7e7b252e9 req-fb2e5cd5-fcd7-4913-922c-247f70f609a5 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Received unexpected event network-vif-plugged-ef9aad5b-2373-47b5-910b-8664d08e5df5 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 22:41:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:26 user nova-compute[72773]: DEBUG nova.compute.manager [req-286c897f-2c1e-47a8-a955-ac1f1ec67365 req-75bcd4d7-94df-48b3-9150-b0b1fa4a4025 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Received event network-vif-plugged-ef9aad5b-2373-47b5-910b-8664d08e5df5 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:41:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-286c897f-2c1e-47a8-a955-ac1f1ec67365 req-75bcd4d7-94df-48b3-9150-b0b1fa4a4025 service nova] Acquiring lock "7cf275ce-0647-43af-ad03-24cbac934b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-286c897f-2c1e-47a8-a955-ac1f1ec67365 req-75bcd4d7-94df-48b3-9150-b0b1fa4a4025 service nova] Lock "7cf275ce-0647-43af-ad03-24cbac934b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-286c897f-2c1e-47a8-a955-ac1f1ec67365 req-75bcd4d7-94df-48b3-9150-b0b1fa4a4025 service nova] Lock "7cf275ce-0647-43af-ad03-24cbac934b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:26 user nova-compute[72773]: DEBUG nova.compute.manager [req-286c897f-2c1e-47a8-a955-ac1f1ec67365 req-75bcd4d7-94df-48b3-9150-b0b1fa4a4025 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] No waiting events found dispatching network-vif-plugged-ef9aad5b-2373-47b5-910b-8664d08e5df5 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:41:26 user nova-compute[72773]: WARNING nova.compute.manager [req-286c897f-2c1e-47a8-a955-ac1f1ec67365 req-75bcd4d7-94df-48b3-9150-b0b1fa4a4025 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Received unexpected event network-vif-plugged-ef9aad5b-2373-47b5-910b-8664d08e5df5 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 22:41:26 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225686.6287649, 7cf275ce-0647-43af-ad03-24cbac934b59 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:41:26 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] VM Resumed (Lifecycle Event)
Aug 16 22:41:26 user nova-compute[72773]: DEBUG nova.compute.manager [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:41:26 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:41:26 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:41:26 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Instance spawned successfully.
Aug 16 22:41:26 user nova-compute[72773]: DEBUG nova.compute.manager [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:41:26 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:41:26 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:41:26 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225686.6321335, 7cf275ce-0647-43af-ad03-24cbac934b59 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:41:26 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] VM Started (Lifecycle Event)
Aug 16 22:41:26 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:41:26 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:41:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8e5366fa-d63a-4f36-ae16-e97aa2933eb8 tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lock "7cf275ce-0647-43af-ad03-24cbac934b59" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 22.646s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_power_states {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Triggering sync for uuid 956d334e-f190-4625-b144-ab44d2f3321a {{(pid=72773) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Triggering sync for uuid 030d076d-5099-4236-ae31-6025017eb51e {{(pid=72773) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Triggering sync for uuid 391a6006-4fe6-4398-a1e8-ae95b5edbf2b {{(pid=72773) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Triggering sync for uuid cf01c401-c424-4b3e-aa5b-439d62b1ae4c {{(pid=72773) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Triggering sync for uuid 23894101-2fd3-41a4-83a3-8f6869d24d97 {{(pid=72773) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Triggering sync for uuid 5ebcd117-6765-44eb-871b-226afd58e4e1 {{(pid=72773) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Triggering sync for uuid f4210738-d01e-4408-a15c-aeccada6dd23 {{(pid=72773) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Triggering sync for uuid 2c59217c-22f8-4745-b05e-53300ca454f2 {{(pid=72773) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Triggering sync for uuid 7cf275ce-0647-43af-ad03-24cbac934b59 {{(pid=72773) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Triggering sync for uuid 05f47c14-f17f-43d9-b607-bccc9a0c3957 {{(pid=72773) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Triggering sync for uuid 60f877e9-8032-4781-8692-88853f420a3c {{(pid=72773) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Triggering sync for uuid b99244c8-f6df-4c60-b8be-09fc4e644733 {{(pid=72773) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "956d334e-f190-4625-b144-ab44d2f3321a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "956d334e-f190-4625-b144-ab44d2f3321a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "030d076d-5099-4236-ae31-6025017eb51e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "030d076d-5099-4236-ae31-6025017eb51e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "23894101-2fd3-41a4-83a3-8f6869d24d97" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "5ebcd117-6765-44eb-871b-226afd58e4e1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "5ebcd117-6765-44eb-871b-226afd58e4e1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "f4210738-d01e-4408-a15c-aeccada6dd23" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "f4210738-d01e-4408-a15c-aeccada6dd23" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "2c59217c-22f8-4745-b05e-53300ca454f2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "2c59217c-22f8-4745-b05e-53300ca454f2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "7cf275ce-0647-43af-ad03-24cbac934b59" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "7cf275ce-0647-43af-ad03-24cbac934b59" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "05f47c14-f17f-43d9-b607-bccc9a0c3957" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "05f47c14-f17f-43d9-b607-bccc9a0c3957" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "60f877e9-8032-4781-8692-88853f420a3c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "60f877e9-8032-4781-8692-88853f420a3c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "b99244c8-f6df-4c60-b8be-09fc4e644733" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "b99244c8-f6df-4c60-b8be-09fc4e644733" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "030d076d-5099-4236-ae31-6025017eb51e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "956d334e-f190-4625-b144-ab44d2f3321a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "5ebcd117-6765-44eb-871b-226afd58e4e1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "f4210738-d01e-4408-a15c-aeccada6dd23" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "2c59217c-22f8-4745-b05e-53300ca454f2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "7cf275ce-0647-43af-ad03-24cbac934b59" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "05f47c14-f17f-43d9-b607-bccc9a0c3957" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "60f877e9-8032-4781-8692-88853f420a3c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.109s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "b99244c8-f6df-4c60-b8be-09fc4e644733" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:53 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:41:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Acquiring lock "85969e4e-3ee6-4f76-9598-960282e030af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "85969e4e-3ee6-4f76-9598-960282e030af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:55 user nova-compute[72773]: DEBUG nova.compute.manager [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:41:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:55 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:41:55 user nova-compute[72773]: INFO nova.compute.claims [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Claim successful on node user
Aug 16 22:41:56 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:41:56 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:41:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.591s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:56 user nova-compute[72773]: DEBUG nova.compute.manager [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:41:56 user nova-compute[72773]: DEBUG nova.compute.manager [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:41:56 user nova-compute[72773]: DEBUG nova.network.neutron [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:41:56 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:41:56 user nova-compute[72773]: DEBUG nova.compute.manager [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:41:56 user nova-compute[72773]: DEBUG nova.policy [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f871d59634eb4b08a3671b860be5dbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2606202eee724d63a4f3596b520b8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:41:56 user nova-compute[72773]: DEBUG nova.compute.manager [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:41:56 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:41:56 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Creating image(s)
Aug 16 22:41:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Acquiring lock "/opt/stack/data/nova/instances/85969e4e-3ee6-4f76-9598-960282e030af/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "/opt/stack/data/nova/instances/85969e4e-3ee6-4f76-9598-960282e030af/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "/opt/stack/data/nova/instances/85969e4e-3ee6-4f76-9598-960282e030af/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.244s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.198s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/85969e4e-3ee6-4f76-9598-960282e030af/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/85969e4e-3ee6-4f76-9598-960282e030af/disk 1073741824" returned: 0 in 0.059s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:57 user nova-compute[72773]: DEBUG nova.network.neutron [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Successfully created port: a032c74c-6676-4542-9419-7338d24d7648 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:41:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.241s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:57 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85969e4e-3ee6-4f76-9598-960282e030af/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:41:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85969e4e-3ee6-4f76-9598-960282e030af/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:41:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85969e4e-3ee6-4f76-9598-960282e030af/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:41:57 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Cannot resize image /opt/stack/data/nova/instances/85969e4e-3ee6-4f76-9598-960282e030af/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:41:57 user nova-compute[72773]: DEBUG nova.objects.instance [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lazy-loading 'migration_context' on Instance uuid 85969e4e-3ee6-4f76-9598-960282e030af {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:41:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:41:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Ensure instance console log exists: /opt/stack/data/nova/instances/85969e4e-3ee6-4f76-9598-960282e030af/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:41:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:41:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:41:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:41:58 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:41:58 user nova-compute[72773]: DEBUG nova.network.neutron [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Successfully updated port: a032c74c-6676-4542-9419-7338d24d7648 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:41:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Acquiring lock "refresh_cache-85969e4e-3ee6-4f76-9598-960282e030af" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:41:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Acquired lock "refresh_cache-85969e4e-3ee6-4f76-9598-960282e030af" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:41:58 user nova-compute[72773]: DEBUG nova.network.neutron [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:41:58 user nova-compute[72773]: DEBUG nova.network.neutron [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:41:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-5e24c42c-9326-442f-8f49-86c8e9e2f735 req-e58e0f52-57db-48e2-bbff-b1d4045477e6 service nova] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Received event network-changed-a032c74c-6676-4542-9419-7338d24d7648 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:41:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-5e24c42c-9326-442f-8f49-86c8e9e2f735 req-e58e0f52-57db-48e2-bbff-b1d4045477e6 service nova] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Refreshing instance network info cache due to event network-changed-a032c74c-6676-4542-9419-7338d24d7648. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:41:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5e24c42c-9326-442f-8f49-86c8e9e2f735 req-e58e0f52-57db-48e2-bbff-b1d4045477e6 service nova] Acquiring lock "refresh_cache-85969e4e-3ee6-4f76-9598-960282e030af" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:41:58 user nova-compute[72773]: DEBUG nova.network.neutron [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Updating instance_info_cache with network_info: [{"id": "a032c74c-6676-4542-9419-7338d24d7648", "address": "fa:16:3e:da:a9:c3", "network": {"id": "fbbd26d0-dfa2-4568-b941-8603e19595eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-767228890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2606202eee724d63a4f3596b520b8867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa032c74c-66", "ovs_interfaceid": "a032c74c-6676-4542-9419-7338d24d7648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:41:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Releasing lock "refresh_cache-85969e4e-3ee6-4f76-9598-960282e030af" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:41:58 user nova-compute[72773]: DEBUG nova.compute.manager [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Instance network_info: |[{"id": "a032c74c-6676-4542-9419-7338d24d7648", "address": "fa:16:3e:da:a9:c3", "network": {"id": "fbbd26d0-dfa2-4568-b941-8603e19595eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-767228890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2606202eee724d63a4f3596b520b8867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa032c74c-66", "ovs_interfaceid": "a032c74c-6676-4542-9419-7338d24d7648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:41:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5e24c42c-9326-442f-8f49-86c8e9e2f735 req-e58e0f52-57db-48e2-bbff-b1d4045477e6 service nova] Acquired lock "refresh_cache-85969e4e-3ee6-4f76-9598-960282e030af" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:41:58 user nova-compute[72773]: DEBUG nova.network.neutron [req-5e24c42c-9326-442f-8f49-86c8e9e2f735 req-e58e0f52-57db-48e2-bbff-b1d4045477e6 service nova] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Refreshing network info cache for port a032c74c-6676-4542-9419-7338d24d7648 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:41:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Start _get_guest_xml network_info=[{"id": "a032c74c-6676-4542-9419-7338d24d7648", "address": "fa:16:3e:da:a9:c3", "network": {"id": "fbbd26d0-dfa2-4568-b941-8603e19595eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-767228890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2606202eee724d63a4f3596b520b8867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa032c74c-66", "ovs_interfaceid": "a032c74c-6676-4542-9419-7338d24d7648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:41:58 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:41:58 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:41:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:41:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:41:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:41:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:41:58 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:41:58 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:41:58 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:41:58 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:41:58 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:41:58 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:41:58 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:41:58 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:41:58 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:41:58 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:41:58 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:41:58 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:41:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:41:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1269750788',display_name='tempest-TestServerVolumeAttachmentScenario-server-1269750788',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1269750788',id=37,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6X9D0XVGcAmhFA21Y5OQ72eetWcx2oEQJIvkKEwFRGZBwe+WkHDNvKRtM8hMwe1DNjIre98T3PDfrbg/q/HMNPTUd4uSP7/c0dUwsP8OaSvh2rjaqzl+HJcSgQtuw1xQ==',key_name='tempest-keypair-563107463',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2606202eee724d63a4f3596b520b8867',ramdisk_id='',reservation_id='r-x2akdsl5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-100847313',owner_user_name='tempest-TestServerVolumeAttachmentScenario-100847313-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:41:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f871d59634eb4b08a3671b860be5dbf9',uuid=85969e4e-3ee6-4f76-9598-960282e030af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a032c74c-6676-4542-9419-7338d24d7648", "address": "fa:16:3e:da:a9:c3", "network": {"id": "fbbd26d0-dfa2-4568-b941-8603e19595eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-767228890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2606202eee724d63a4f3596b520b8867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa032c74c-66", "ovs_interfaceid": "a032c74c-6676-4542-9419-7338d24d7648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:41:59 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Converting VIF {"id": "a032c74c-6676-4542-9419-7338d24d7648", "address": "fa:16:3e:da:a9:c3", "network": {"id": "fbbd26d0-dfa2-4568-b941-8603e19595eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-767228890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2606202eee724d63a4f3596b520b8867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa032c74c-66", "ovs_interfaceid": "a032c74c-6676-4542-9419-7338d24d7648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:41:59 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:a9:c3,bridge_name='br-int',has_traffic_filtering=True,id=a032c74c-6676-4542-9419-7338d24d7648,network=Network(fbbd26d0-dfa2-4568-b941-8603e19595eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa032c74c-66') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:41:59 user nova-compute[72773]: DEBUG nova.objects.instance [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lazy-loading 'pci_devices' on Instance uuid 85969e4e-3ee6-4f76-9598-960282e030af {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:41:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:41:59 user nova-compute[72773]:   <uuid>85969e4e-3ee6-4f76-9598-960282e030af</uuid>
Aug 16 22:41:59 user nova-compute[72773]:   <name>instance-00000025</name>
Aug 16 22:41:59 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:41:59 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:41:59 user nova-compute[72773]:   <metadata>
Aug 16 22:41:59 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:41:59 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:41:59 user nova-compute[72773]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1269750788</nova:name>
Aug 16 22:41:59 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:41:58</nova:creationTime>
Aug 16 22:41:59 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:41:59 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:41:59 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:41:59 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:41:59 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:41:59 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:41:59 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:41:59 user nova-compute[72773]:       <nova:owner>
Aug 16 22:41:59 user nova-compute[72773]:         <nova:user uuid="f871d59634eb4b08a3671b860be5dbf9">tempest-TestServerVolumeAttachmentScenario-100847313-project-member</nova:user>
Aug 16 22:41:59 user nova-compute[72773]:         <nova:project uuid="2606202eee724d63a4f3596b520b8867">tempest-TestServerVolumeAttachmentScenario-100847313</nova:project>
Aug 16 22:41:59 user nova-compute[72773]:       </nova:owner>
Aug 16 22:41:59 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:41:59 user nova-compute[72773]:       <nova:ports>
Aug 16 22:41:59 user nova-compute[72773]:         <nova:port uuid="a032c74c-6676-4542-9419-7338d24d7648">
Aug 16 22:41:59 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 22:41:59 user nova-compute[72773]:         </nova:port>
Aug 16 22:41:59 user nova-compute[72773]:       </nova:ports>
Aug 16 22:41:59 user nova-compute[72773]:     </nova:instance>
Aug 16 22:41:59 user nova-compute[72773]:   </metadata>
Aug 16 22:41:59 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:41:59 user nova-compute[72773]:     <system>
Aug 16 22:41:59 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:41:59 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:41:59 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:41:59 user nova-compute[72773]:       <entry name="serial">85969e4e-3ee6-4f76-9598-960282e030af</entry>
Aug 16 22:41:59 user nova-compute[72773]:       <entry name="uuid">85969e4e-3ee6-4f76-9598-960282e030af</entry>
Aug 16 22:41:59 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:41:59 user nova-compute[72773]:     </system>
Aug 16 22:41:59 user nova-compute[72773]:   </sysinfo>
Aug 16 22:41:59 user nova-compute[72773]:   <os>
Aug 16 22:41:59 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:41:59 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:41:59 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:41:59 user nova-compute[72773]:   </os>
Aug 16 22:41:59 user nova-compute[72773]:   <features>
Aug 16 22:41:59 user nova-compute[72773]:     <acpi/>
Aug 16 22:41:59 user nova-compute[72773]:     <apic/>
Aug 16 22:41:59 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:41:59 user nova-compute[72773]:   </features>
Aug 16 22:41:59 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:41:59 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:41:59 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:41:59 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:41:59 user nova-compute[72773]:   </clock>
Aug 16 22:41:59 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:41:59 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:41:59 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:41:59 user nova-compute[72773]:   </cpu>
Aug 16 22:41:59 user nova-compute[72773]:   <devices>
Aug 16 22:41:59 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:41:59 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:41:59 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/85969e4e-3ee6-4f76-9598-960282e030af/disk"/>
Aug 16 22:41:59 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:41:59 user nova-compute[72773]:     </disk>
Aug 16 22:41:59 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:41:59 user nova-compute[72773]:       <mac address="fa:16:3e:da:a9:c3"/>
Aug 16 22:41:59 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:41:59 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:41:59 user nova-compute[72773]:       <target dev="tapa032c74c-66"/>
Aug 16 22:41:59 user nova-compute[72773]:     </interface>
Aug 16 22:41:59 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:41:59 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/85969e4e-3ee6-4f76-9598-960282e030af/console.log" append="off"/>
Aug 16 22:41:59 user nova-compute[72773]:     </serial>
Aug 16 22:41:59 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:41:59 user nova-compute[72773]:     <video>
Aug 16 22:41:59 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:41:59 user nova-compute[72773]:     </video>
Aug 16 22:41:59 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:41:59 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:41:59 user nova-compute[72773]:     </rng>
Aug 16 22:41:59 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:41:59 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:41:59 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:41:59 user nova-compute[72773]:     </memballoon>
Aug 16 22:41:59 user nova-compute[72773]:   </devices>
Aug 16 22:41:59 user nova-compute[72773]: </domain>
Aug 16 22:41:59 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:41:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:41:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1269750788',display_name='tempest-TestServerVolumeAttachmentScenario-server-1269750788',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1269750788',id=37,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6X9D0XVGcAmhFA21Y5OQ72eetWcx2oEQJIvkKEwFRGZBwe+WkHDNvKRtM8hMwe1DNjIre98T3PDfrbg/q/HMNPTUd4uSP7/c0dUwsP8OaSvh2rjaqzl+HJcSgQtuw1xQ==',key_name='tempest-keypair-563107463',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2606202eee724d63a4f3596b520b8867',ramdisk_id='',reservation_id='r-x2akdsl5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-100847313',owner_user_name='tempest-TestServerVolumeAttachmentScenario-100847313-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:41:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f871d59634eb4b08a3671b860be5dbf9',uuid=85969e4e-3ee6-4f76-9598-960282e030af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a032c74c-6676-4542-9419-7338d24d7648", "address": "fa:16:3e:da:a9:c3", "network": {"id": "fbbd26d0-dfa2-4568-b941-8603e19595eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-767228890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2606202eee724d63a4f3596b520b8867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa032c74c-66", "ovs_interfaceid": "a032c74c-6676-4542-9419-7338d24d7648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:41:59 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Converting VIF {"id": "a032c74c-6676-4542-9419-7338d24d7648", "address": "fa:16:3e:da:a9:c3", "network": {"id": "fbbd26d0-dfa2-4568-b941-8603e19595eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-767228890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2606202eee724d63a4f3596b520b8867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa032c74c-66", "ovs_interfaceid": "a032c74c-6676-4542-9419-7338d24d7648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:41:59 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:a9:c3,bridge_name='br-int',has_traffic_filtering=True,id=a032c74c-6676-4542-9419-7338d24d7648,network=Network(fbbd26d0-dfa2-4568-b941-8603e19595eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa032c74c-66') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:41:59 user nova-compute[72773]: DEBUG os_vif [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:a9:c3,bridge_name='br-int',has_traffic_filtering=True,id=a032c74c-6676-4542-9419-7338d24d7648,network=Network(fbbd26d0-dfa2-4568-b941-8603e19595eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa032c74c-66') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:41:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:41:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:41:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa032c74c-66, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:41:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa032c74c-66, col_values=(('external_ids', {'iface-id': 'a032c74c-6676-4542-9419-7338d24d7648', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:a9:c3', 'vm-uuid': '85969e4e-3ee6-4f76-9598-960282e030af'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:41:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:41:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:41:59 user nova-compute[72773]: INFO os_vif [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:a9:c3,bridge_name='br-int',has_traffic_filtering=True,id=a032c74c-6676-4542-9419-7338d24d7648,network=Network(fbbd26d0-dfa2-4568-b941-8603e19595eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa032c74c-66')
Aug 16 22:41:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:41:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] No VIF found with MAC fa:16:3e:da:a9:c3, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:41:59 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:41:59 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:41:59 user nova-compute[72773]: DEBUG nova.network.neutron [req-5e24c42c-9326-442f-8f49-86c8e9e2f735 req-e58e0f52-57db-48e2-bbff-b1d4045477e6 service nova] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Updated VIF entry in instance network info cache for port a032c74c-6676-4542-9419-7338d24d7648. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:41:59 user nova-compute[72773]: DEBUG nova.network.neutron [req-5e24c42c-9326-442f-8f49-86c8e9e2f735 req-e58e0f52-57db-48e2-bbff-b1d4045477e6 service nova] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Updating instance_info_cache with network_info: [{"id": "a032c74c-6676-4542-9419-7338d24d7648", "address": "fa:16:3e:da:a9:c3", "network": {"id": "fbbd26d0-dfa2-4568-b941-8603e19595eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-767228890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2606202eee724d63a4f3596b520b8867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa032c74c-66", "ovs_interfaceid": "a032c74c-6676-4542-9419-7338d24d7648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:41:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5e24c42c-9326-442f-8f49-86c8e9e2f735 req-e58e0f52-57db-48e2-bbff-b1d4045477e6 service nova] Releasing lock "refresh_cache-85969e4e-3ee6-4f76-9598-960282e030af" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:41:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-23894101-2fd3-41a4-83a3-8f6869d24d97" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:41:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-23894101-2fd3-41a4-83a3-8f6869d24d97" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:41:59 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 22:42:00 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Updating instance_info_cache with network_info: [{"id": "5725a1df-f51f-4ba4-99f7-777975663b2e", "address": "fa:16:3e:98:fa:bf", "network": {"id": "00744c2a-d566-47bc-abeb-8e9bc9ab312d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-384143120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cafc1d829ed749c2bfe35f7bc58e331c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5725a1df-f5", "ovs_interfaceid": "5725a1df-f51f-4ba4-99f7-777975663b2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:42:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-23894101-2fd3-41a4-83a3-8f6869d24d97" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:42:00 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 22:42:00 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:42:00 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:42:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:00 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:42:00 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:42:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Acquiring lock "23894101-2fd3-41a4-83a3-8f6869d24d97" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:42:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:42:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Acquiring lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:42:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:42:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:42:00 user nova-compute[72773]: INFO nova.compute.manager [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Terminating instance
Aug 16 22:42:00 user nova-compute[72773]: DEBUG nova.compute.manager [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:42:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "2c59217c-22f8-4745-b05e-53300ca454f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "2c59217c-22f8-4745-b05e-53300ca454f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG nova.compute.manager [req-d06e6167-1c96-4b30-9adc-ee124a85e7cb req-b2f0059a-178b-47e7-ac31-353dd6da3a3d service nova] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Received event network-vif-plugged-a032c74c-6676-4542-9419-7338d24d7648 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d06e6167-1c96-4b30-9adc-ee124a85e7cb req-b2f0059a-178b-47e7-ac31-353dd6da3a3d service nova] Acquiring lock "85969e4e-3ee6-4f76-9598-960282e030af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d06e6167-1c96-4b30-9adc-ee124a85e7cb req-b2f0059a-178b-47e7-ac31-353dd6da3a3d service nova] Lock "85969e4e-3ee6-4f76-9598-960282e030af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d06e6167-1c96-4b30-9adc-ee124a85e7cb req-b2f0059a-178b-47e7-ac31-353dd6da3a3d service nova] Lock "85969e4e-3ee6-4f76-9598-960282e030af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG nova.compute.manager [req-d06e6167-1c96-4b30-9adc-ee124a85e7cb req-b2f0059a-178b-47e7-ac31-353dd6da3a3d service nova] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] No waiting events found dispatching network-vif-plugged-a032c74c-6676-4542-9419-7338d24d7648 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:42:01 user nova-compute[72773]: WARNING nova.compute.manager [req-d06e6167-1c96-4b30-9adc-ee124a85e7cb req-b2f0059a-178b-47e7-ac31-353dd6da3a3d service nova] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Received unexpected event network-vif-plugged-a032c74c-6676-4542-9419-7338d24d7648 for instance with vm_state building and task_state spawning.
Aug 16 22:42:01 user nova-compute[72773]: INFO nova.compute.manager [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Terminating instance
Aug 16 22:42:01 user nova-compute[72773]: DEBUG nova.compute.manager [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:01 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Instance destroyed successfully.
Aug 16 22:42:01 user nova-compute[72773]: DEBUG nova.objects.instance [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lazy-loading 'resources' on Instance uuid 23894101-2fd3-41a4-83a3-8f6869d24d97 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:33:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2107689448',display_name='tempest-ServerActionsTestOtherB-server-2107689448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2107689448',id=26,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh1GymZbw24IcnH5dONTb6loGV9Z6Plyeb2rJeaUseM4wpzMr4OTPGkSKihakM6H3XgBNMxcd+thJYbV9RDvja0dJb4k7n+wBitov4O9EMqeBt9unfmT2aB8P/P3aCmCA==',key_name='tempest-keypair-1176159006',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:39:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cafc1d829ed749c2bfe35f7bc58e331c',ramdisk_id='',reservation_id='r-sdzz0nnk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1140735028',owner_user_name='tempest-ServerActionsTestOtherB-1140735028-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:39:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cdb4ae56354496ab9e3f71461bd9d6d',uuid=23894101-2fd3-41a4-83a3-8f6869d24d97,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5725a1df-f51f-4ba4-99f7-777975663b2e", "address": "fa:16:3e:98:fa:bf", "network": {"id": "00744c2a-d566-47bc-abeb-8e9bc9ab312d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-384143120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cafc1d829ed749c2bfe35f7bc58e331c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5725a1df-f5", "ovs_interfaceid": "5725a1df-f51f-4ba4-99f7-777975663b2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Converting VIF {"id": "5725a1df-f51f-4ba4-99f7-777975663b2e", "address": "fa:16:3e:98:fa:bf", "network": {"id": "00744c2a-d566-47bc-abeb-8e9bc9ab312d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-384143120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cafc1d829ed749c2bfe35f7bc58e331c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5725a1df-f5", "ovs_interfaceid": "5725a1df-f51f-4ba4-99f7-777975663b2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:fa:bf,bridge_name='br-int',has_traffic_filtering=True,id=5725a1df-f51f-4ba4-99f7-777975663b2e,network=Network(00744c2a-d566-47bc-abeb-8e9bc9ab312d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5725a1df-f5') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG os_vif [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:fa:bf,bridge_name='br-int',has_traffic_filtering=True,id=5725a1df-f51f-4ba4-99f7-777975663b2e,network=Network(00744c2a-d566-47bc-abeb-8e9bc9ab312d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5725a1df-f5') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5725a1df-f5, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:01 user nova-compute[72773]: INFO os_vif [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:fa:bf,bridge_name='br-int',has_traffic_filtering=True,id=5725a1df-f51f-4ba4-99f7-777975663b2e,network=Network(00744c2a-d566-47bc-abeb-8e9bc9ab312d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5725a1df-f5')
Aug 16 22:42:01 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yDKPldmU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:42:01 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:42:01 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb80d80b-2610-4258-b02c-31e24c43269f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[de51f48c-b24b-492d-a859-393f4bbda6a5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:42:01 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:42:01 user nova-compute[72773]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:42:01 user nova-compute[72773]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 (non-flash)
Aug 16 22:42:01 user nova-compute[72773]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)
Aug 16 22:42:01 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:42:01 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:42:01 user nova-compute[72773]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d (non-flash)
Aug 16 22:42:01 user nova-compute[72773]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 (non-flash)
Aug 16 22:42:01 user nova-compute[72773]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)
Aug 16 22:42:01 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef94a78940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d'): ({'sdc'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Removing single pathed devices sdc {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf23e92-7f38-4df0-9586-93646d0e5159]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff5677a-c6ce-40e0-94df-19e141250ed2]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Flushing IO for device /dev/sdc {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6c6eb0-4280-4027-aec5-b7a9be515942]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2047a10-6b3f-4e94-a941-6416ecde62e2]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ffeee5-83e7-47cb-8c79-ab26ef3527d4]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db7275c-21a9-4a66-aaa9-935cd391d85e]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d, portal: 172.16.0.220,3260]
Aug 16 22:42:01 user nova-compute[72773]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d, portal: 172.16.0.220,3260] successful.
Aug 16 22:42:01 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:42:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2e61c3-7e0d-4dec-84b6-038a4b3b175d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cb5cdf-9d12-46f4-8ea9-65d1d25f162a]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] <== disconnect_volume: return (392ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:42:02 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Deleting instance files /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97_del
Aug 16 22:42:02 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Deletion of /opt/stack/data/nova/instances/23894101-2fd3-41a4-83a3-8f6869d24d97_del complete
Aug 16 22:42:02 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Instance destroyed successfully.
Aug 16 22:42:02 user nova-compute[72773]: DEBUG nova.objects.instance [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lazy-loading 'resources' on Instance uuid 2c59217c-22f8-4745-b05e-53300ca454f2 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:36:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-886465728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-886465728',id=32,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:38:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f496354017e467e9b7a537c73248fe2',ramdisk_id='',reservation_id='r-qolg41tm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648946443',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:40:15Z,user_data=None,user_id='42e8c8d0806e45ed9d1126aad24a034b',uuid=2c59217c-22f8-4745-b05e-53300ca454f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "068f02fa-b6b9-4148-b9b2-737d79b6c82e", "address": "fa:16:3e:6b:7c:d2", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068f02fa-b6", "ovs_interfaceid": "068f02fa-b6b9-4148-b9b2-737d79b6c82e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Converting VIF {"id": "068f02fa-b6b9-4148-b9b2-737d79b6c82e", "address": "fa:16:3e:6b:7c:d2", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068f02fa-b6", "ovs_interfaceid": "068f02fa-b6b9-4148-b9b2-737d79b6c82e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=068f02fa-b6b9-4148-b9b2-737d79b6c82e,network=Network(0a6ec813-28f9-4716-bf41-20722c69fe20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068f02fa-b6') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG os_vif [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=068f02fa-b6b9-4148-b9b2-737d79b6c82e,network=Network(0a6ec813-28f9-4716-bf41-20722c69fe20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068f02fa-b6') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap068f02fa-b6, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:02 user nova-compute[72773]: INFO os_vif [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=068f02fa-b6b9-4148-b9b2-737d79b6c82e,network=Network(0a6ec813-28f9-4716-bf41-20722c69fe20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068f02fa-b6')
Aug 16 22:42:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yplbNxGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:42:02 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:42:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:42:02 user nova-compute[72773]: INFO nova.compute.manager [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Took 1.49 seconds to destroy the instance on the hypervisor.
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[db622965-a8ea-436c-be1b-912afaf182d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f277474f-63ae-43c6-9d79-7df2dd3d11f1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:42:02 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:42:02 user nova-compute[72773]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 (non-flash)
Aug 16 22:42:02 user nova-compute[72773]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)
Aug 16 22:42:02 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:42:02 user nova-compute[72773]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad (non-flash)
Aug 16 22:42:02 user nova-compute[72773]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 (non-flash)
Aug 16 22:42:02 user nova-compute[72773]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)
Aug 16 22:42:02 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef5c341900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad'): ({'sdd'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Removing single pathed devices sdd {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[efadc095-0d39-4bbf-bb77-7eafba5580d0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef604499-9e99-4119-9da2-c18c2e317e49]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Flushing IO for device /dev/sdd {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d8c994-3038-4a44-8347-ca27e0e02f51]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.093s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d206758-f2af-484d-9b3d-96dc1ac54db8]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] SCSI volumes sdd have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb73609-be40-4872-bcf4-61e58d81c965]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[20566002-604a-4ab0-8106-434914573145]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad, portal: 172.16.0.220,3260]
Aug 16 22:42:02 user nova-compute[72773]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad, portal: 172.16.0.220,3260] successful.
Aug 16 22:42:02 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b853e2cd-8117-4231-bb70-cfc6469d3fad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf43302-7be8-4fef-a28d-25b7a07e4896]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.493s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] <== disconnect_volume: return (495ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:42:02 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Deleting instance files /opt/stack/data/nova/instances/2c59217c-22f8-4745-b05e-53300ca454f2_del
Aug 16 22:42:02 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Deletion of /opt/stack/data/nova/instances/2c59217c-22f8-4745-b05e-53300ca454f2_del complete
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:02 user nova-compute[72773]: INFO nova.compute.manager [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Took 1.63 seconds to destroy the instance on the hypervisor.
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG nova.compute.manager [req-5f76a233-f637-4f62-b481-a517e0a89838 req-545ce732-c5cd-463b-9e1a-3dde5a500cfc service nova] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Received event network-vif-plugged-a032c74c-6676-4542-9419-7338d24d7648 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5f76a233-f637-4f62-b481-a517e0a89838 req-545ce732-c5cd-463b-9e1a-3dde5a500cfc service nova] Acquiring lock "85969e4e-3ee6-4f76-9598-960282e030af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5f76a233-f637-4f62-b481-a517e0a89838 req-545ce732-c5cd-463b-9e1a-3dde5a500cfc service nova] Lock "85969e4e-3ee6-4f76-9598-960282e030af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5f76a233-f637-4f62-b481-a517e0a89838 req-545ce732-c5cd-463b-9e1a-3dde5a500cfc service nova] Lock "85969e4e-3ee6-4f76-9598-960282e030af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG nova.compute.manager [req-5f76a233-f637-4f62-b481-a517e0a89838 req-545ce732-c5cd-463b-9e1a-3dde5a500cfc service nova] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] No waiting events found dispatching network-vif-plugged-a032c74c-6676-4542-9419-7338d24d7648 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:42:03 user nova-compute[72773]: WARNING nova.compute.manager [req-5f76a233-f637-4f62-b481-a517e0a89838 req-545ce732-c5cd-463b-9e1a-3dde5a500cfc service nova] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Received unexpected event network-vif-plugged-a032c74c-6676-4542-9419-7338d24d7648 for instance with vm_state building and task_state spawning.
Aug 16 22:42:03 user nova-compute[72773]: DEBUG nova.compute.manager [req-5f76a233-f637-4f62-b481-a517e0a89838 req-545ce732-c5cd-463b-9e1a-3dde5a500cfc service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Received event network-vif-unplugged-5725a1df-f51f-4ba4-99f7-777975663b2e {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5f76a233-f637-4f62-b481-a517e0a89838 req-545ce732-c5cd-463b-9e1a-3dde5a500cfc service nova] Acquiring lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5f76a233-f637-4f62-b481-a517e0a89838 req-545ce732-c5cd-463b-9e1a-3dde5a500cfc service nova] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5f76a233-f637-4f62-b481-a517e0a89838 req-545ce732-c5cd-463b-9e1a-3dde5a500cfc service nova] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG nova.compute.manager [req-5f76a233-f637-4f62-b481-a517e0a89838 req-545ce732-c5cd-463b-9e1a-3dde5a500cfc service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] No waiting events found dispatching network-vif-unplugged-5725a1df-f51f-4ba4-99f7-777975663b2e {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG nova.compute.manager [req-5f76a233-f637-4f62-b481-a517e0a89838 req-545ce732-c5cd-463b-9e1a-3dde5a500cfc service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Received event network-vif-unplugged-5725a1df-f51f-4ba4-99f7-777975663b2e for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG nova.compute.manager [req-5f76a233-f637-4f62-b481-a517e0a89838 req-545ce732-c5cd-463b-9e1a-3dde5a500cfc service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Received event network-vif-plugged-5725a1df-f51f-4ba4-99f7-777975663b2e {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5f76a233-f637-4f62-b481-a517e0a89838 req-545ce732-c5cd-463b-9e1a-3dde5a500cfc service nova] Acquiring lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5f76a233-f637-4f62-b481-a517e0a89838 req-545ce732-c5cd-463b-9e1a-3dde5a500cfc service nova] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5f76a233-f637-4f62-b481-a517e0a89838 req-545ce732-c5cd-463b-9e1a-3dde5a500cfc service nova] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG nova.compute.manager [req-5f76a233-f637-4f62-b481-a517e0a89838 req-545ce732-c5cd-463b-9e1a-3dde5a500cfc service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] No waiting events found dispatching network-vif-plugged-5725a1df-f51f-4ba4-99f7-777975663b2e {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:42:03 user nova-compute[72773]: WARNING nova.compute.manager [req-5f76a233-f637-4f62-b481-a517e0a89838 req-545ce732-c5cd-463b-9e1a-3dde5a500cfc service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Received unexpected event network-vif-plugged-5725a1df-f51f-4ba4-99f7-777975663b2e for instance with vm_state active and task_state deleting.
Aug 16 22:42:03 user nova-compute[72773]: DEBUG nova.compute.manager [req-5f76a233-f637-4f62-b481-a517e0a89838 req-545ce732-c5cd-463b-9e1a-3dde5a500cfc service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Received event network-vif-unplugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5f76a233-f637-4f62-b481-a517e0a89838 req-545ce732-c5cd-463b-9e1a-3dde5a500cfc service nova] Acquiring lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5f76a233-f637-4f62-b481-a517e0a89838 req-545ce732-c5cd-463b-9e1a-3dde5a500cfc service nova] Lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5f76a233-f637-4f62-b481-a517e0a89838 req-545ce732-c5cd-463b-9e1a-3dde5a500cfc service nova] Lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG nova.compute.manager [req-5f76a233-f637-4f62-b481-a517e0a89838 req-545ce732-c5cd-463b-9e1a-3dde5a500cfc service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] No waiting events found dispatching network-vif-unplugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG nova.compute.manager [req-5f76a233-f637-4f62-b481-a517e0a89838 req-545ce732-c5cd-463b-9e1a-3dde5a500cfc service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Received event network-vif-unplugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:42:03 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Took 1.32 seconds to deallocate network for instance.
Aug 16 22:42:03 user nova-compute[72773]: DEBUG nova.compute.manager [req-524fe0d0-ee74-480e-9b45-f8d890c9dc16 req-8f04da73-f751-4830-b87d-c3bb414d30d6 service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Received event network-vif-deleted-5725a1df-f51f-4ba4-99f7-777975663b2e {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:42:03 user nova-compute[72773]: INFO nova.compute.manager [req-524fe0d0-ee74-480e-9b45-f8d890c9dc16 req-8f04da73-f751-4830-b87d-c3bb414d30d6 service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Neutron deleted interface 5725a1df-f51f-4ba4-99f7-777975663b2e; detaching it from the instance and deleting it from the info cache
Aug 16 22:42:03 user nova-compute[72773]: DEBUG nova.network.neutron [req-524fe0d0-ee74-480e-9b45-f8d890c9dc16 req-8f04da73-f751-4830-b87d-c3bb414d30d6 service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG nova.compute.manager [req-524fe0d0-ee74-480e-9b45-f8d890c9dc16 req-8f04da73-f751-4830-b87d-c3bb414d30d6 service nova] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Detach interface failed, port_id=5725a1df-f51f-4ba4-99f7-777975663b2e, reason: Instance 23894101-2fd3-41a4-83a3-8f6869d24d97 could not be found. {{(pid=72773) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 22:42:03 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Took 0.76 seconds to deallocate network for instance.
Aug 16 22:42:03 user nova-compute[72773]: DEBUG nova.compute.manager [req-8ca02cb8-7dde-4870-b006-00d502d8406c req-401203f5-84ad-495d-a885-dd2500387db8 service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Received event network-vif-deleted-068f02fa-b6b9-4148-b9b2-737d79b6c82e {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:42:03 user nova-compute[72773]: INFO nova.compute.manager [req-8ca02cb8-7dde-4870-b006-00d502d8406c req-401203f5-84ad-495d-a885-dd2500387db8 service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Neutron deleted interface 068f02fa-b6b9-4148-b9b2-737d79b6c82e; detaching it from the instance and deleting it from the info cache
Aug 16 22:42:03 user nova-compute[72773]: DEBUG nova.network.neutron [req-8ca02cb8-7dde-4870-b006-00d502d8406c req-401203f5-84ad-495d-a885-dd2500387db8 service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225723.5714712, 85969e4e-3ee6-4f76-9598-960282e030af => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:42:03 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] VM Resumed (Lifecycle Event)
Aug 16 22:42:03 user nova-compute[72773]: DEBUG nova.compute.manager [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:42:03 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Instance spawned successfully.
Aug 16 22:42:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG nova.compute.manager [req-8ca02cb8-7dde-4870-b006-00d502d8406c req-401203f5-84ad-495d-a885-dd2500387db8 service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Detach interface failed, port_id=068f02fa-b6b9-4148-b9b2-737d79b6c82e, reason: Instance 2c59217c-22f8-4745-b05e-53300ca454f2 could not be found. {{(pid=72773) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:42:03 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:42:03 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225723.572235, 85969e4e-3ee6-4f76-9598-960282e030af => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:42:03 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] VM Started (Lifecycle Event)
Aug 16 22:42:03 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:03 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:42:03 user nova-compute[72773]: INFO nova.compute.manager [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Took 6.90 seconds to spawn the instance on the hypervisor.
Aug 16 22:42:03 user nova-compute[72773]: DEBUG nova.compute.manager [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:42:03 user nova-compute[72773]: INFO nova.compute.manager [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Took 7.89 seconds to build instance.
Aug 16 22:42:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c5da2947-1c6e-44cc-806b-07425f7c57be tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "85969e4e-3ee6-4f76-9598-960282e030af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.985s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:42:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:03 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Error from libvirt while getting description of instance-00000020: [Error Code 42] Domain not found: no domain with matching uuid '2c59217c-22f8-4745-b05e-53300ca454f2' (instance-00000020): libvirt.libvirtError: Domain not found: no domain with matching uuid '2c59217c-22f8-4745-b05e-53300ca454f2' (instance-00000020)
Aug 16 22:42:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:04 user nova-compute[72773]: INFO nova.compute.manager [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Took 1.14 seconds to detach 1 volumes for instance.
Aug 16 22:42:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:04 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:42:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:42:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:42:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:04 user nova-compute[72773]: INFO nova.compute.manager [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Took 1.30 seconds to detach 1 volumes for instance.
Aug 16 22:42:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:42:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:05 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:42:05 user nova-compute[72773]: DEBUG nova.compute.manager [req-668bf1e4-af27-49f4-bd28-512f212976df req-2f175e86-9a35-40da-ac1d-5bc054f81d62 service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Received event network-vif-plugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:42:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-668bf1e4-af27-49f4-bd28-512f212976df req-2f175e86-9a35-40da-ac1d-5bc054f81d62 service nova] Acquiring lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:42:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-668bf1e4-af27-49f4-bd28-512f212976df req-2f175e86-9a35-40da-ac1d-5bc054f81d62 service nova] Lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:42:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-668bf1e4-af27-49f4-bd28-512f212976df req-2f175e86-9a35-40da-ac1d-5bc054f81d62 service nova] Lock "2c59217c-22f8-4745-b05e-53300ca454f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:42:05 user nova-compute[72773]: DEBUG nova.compute.manager [req-668bf1e4-af27-49f4-bd28-512f212976df req-2f175e86-9a35-40da-ac1d-5bc054f81d62 service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] No waiting events found dispatching network-vif-plugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:42:05 user nova-compute[72773]: WARNING nova.compute.manager [req-668bf1e4-af27-49f4-bd28-512f212976df req-2f175e86-9a35-40da-ac1d-5bc054f81d62 service nova] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Received unexpected event network-vif-plugged-068f02fa-b6b9-4148-b9b2-737d79b6c82e for instance with vm_state deleted and task_state None.
Aug 16 22:42:05 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:42:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.618s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:42:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.428s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:42:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:05 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Deleted allocations for instance 23894101-2fd3-41a4-83a3-8f6869d24d97
Aug 16 22:42:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-83fb5384-a0c1-4722-a6a3-d608eb75ac6e tempest-ServerActionsTestOtherB-1140735028 tempest-ServerActionsTestOtherB-1140735028-project-member] Lock "23894101-2fd3-41a4-83a3-8f6869d24d97" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.831s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:42:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b99244c8-f6df-4c60-b8be-09fc4e644733/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:05 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:42:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b99244c8-f6df-4c60-b8be-09fc4e644733/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b99244c8-f6df-4c60-b8be-09fc4e644733/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:05 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:42:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.572s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:42:05 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Deleted allocations for instance 2c59217c-22f8-4745-b05e-53300ca454f2
Aug 16 22:42:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b99244c8-f6df-4c60-b8be-09fc4e644733/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-04c2d421-9a72-463d-a564-960d2f99c46c tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "2c59217c-22f8-4745-b05e-53300ca454f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.991s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:42:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85969e4e-3ee6-4f76-9598-960282e030af/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85969e4e-3ee6-4f76-9598-960282e030af/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85969e4e-3ee6-4f76-9598-960282e030af/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85969e4e-3ee6-4f76-9598-960282e030af/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:07 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:42:07 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:42:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=7299MB free_disk=25.2474365234375GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:42:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:42:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:42:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 956d334e-f190-4625-b144-ab44d2f3321a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:42:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 030d076d-5099-4236-ae31-6025017eb51e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:42:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 391a6006-4fe6-4398-a1e8-ae95b5edbf2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:42:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance cf01c401-c424-4b3e-aa5b-439d62b1ae4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:42:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 5ebcd117-6765-44eb-871b-226afd58e4e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:42:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance f4210738-d01e-4408-a15c-aeccada6dd23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:42:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 05f47c14-f17f-43d9-b607-bccc9a0c3957 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:42:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 7cf275ce-0647-43af-ad03-24cbac934b59 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:42:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 60f877e9-8032-4781-8692-88853f420a3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:42:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance b99244c8-f6df-4c60-b8be-09fc4e644733 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:42:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 85969e4e-3ee6-4f76-9598-960282e030af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:42:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:42:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:42:07 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:42:07 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:42:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:42:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.598s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:42:08 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:42:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:16 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692225721.5545805, 23894101-2fd3-41a4-83a3-8f6869d24d97 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:42:16 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] VM Stopped (Lifecycle Event)
Aug 16 22:42:16 user nova-compute[72773]: DEBUG nova.compute.manager [None req-1e048d11-0094-4350-adea-c5faefc3eafe None None] [instance: 23894101-2fd3-41a4-83a3-8f6869d24d97] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:42:17 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692225722.0389194, 2c59217c-22f8-4745-b05e-53300ca454f2 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:42:17 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] VM Stopped (Lifecycle Event)
Aug 16 22:42:17 user nova-compute[72773]: DEBUG nova.compute.manager [None req-c97f6888-c728-47ee-922e-b70daa7bdffd None None] [instance: 2c59217c-22f8-4745-b05e-53300ca454f2] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:42:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:42:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ce4185c7-3f39-4265-b1b2-f13a0bd3c4dd tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "5ebcd117-6765-44eb-871b-226afd58e4e1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:42:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ce4185c7-3f39-4265-b1b2-f13a0bd3c4dd tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "5ebcd117-6765-44eb-871b-226afd58e4e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:42:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ce4185c7-3f39-4265-b1b2-f13a0bd3c4dd tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "5ebcd117-6765-44eb-871b-226afd58e4e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:42:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ce4185c7-3f39-4265-b1b2-f13a0bd3c4dd tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "5ebcd117-6765-44eb-871b-226afd58e4e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:42:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ce4185c7-3f39-4265-b1b2-f13a0bd3c4dd tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "5ebcd117-6765-44eb-871b-226afd58e4e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:42:52 user nova-compute[72773]: INFO nova.compute.manager [None req-ce4185c7-3f39-4265-b1b2-f13a0bd3c4dd tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Terminating instance
Aug 16 22:42:52 user nova-compute[72773]: DEBUG nova.compute.manager [None req-ce4185c7-3f39-4265-b1b2-f13a0bd3c4dd tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:42:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:53 user nova-compute[72773]: DEBUG nova.compute.manager [req-4ed554eb-fc59-4062-acd5-bca506932485 req-cd8ed263-f6ad-482c-89b3-d42d707a6013 service nova] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Received event network-vif-unplugged-d558ec29-12a3-451b-aa7f-13646e4e9e3d {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:42:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4ed554eb-fc59-4062-acd5-bca506932485 req-cd8ed263-f6ad-482c-89b3-d42d707a6013 service nova] Acquiring lock "5ebcd117-6765-44eb-871b-226afd58e4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:42:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4ed554eb-fc59-4062-acd5-bca506932485 req-cd8ed263-f6ad-482c-89b3-d42d707a6013 service nova] Lock "5ebcd117-6765-44eb-871b-226afd58e4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:42:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4ed554eb-fc59-4062-acd5-bca506932485 req-cd8ed263-f6ad-482c-89b3-d42d707a6013 service nova] Lock "5ebcd117-6765-44eb-871b-226afd58e4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:42:53 user nova-compute[72773]: DEBUG nova.compute.manager [req-4ed554eb-fc59-4062-acd5-bca506932485 req-cd8ed263-f6ad-482c-89b3-d42d707a6013 service nova] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] No waiting events found dispatching network-vif-unplugged-d558ec29-12a3-451b-aa7f-13646e4e9e3d {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:42:53 user nova-compute[72773]: DEBUG nova.compute.manager [req-4ed554eb-fc59-4062-acd5-bca506932485 req-cd8ed263-f6ad-482c-89b3-d42d707a6013 service nova] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Received event network-vif-unplugged-d558ec29-12a3-451b-aa7f-13646e4e9e3d for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:42:53 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Instance destroyed successfully.
Aug 16 22:42:53 user nova-compute[72773]: DEBUG nova.objects.instance [None req-ce4185c7-3f39-4265-b1b2-f13a0bd3c4dd tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lazy-loading 'resources' on Instance uuid 5ebcd117-6765-44eb-871b-226afd58e4e1 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:42:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-ce4185c7-3f39-4265-b1b2-f13a0bd3c4dd tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:33:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1398929644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1398929644',id=28,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:33:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f496354017e467e9b7a537c73248fe2',ramdisk_id='',reservation_id='r-ty00mxjv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648946443',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:35:26Z,user_data=None,user_id='42e8c8d0806e45ed9d1126aad24a034b',uuid=5ebcd117-6765-44eb-871b-226afd58e4e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d558ec29-12a3-451b-aa7f-13646e4e9e3d", "address": "fa:16:3e:cb:40:f7", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd558ec29-12", "ovs_interfaceid": "d558ec29-12a3-451b-aa7f-13646e4e9e3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:42:53 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-ce4185c7-3f39-4265-b1b2-f13a0bd3c4dd tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Converting VIF {"id": "d558ec29-12a3-451b-aa7f-13646e4e9e3d", "address": "fa:16:3e:cb:40:f7", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd558ec29-12", "ovs_interfaceid": "d558ec29-12a3-451b-aa7f-13646e4e9e3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:42:53 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-ce4185c7-3f39-4265-b1b2-f13a0bd3c4dd tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:40:f7,bridge_name='br-int',has_traffic_filtering=True,id=d558ec29-12a3-451b-aa7f-13646e4e9e3d,network=Network(0a6ec813-28f9-4716-bf41-20722c69fe20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd558ec29-12') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:42:53 user nova-compute[72773]: DEBUG os_vif [None req-ce4185c7-3f39-4265-b1b2-f13a0bd3c4dd tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:40:f7,bridge_name='br-int',has_traffic_filtering=True,id=d558ec29-12a3-451b-aa7f-13646e4e9e3d,network=Network(0a6ec813-28f9-4716-bf41-20722c69fe20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd558ec29-12') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:42:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd558ec29-12, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:42:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:42:53 user nova-compute[72773]: INFO os_vif [None req-ce4185c7-3f39-4265-b1b2-f13a0bd3c4dd tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:40:f7,bridge_name='br-int',has_traffic_filtering=True,id=d558ec29-12a3-451b-aa7f-13646e4e9e3d,network=Network(0a6ec813-28f9-4716-bf41-20722c69fe20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd558ec29-12')
Aug 16 22:42:53 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-ce4185c7-3f39-4265-b1b2-f13a0bd3c4dd tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Deleting instance files /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1_del
Aug 16 22:42:53 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-ce4185c7-3f39-4265-b1b2-f13a0bd3c4dd tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Deletion of /opt/stack/data/nova/instances/5ebcd117-6765-44eb-871b-226afd58e4e1_del complete
Aug 16 22:42:53 user nova-compute[72773]: INFO nova.compute.manager [None req-ce4185c7-3f39-4265-b1b2-f13a0bd3c4dd tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 16 22:42:53 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-ce4185c7-3f39-4265-b1b2-f13a0bd3c4dd tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:42:53 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:42:53 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:42:54 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:42:54 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Took 0.61 seconds to deallocate network for instance.
Aug 16 22:42:54 user nova-compute[72773]: DEBUG nova.compute.manager [req-a70a64e7-4b43-473a-b262-6bb485ade3a8 req-7e48a63f-75b8-4c62-959a-fd3b87874932 service nova] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Received event network-vif-deleted-d558ec29-12a3-451b-aa7f-13646e4e9e3d {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:42:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ce4185c7-3f39-4265-b1b2-f13a0bd3c4dd tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:42:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ce4185c7-3f39-4265-b1b2-f13a0bd3c4dd tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:42:54 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:42:54 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-ce4185c7-3f39-4265-b1b2-f13a0bd3c4dd tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:42:54 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-ce4185c7-3f39-4265-b1b2-f13a0bd3c4dd tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:42:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ce4185c7-3f39-4265-b1b2-f13a0bd3c4dd tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:42:54 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-ce4185c7-3f39-4265-b1b2-f13a0bd3c4dd tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Deleted allocations for instance 5ebcd117-6765-44eb-871b-226afd58e4e1
Aug 16 22:42:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ce4185c7-3f39-4265-b1b2-f13a0bd3c4dd tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "5ebcd117-6765-44eb-871b-226afd58e4e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.079s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:42:55 user nova-compute[72773]: DEBUG nova.compute.manager [req-ceda20e9-ff43-4ad7-ac8e-b3e9817f64d7 req-361af512-22e1-461a-99e6-fcc8f8a89544 service nova] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Received event network-vif-plugged-d558ec29-12a3-451b-aa7f-13646e4e9e3d {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:42:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ceda20e9-ff43-4ad7-ac8e-b3e9817f64d7 req-361af512-22e1-461a-99e6-fcc8f8a89544 service nova] Acquiring lock "5ebcd117-6765-44eb-871b-226afd58e4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:42:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ceda20e9-ff43-4ad7-ac8e-b3e9817f64d7 req-361af512-22e1-461a-99e6-fcc8f8a89544 service nova] Lock "5ebcd117-6765-44eb-871b-226afd58e4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:42:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ceda20e9-ff43-4ad7-ac8e-b3e9817f64d7 req-361af512-22e1-461a-99e6-fcc8f8a89544 service nova] Lock "5ebcd117-6765-44eb-871b-226afd58e4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:42:55 user nova-compute[72773]: DEBUG nova.compute.manager [req-ceda20e9-ff43-4ad7-ac8e-b3e9817f64d7 req-361af512-22e1-461a-99e6-fcc8f8a89544 service nova] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] No waiting events found dispatching network-vif-plugged-d558ec29-12a3-451b-aa7f-13646e4e9e3d {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:42:55 user nova-compute[72773]: WARNING nova.compute.manager [req-ceda20e9-ff43-4ad7-ac8e-b3e9817f64d7 req-361af512-22e1-461a-99e6-fcc8f8a89544 service nova] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Received unexpected event network-vif-plugged-d558ec29-12a3-451b-aa7f-13646e4e9e3d for instance with vm_state deleted and task_state None.
Aug 16 22:42:55 user nova-compute[72773]: DEBUG nova.compute.manager [req-e92f891c-8ea7-4038-b2e9-04ecccd95fc3 req-9702a0fb-2d59-478e-a2a6-71c9cb68c93f service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Received event network-changed-ef9aad5b-2373-47b5-910b-8664d08e5df5 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:42:55 user nova-compute[72773]: DEBUG nova.compute.manager [req-e92f891c-8ea7-4038-b2e9-04ecccd95fc3 req-9702a0fb-2d59-478e-a2a6-71c9cb68c93f service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Refreshing instance network info cache due to event network-changed-ef9aad5b-2373-47b5-910b-8664d08e5df5. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:42:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e92f891c-8ea7-4038-b2e9-04ecccd95fc3 req-9702a0fb-2d59-478e-a2a6-71c9cb68c93f service nova] Acquiring lock "refresh_cache-7cf275ce-0647-43af-ad03-24cbac934b59" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:42:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e92f891c-8ea7-4038-b2e9-04ecccd95fc3 req-9702a0fb-2d59-478e-a2a6-71c9cb68c93f service nova] Acquired lock "refresh_cache-7cf275ce-0647-43af-ad03-24cbac934b59" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:42:55 user nova-compute[72773]: DEBUG nova.network.neutron [req-e92f891c-8ea7-4038-b2e9-04ecccd95fc3 req-9702a0fb-2d59-478e-a2a6-71c9cb68c93f service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Refreshing network info cache for port ef9aad5b-2373-47b5-910b-8664d08e5df5 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:42:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Acquiring lock "7cf275ce-0647-43af-ad03-24cbac934b59" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:42:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lock "7cf275ce-0647-43af-ad03-24cbac934b59" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:42:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Acquiring lock "7cf275ce-0647-43af-ad03-24cbac934b59-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:42:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lock "7cf275ce-0647-43af-ad03-24cbac934b59-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:42:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lock "7cf275ce-0647-43af-ad03-24cbac934b59-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:42:55 user nova-compute[72773]: INFO nova.compute.manager [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Terminating instance
Aug 16 22:42:55 user nova-compute[72773]: DEBUG nova.compute.manager [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:42:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:55 user nova-compute[72773]: DEBUG nova.network.neutron [req-e92f891c-8ea7-4038-b2e9-04ecccd95fc3 req-9702a0fb-2d59-478e-a2a6-71c9cb68c93f service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Updated VIF entry in instance network info cache for port ef9aad5b-2373-47b5-910b-8664d08e5df5. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:42:55 user nova-compute[72773]: DEBUG nova.network.neutron [req-e92f891c-8ea7-4038-b2e9-04ecccd95fc3 req-9702a0fb-2d59-478e-a2a6-71c9cb68c93f service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Updating instance_info_cache with network_info: [{"id": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "address": "fa:16:3e:11:03:33", "network": {"id": "09f1ea90-9baf-4dc6-965e-30b89fa0557d", "bridge": "br-int", "label": "tempest-TestShelveInstance-375734384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "128365b541d848b4a369bdb73a357786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9aad5b-23", "ovs_interfaceid": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:42:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e92f891c-8ea7-4038-b2e9-04ecccd95fc3 req-9702a0fb-2d59-478e-a2a6-71c9cb68c93f service nova] Releasing lock "refresh_cache-7cf275ce-0647-43af-ad03-24cbac934b59" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:42:56 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Instance destroyed successfully.
Aug 16 22:42:56 user nova-compute[72773]: DEBUG nova.objects.instance [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lazy-loading 'resources' on Instance uuid 7cf275ce-0647-43af-ad03-24cbac934b59 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T22:37:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1525734974',display_name='tempest-TestShelveInstance-server-1525734974',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1525734974',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXQBASS0jXrxI3OGcv7vu4DdfXzpmoqsRvSbmQ6vxACy0aQ5iheigPnMtUaevvjo5jGI3reLnnhACND3PPyJAWWWf8sEZP9M76YWibt3G9R/QtnNRpsjmPAUnUPnW3dlQ==',key_name='tempest-TestShelveInstance-631846690',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:41:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='128365b541d848b4a369bdb73a357786',ramdisk_id='',reservation_id='r-ppxqqatm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1515246832',owner_user_name='tempest-TestShelveInstance-1515246832-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:41:27Z,user_data=None,user_id='6e5f5ea155144f91886018bc0057e13b',uuid=7cf275ce-0647-43af-ad03-24cbac934b59,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "address": "fa:16:3e:11:03:33", "network": {"id": "09f1ea90-9baf-4dc6-965e-30b89fa0557d", "bridge": "br-int", "label": "tempest-TestShelveInstance-375734384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "128365b541d848b4a369bdb73a357786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9aad5b-23", "ovs_interfaceid": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Converting VIF {"id": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "address": "fa:16:3e:11:03:33", "network": {"id": "09f1ea90-9baf-4dc6-965e-30b89fa0557d", "bridge": "br-int", "label": "tempest-TestShelveInstance-375734384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "128365b541d848b4a369bdb73a357786", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9aad5b-23", "ovs_interfaceid": "ef9aad5b-2373-47b5-910b-8664d08e5df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:03:33,bridge_name='br-int',has_traffic_filtering=True,id=ef9aad5b-2373-47b5-910b-8664d08e5df5,network=Network(09f1ea90-9baf-4dc6-965e-30b89fa0557d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef9aad5b-23') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG os_vif [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:03:33,bridge_name='br-int',has_traffic_filtering=True,id=ef9aad5b-2373-47b5-910b-8664d08e5df5,network=Network(09f1ea90-9baf-4dc6-965e-30b89fa0557d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef9aad5b-23') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef9aad5b-23, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:42:56 user nova-compute[72773]: INFO os_vif [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:03:33,bridge_name='br-int',has_traffic_filtering=True,id=ef9aad5b-2373-47b5-910b-8664d08e5df5,network=Network(09f1ea90-9baf-4dc6-965e-30b89fa0557d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef9aad5b-23')
Aug 16 22:42:56 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YszrhEio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:42:56 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:42:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5f199f-f890-49b7-a19a-2cc99701ab56]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b3a041-965b-4099-8615-48e983d7a323]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:42:56 user nova-compute[72773]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 (non-flash)
Aug 16 22:42:56 user nova-compute[72773]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)
Aug 16 22:42:56 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:42:56 user nova-compute[72773]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 (non-flash)
Aug 16 22:42:56 user nova-compute[72773]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca (non-flash)
Aug 16 22:42:56 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef5c424160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca'): ({'sdf'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Removing single pathed devices sdf {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[beca8692-026b-448a-8a22-548b23db3eac]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.027s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[14dfb4f8-5f6a-4a3f-8774-db655be201e5]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Flushing IO for device /dev/sdf {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7547264f-e4cf-4a69-8312-850a93ac8c27]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fd48d6-68c6-44c9-90cc-7ad1f6bf6104]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] SCSI volumes sdf have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb5af96-2b45-47af-bb57-7892e4465095]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2536b7-77c1-482e-bac6-377f85895d13]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca, portal: 172.16.0.220,3260]
Aug 16 22:42:56 user nova-compute[72773]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca, portal: 172.16.0.220,3260] successful.
Aug 16 22:42:56 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c203a677-77d4-45aa-a91d-f69ed23c7dca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7404a358-69c5-4d4c-9a84-52449ac41769]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.666s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] <== disconnect_volume: return (667ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:42:56 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Deleting instance files /opt/stack/data/nova/instances/7cf275ce-0647-43af-ad03-24cbac934b59_del
Aug 16 22:42:56 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Deletion of /opt/stack/data/nova/instances/7cf275ce-0647-43af-ad03-24cbac934b59_del complete
Aug 16 22:42:56 user nova-compute[72773]: INFO nova.compute.manager [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Took 1.58 seconds to destroy the instance on the hypervisor.
Aug 16 22:42:56 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:42:56 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:42:57 user nova-compute[72773]: DEBUG nova.compute.manager [req-2e61d6f0-71ba-4c7a-8224-655f677b42e6 req-303f300a-70bd-42d5-8377-9964cd5c1594 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Received event network-vif-unplugged-ef9aad5b-2373-47b5-910b-8664d08e5df5 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:42:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2e61d6f0-71ba-4c7a-8224-655f677b42e6 req-303f300a-70bd-42d5-8377-9964cd5c1594 service nova] Acquiring lock "7cf275ce-0647-43af-ad03-24cbac934b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:42:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2e61d6f0-71ba-4c7a-8224-655f677b42e6 req-303f300a-70bd-42d5-8377-9964cd5c1594 service nova] Lock "7cf275ce-0647-43af-ad03-24cbac934b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:42:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2e61d6f0-71ba-4c7a-8224-655f677b42e6 req-303f300a-70bd-42d5-8377-9964cd5c1594 service nova] Lock "7cf275ce-0647-43af-ad03-24cbac934b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:42:57 user nova-compute[72773]: DEBUG nova.compute.manager [req-2e61d6f0-71ba-4c7a-8224-655f677b42e6 req-303f300a-70bd-42d5-8377-9964cd5c1594 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] No waiting events found dispatching network-vif-unplugged-ef9aad5b-2373-47b5-910b-8664d08e5df5 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:42:57 user nova-compute[72773]: DEBUG nova.compute.manager [req-2e61d6f0-71ba-4c7a-8224-655f677b42e6 req-303f300a-70bd-42d5-8377-9964cd5c1594 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Received event network-vif-unplugged-ef9aad5b-2373-47b5-910b-8664d08e5df5 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:42:57 user nova-compute[72773]: DEBUG nova.compute.manager [req-2e61d6f0-71ba-4c7a-8224-655f677b42e6 req-303f300a-70bd-42d5-8377-9964cd5c1594 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Received event network-vif-plugged-ef9aad5b-2373-47b5-910b-8664d08e5df5 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:42:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2e61d6f0-71ba-4c7a-8224-655f677b42e6 req-303f300a-70bd-42d5-8377-9964cd5c1594 service nova] Acquiring lock "7cf275ce-0647-43af-ad03-24cbac934b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:42:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2e61d6f0-71ba-4c7a-8224-655f677b42e6 req-303f300a-70bd-42d5-8377-9964cd5c1594 service nova] Lock "7cf275ce-0647-43af-ad03-24cbac934b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:42:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2e61d6f0-71ba-4c7a-8224-655f677b42e6 req-303f300a-70bd-42d5-8377-9964cd5c1594 service nova] Lock "7cf275ce-0647-43af-ad03-24cbac934b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:42:57 user nova-compute[72773]: DEBUG nova.compute.manager [req-2e61d6f0-71ba-4c7a-8224-655f677b42e6 req-303f300a-70bd-42d5-8377-9964cd5c1594 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] No waiting events found dispatching network-vif-plugged-ef9aad5b-2373-47b5-910b-8664d08e5df5 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:42:57 user nova-compute[72773]: WARNING nova.compute.manager [req-2e61d6f0-71ba-4c7a-8224-655f677b42e6 req-303f300a-70bd-42d5-8377-9964cd5c1594 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Received unexpected event network-vif-plugged-ef9aad5b-2373-47b5-910b-8664d08e5df5 for instance with vm_state active and task_state deleting.
Aug 16 22:42:57 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:42:57 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Took 0.70 seconds to deallocate network for instance.
Aug 16 22:42:57 user nova-compute[72773]: DEBUG nova.compute.manager [req-f5c08677-06f1-4cd7-a47f-9be0f32d6b94 req-52994498-baf3-4476-bc0a-4e16f4fdac31 service nova] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Received event network-vif-deleted-ef9aad5b-2373-47b5-910b-8664d08e5df5 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:42:58 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:42:59 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:42:59 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:42:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-f4210738-d01e-4408-a15c-aeccada6dd23" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:42:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-f4210738-d01e-4408-a15c-aeccada6dd23" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:42:59 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 22:42:59 user nova-compute[72773]: DEBUG nova.compute.manager [req-80056aa2-ae65-4d1c-a067-b2b06c287e14 req-9a75f2a9-2514-4517-8e11-ff7ee8fc789d service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received event network-changed-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:42:59 user nova-compute[72773]: DEBUG nova.compute.manager [req-80056aa2-ae65-4d1c-a067-b2b06c287e14 req-9a75f2a9-2514-4517-8e11-ff7ee8fc789d service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Refreshing instance network info cache due to event network-changed-39797b08-9184-4673-a07c-c2123736fc54. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:42:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-80056aa2-ae65-4d1c-a067-b2b06c287e14 req-9a75f2a9-2514-4517-8e11-ff7ee8fc789d service nova] Acquiring lock "refresh_cache-60f877e9-8032-4781-8692-88853f420a3c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:42:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-80056aa2-ae65-4d1c-a067-b2b06c287e14 req-9a75f2a9-2514-4517-8e11-ff7ee8fc789d service nova] Acquired lock "refresh_cache-60f877e9-8032-4781-8692-88853f420a3c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:42:59 user nova-compute[72773]: DEBUG nova.network.neutron [req-80056aa2-ae65-4d1c-a067-b2b06c287e14 req-9a75f2a9-2514-4517-8e11-ff7ee8fc789d service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Refreshing network info cache for port 39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "60f877e9-8032-4781-8692-88853f420a3c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "60f877e9-8032-4781-8692-88853f420a3c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG nova.objects.instance [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lazy-loading 'flavor' on Instance uuid 60f877e9-8032-4781-8692-88853f420a3c {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Updating instance_info_cache with network_info: [{"id": "bb573e79-a106-40c5-8c53-ab73eb6ba240", "address": "fa:16:3e:1e:80:9b", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb573e79-a1", "ovs_interfaceid": "bb573e79-a106-40c5-8c53-ab73eb6ba240", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "60f877e9-8032-4781-8692-88853f420a3c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-f4210738-d01e-4408-a15c-aeccada6dd23" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "60f877e9-8032-4781-8692-88853f420a3c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "60f877e9-8032-4781-8692-88853f420a3c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:43:00 user nova-compute[72773]: INFO nova.compute.manager [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Attaching volume f7fded2d-3c3a-4184-9aba-0a3f80e01531 to /dev/vdb
Aug 16 22:43:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-24d8ea7d-3037-44d5-a911-2be7a5693018 tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Acquiring lock "b99244c8-f6df-4c60-b8be-09fc4e644733" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-24d8ea7d-3037-44d5-a911-2be7a5693018 tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Lock "b99244c8-f6df-4c60-b8be-09fc4e644733" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-24d8ea7d-3037-44d5-a911-2be7a5693018 tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Acquiring lock "b99244c8-f6df-4c60-b8be-09fc4e644733-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-24d8ea7d-3037-44d5-a911-2be7a5693018 tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Lock "b99244c8-f6df-4c60-b8be-09fc4e644733-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-24d8ea7d-3037-44d5-a911-2be7a5693018 tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Lock "b99244c8-f6df-4c60-b8be-09fc4e644733-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:43:00 user nova-compute[72773]: INFO nova.compute.manager [None req-24d8ea7d-3037-44d5-a911-2be7a5693018 tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Terminating instance
Aug 16 22:43:00 user nova-compute[72773]: DEBUG nova.compute.manager [None req-24d8ea7d-3037-44d5-a911-2be7a5693018 tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG os_brick.utils [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b78759-c235-43ed-b719-796979255491]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[144ac98e-8270-4049-a542-cfbf3a3fcdc8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89b2e9c-f1c7-4ee3-a949-87fea8a965f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3840e0-3a70-44d7-87f1-4da3ea2e6c0e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:43:00 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:43:00 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[00edafd4-cc2e-46c5-a632-559dee804b93]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG os_brick.utils [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Updating existing volume attachment record: c2a25b4f-071f-4435-adcb-643c74ae97e0 {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG nova.network.neutron [req-80056aa2-ae65-4d1c-a067-b2b06c287e14 req-9a75f2a9-2514-4517-8e11-ff7ee8fc789d service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Updated VIF entry in instance network info cache for port 39797b08-9184-4673-a07c-c2123736fc54. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG nova.network.neutron [req-80056aa2-ae65-4d1c-a067-b2b06c287e14 req-9a75f2a9-2514-4517-8e11-ff7ee8fc789d service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Updating instance_info_cache with network_info: [{"id": "39797b08-9184-4673-a07c-c2123736fc54", "address": "fa:16:3e:71:50:b7", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39797b08-91", "ovs_interfaceid": "39797b08-9184-4673-a07c-c2123736fc54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:43:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-80056aa2-ae65-4d1c-a067-b2b06c287e14 req-9a75f2a9-2514-4517-8e11-ff7ee8fc789d service nova] Releasing lock "refresh_cache-60f877e9-8032-4781-8692-88853f420a3c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:43:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:01 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Instance destroyed successfully.
Aug 16 22:43:01 user nova-compute[72773]: DEBUG nova.objects.instance [None req-24d8ea7d-3037-44d5-a911-2be7a5693018 tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Lazy-loading 'resources' on Instance uuid b99244c8-f6df-4c60-b8be-09fc4e644733 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:43:01 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-24d8ea7d-3037-44d5-a911-2be7a5693018 tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:41:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-265416519',display_name='tempest-VolumesNegativeTest-instance-265416519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-265416519',id=36,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:41:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ec4c3fcf849453f8e5a2f0e3e6837df',ramdisk_id='',reservation_id='r-zls002oq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1957090774',owner_user_name='tempest-VolumesNegativeTest-1957090774-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:41:19Z,user_data=None,user_id='3b4d716629504e8bb9cdc2c50b224f6b',uuid=b99244c8-f6df-4c60-b8be-09fc4e644733,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4977c3dd-df4f-41a3-bff7-135cccdf164e", "address": "fa:16:3e:59:f9:55", "network": {"id": "8bc4a357-d1cb-4e20-b75b-9745ca8ed924", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "271c18b5b5f546819051ae850473f6b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4977c3dd-df", "ovs_interfaceid": "4977c3dd-df4f-41a3-bff7-135cccdf164e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:43:01 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-24d8ea7d-3037-44d5-a911-2be7a5693018 tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Converting VIF {"id": "4977c3dd-df4f-41a3-bff7-135cccdf164e", "address": "fa:16:3e:59:f9:55", "network": {"id": "8bc4a357-d1cb-4e20-b75b-9745ca8ed924", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "271c18b5b5f546819051ae850473f6b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4977c3dd-df", "ovs_interfaceid": "4977c3dd-df4f-41a3-bff7-135cccdf164e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:43:01 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-24d8ea7d-3037-44d5-a911-2be7a5693018 tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:f9:55,bridge_name='br-int',has_traffic_filtering=True,id=4977c3dd-df4f-41a3-bff7-135cccdf164e,network=Network(8bc4a357-d1cb-4e20-b75b-9745ca8ed924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4977c3dd-df') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:43:01 user nova-compute[72773]: DEBUG os_vif [None req-24d8ea7d-3037-44d5-a911-2be7a5693018 tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:f9:55,bridge_name='br-int',has_traffic_filtering=True,id=4977c3dd-df4f-41a3-bff7-135cccdf164e,network=Network(8bc4a357-d1cb-4e20-b75b-9745ca8ed924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4977c3dd-df') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:43:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4977c3dd-df, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:43:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:43:01 user nova-compute[72773]: INFO os_vif [None req-24d8ea7d-3037-44d5-a911-2be7a5693018 tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:f9:55,bridge_name='br-int',has_traffic_filtering=True,id=4977c3dd-df4f-41a3-bff7-135cccdf164e,network=Network(8bc4a357-d1cb-4e20-b75b-9745ca8ed924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4977c3dd-df')
Aug 16 22:43:01 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-24d8ea7d-3037-44d5-a911-2be7a5693018 tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Deleting instance files /opt/stack/data/nova/instances/b99244c8-f6df-4c60-b8be-09fc4e644733_del
Aug 16 22:43:01 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-24d8ea7d-3037-44d5-a911-2be7a5693018 tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Deletion of /opt/stack/data/nova/instances/b99244c8-f6df-4c60-b8be-09fc4e644733_del complete
Aug 16 22:43:01 user nova-compute[72773]: INFO nova.compute.manager [None req-24d8ea7d-3037-44d5-a911-2be7a5693018 tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 16 22:43:01 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-24d8ea7d-3037-44d5-a911-2be7a5693018 tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:43:01 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:43:01 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:43:01 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:43:01 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:43:01 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Took 0.66 seconds to deallocate network for instance.
Aug 16 22:43:01 user nova-compute[72773]: DEBUG nova.compute.manager [req-d162f921-ec0f-408c-bf3d-85aef8ce5c23 req-7cfdb738-406d-42fe-8c58-5db8e318b1b4 service nova] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Received event network-vif-deleted-4977c3dd-df4f-41a3-bff7-135cccdf164e {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:43:01 user nova-compute[72773]: INFO nova.compute.manager [req-d162f921-ec0f-408c-bf3d-85aef8ce5c23 req-7cfdb738-406d-42fe-8c58-5db8e318b1b4 service nova] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Neutron deleted interface 4977c3dd-df4f-41a3-bff7-135cccdf164e; detaching it from the instance and deleting it from the info cache
Aug 16 22:43:01 user nova-compute[72773]: DEBUG nova.network.neutron [req-d162f921-ec0f-408c-bf3d-85aef8ce5c23 req-7cfdb738-406d-42fe-8c58-5db8e318b1b4 service nova] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:43:01 user nova-compute[72773]: DEBUG nova.compute.manager [req-d162f921-ec0f-408c-bf3d-85aef8ce5c23 req-7cfdb738-406d-42fe-8c58-5db8e318b1b4 service nova] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Detach interface failed, port_id=4977c3dd-df4f-41a3-bff7-135cccdf164e, reason: Instance b99244c8-f6df-4c60-b8be-09fc4e644733 could not be found. {{(pid=72773) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 22:43:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-24d8ea7d-3037-44d5-a911-2be7a5693018 tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:43:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-24d8ea7d-3037-44d5-a911-2be7a5693018 tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:43:02 user nova-compute[72773]: DEBUG nova.compute.manager [req-b8612963-aa95-4a35-94cd-0c4dd0a46117 req-793502b8-a5d0-4ea0-9374-cc174b2eeb3d service nova] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Received event network-vif-unplugged-4977c3dd-df4f-41a3-bff7-135cccdf164e {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:43:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b8612963-aa95-4a35-94cd-0c4dd0a46117 req-793502b8-a5d0-4ea0-9374-cc174b2eeb3d service nova] Acquiring lock "b99244c8-f6df-4c60-b8be-09fc4e644733-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:43:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b8612963-aa95-4a35-94cd-0c4dd0a46117 req-793502b8-a5d0-4ea0-9374-cc174b2eeb3d service nova] Lock "b99244c8-f6df-4c60-b8be-09fc4e644733-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:43:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b8612963-aa95-4a35-94cd-0c4dd0a46117 req-793502b8-a5d0-4ea0-9374-cc174b2eeb3d service nova] Lock "b99244c8-f6df-4c60-b8be-09fc4e644733-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:43:02 user nova-compute[72773]: DEBUG nova.compute.manager [req-b8612963-aa95-4a35-94cd-0c4dd0a46117 req-793502b8-a5d0-4ea0-9374-cc174b2eeb3d service nova] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] No waiting events found dispatching network-vif-unplugged-4977c3dd-df4f-41a3-bff7-135cccdf164e {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:43:02 user nova-compute[72773]: WARNING nova.compute.manager [req-b8612963-aa95-4a35-94cd-0c4dd0a46117 req-793502b8-a5d0-4ea0-9374-cc174b2eeb3d service nova] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Received unexpected event network-vif-unplugged-4977c3dd-df4f-41a3-bff7-135cccdf164e for instance with vm_state deleted and task_state None.
Aug 16 22:43:02 user nova-compute[72773]: DEBUG nova.compute.manager [req-b8612963-aa95-4a35-94cd-0c4dd0a46117 req-793502b8-a5d0-4ea0-9374-cc174b2eeb3d service nova] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Received event network-vif-plugged-4977c3dd-df4f-41a3-bff7-135cccdf164e {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:43:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b8612963-aa95-4a35-94cd-0c4dd0a46117 req-793502b8-a5d0-4ea0-9374-cc174b2eeb3d service nova] Acquiring lock "b99244c8-f6df-4c60-b8be-09fc4e644733-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:43:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b8612963-aa95-4a35-94cd-0c4dd0a46117 req-793502b8-a5d0-4ea0-9374-cc174b2eeb3d service nova] Lock "b99244c8-f6df-4c60-b8be-09fc4e644733-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:43:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b8612963-aa95-4a35-94cd-0c4dd0a46117 req-793502b8-a5d0-4ea0-9374-cc174b2eeb3d service nova] Lock "b99244c8-f6df-4c60-b8be-09fc4e644733-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:43:02 user nova-compute[72773]: DEBUG nova.compute.manager [req-b8612963-aa95-4a35-94cd-0c4dd0a46117 req-793502b8-a5d0-4ea0-9374-cc174b2eeb3d service nova] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] No waiting events found dispatching network-vif-plugged-4977c3dd-df4f-41a3-bff7-135cccdf164e {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:43:02 user nova-compute[72773]: WARNING nova.compute.manager [req-b8612963-aa95-4a35-94cd-0c4dd0a46117 req-793502b8-a5d0-4ea0-9374-cc174b2eeb3d service nova] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Received unexpected event network-vif-plugged-4977c3dd-df4f-41a3-bff7-135cccdf164e for instance with vm_state deleted and task_state None.
Aug 16 22:43:02 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-24d8ea7d-3037-44d5-a911-2be7a5693018 tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:43:02 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-24d8ea7d-3037-44d5-a911-2be7a5693018 tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:43:02 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:43:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-24d8ea7d-3037-44d5-a911-2be7a5693018 tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:43:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:43:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:43:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:43:02 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:43:02 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-24d8ea7d-3037-44d5-a911-2be7a5693018 tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Deleted allocations for instance b99244c8-f6df-4c60-b8be-09fc4e644733
Aug 16 22:43:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-24d8ea7d-3037-44d5-a911-2be7a5693018 tempest-VolumesNegativeTest-1957090774 tempest-VolumesNegativeTest-1957090774-project-member] Lock "b99244c8-f6df-4c60-b8be-09fc4e644733" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.196s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:43:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:43:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:04 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:43:04 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85969e4e-3ee6-4f76-9598-960282e030af/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85969e4e-3ee6-4f76-9598-960282e030af/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85969e4e-3ee6-4f76-9598-960282e030af/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85969e4e-3ee6-4f76-9598-960282e030af/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:06 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:43:06 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:43:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=7748MB free_disk=25.372570037841797GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:43:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:43:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:43:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 956d334e-f190-4625-b144-ab44d2f3321a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:43:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 030d076d-5099-4236-ae31-6025017eb51e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:43:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 391a6006-4fe6-4398-a1e8-ae95b5edbf2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:43:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance cf01c401-c424-4b3e-aa5b-439d62b1ae4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:43:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance f4210738-d01e-4408-a15c-aeccada6dd23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:43:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 05f47c14-f17f-43d9-b607-bccc9a0c3957 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:43:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 7cf275ce-0647-43af-ad03-24cbac934b59 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:43:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 60f877e9-8032-4781-8692-88853f420a3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:43:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 85969e4e-3ee6-4f76-9598-960282e030af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:43:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:43:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:43:06 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:43:06 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:43:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:43:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.422s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:43:07 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:43:07 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:43:08 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692225773.4689825, 5ebcd117-6765-44eb-871b-226afd58e4e1 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:43:08 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] VM Stopped (Lifecycle Event)
Aug 16 22:43:08 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a0f53a42-9ee5-42fc-adbf-3ed4360333fd None None] [instance: 5ebcd117-6765-44eb-871b-226afd58e4e1] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:43:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692225776.1233141, 7cf275ce-0647-43af-ad03-24cbac934b59 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:43:11 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] VM Stopped (Lifecycle Event)
Aug 16 22:43:11 user nova-compute[72773]: DEBUG nova.compute.manager [None req-ab41fc53-401a-4ddc-b9bc-67bde9b4cc70 None None] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FoInbRuW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:43:11 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:43:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:43:11 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:43:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:43:11 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:43:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd745254-a2a5-4507-9575-bfba974bcb30]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:43:11 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f36d1de-9585-4373-82f9-bafeb84a2235]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531] added
Aug 16 22:43:11 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b71a2ec-cb33-4a47-88e0-8fd97a3308c3]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee3c26e-c380-4d2e-ba86-900c75750111]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FoInbRuW {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FoInbRuW" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[334ce49d-2c4f-4b13-80aa-9d1f3f335dbf]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FoInbRuW'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de89d2a-a22a-4918-9164-a7fae78d449c]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6aa559-8554-4306-9c8b-d5a814d8d2c5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:43:11 user nova-compute[72773]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 (non-flash)
Aug 16 22:43:11 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:43:11 user nova-compute[72773]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 (non-flash)
Aug 16 22:43:11 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51052b1-13c7-459c-9d9b-c4675010a5e3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531, portal: 172.16.0.220,3260]
Aug 16 22:43:11 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531, portal: 172.16.0.220,3260] successful.
Aug 16 22:43:11 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbfa371-07da-4f55-b1b7-3ed77d25f07d]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb10944-ac5e-4eef-923d-e45e329828ef]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:43:12 user nova-compute[72773]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 (non-flash)
Aug 16 22:43:12 user nova-compute[72773]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)
Aug 16 22:43:12 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:43:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:43:12 user nova-compute[72773]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 (non-flash)
Aug 16 22:43:12 user nova-compute[72773]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)
Aug 16 22:43:12 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:43:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:43:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:43:12 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:43:12 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:43:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:12 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f268168-1f78-4cbf-8427-b383fe873cb8]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:12 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: None {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:43:13 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:43:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FoInbRuW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:43:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:43:13 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23966353237643534', 'path': '/dev/sdc'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:43:13 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966353237643534', 'path': '/dev/sdc'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:43:13 user nova-compute[72773]: DEBUG nova.objects.instance [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lazy-loading 'flavor' on Instance uuid 60f877e9-8032-4781-8692-88853f420a3c {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:43:13 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 22:43:13 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:43:13 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 22:43:13 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:43:13 user nova-compute[72773]:   <serial>f7fded2d-3c3a-4184-9aba-0a3f80e01531</serial>
Aug 16 22:43:13 user nova-compute[72773]: </disk>
Aug 16 22:43:13 user nova-compute[72773]:  {{(pid=72773) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 22:43:13 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:43:13 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:43:13 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] No VIF found with MAC fa:16:3e:71:50:b7, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:43:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d644c5a1-2b66-4443-9cb7-6b6418786e92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "60f877e9-8032-4781-8692-88853f420a3c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.287s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:43:14 user nova-compute[72773]: INFO nova.compute.manager [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Rescuing
Aug 16 22:43:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "refresh_cache-60f877e9-8032-4781-8692-88853f420a3c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:43:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquired lock "refresh_cache-60f877e9-8032-4781-8692-88853f420a3c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:43:14 user nova-compute[72773]: DEBUG nova.network.neutron [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:43:15 user nova-compute[72773]: DEBUG nova.network.neutron [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Updating instance_info_cache with network_info: [{"id": "39797b08-9184-4673-a07c-c2123736fc54", "address": "fa:16:3e:71:50:b7", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39797b08-91", "ovs_interfaceid": "39797b08-9184-4673-a07c-c2123736fc54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:43:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Releasing lock "refresh_cache-60f877e9-8032-4781-8692-88853f420a3c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:43:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:15 user nova-compute[72773]: DEBUG nova.compute.manager [req-faa50d99-1869-4bb7-a11a-c57edf6f8201 req-10b60264-9bd8-478f-8f49-16db237b024d service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received event network-vif-unplugged-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:43:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-faa50d99-1869-4bb7-a11a-c57edf6f8201 req-10b60264-9bd8-478f-8f49-16db237b024d service nova] Acquiring lock "60f877e9-8032-4781-8692-88853f420a3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:43:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-faa50d99-1869-4bb7-a11a-c57edf6f8201 req-10b60264-9bd8-478f-8f49-16db237b024d service nova] Lock "60f877e9-8032-4781-8692-88853f420a3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:43:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-faa50d99-1869-4bb7-a11a-c57edf6f8201 req-10b60264-9bd8-478f-8f49-16db237b024d service nova] Lock "60f877e9-8032-4781-8692-88853f420a3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:43:15 user nova-compute[72773]: DEBUG nova.compute.manager [req-faa50d99-1869-4bb7-a11a-c57edf6f8201 req-10b60264-9bd8-478f-8f49-16db237b024d service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] No waiting events found dispatching network-vif-unplugged-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:43:15 user nova-compute[72773]: WARNING nova.compute.manager [req-faa50d99-1869-4bb7-a11a-c57edf6f8201 req-10b60264-9bd8-478f-8f49-16db237b024d service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received unexpected event network-vif-unplugged-39797b08-9184-4673-a07c-c2123736fc54 for instance with vm_state active and task_state rescuing.
Aug 16 22:43:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:16 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Instance destroyed successfully.
Aug 16 22:43:16 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Attempting rescue
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72773) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Instance directory exists: not creating {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 22:43:16 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Creating image(s)
Aug 16 22:43:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "/opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "/opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "/opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.objects.instance [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lazy-loading 'trusted_certs' on Instance uuid 60f877e9-8032-4781-8692-88853f420a3c {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692225781.1783888, b99244c8-f6df-4c60-b8be-09fc4e644733 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:43:16 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] VM Stopped (Lifecycle Event)
Aug 16 22:43:16 user nova-compute[72773]: INFO nova.compute.manager [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Took 18.62 seconds to detach 1 volumes for instance.
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.compute.manager [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] [instance: 7cf275ce-0647-43af-ad03-24cbac934b59] Deleting volume: c203a677-77d4-45aa-a91d-f69ed23c7dca {{(pid=72773) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.compute.manager [None req-b3661925-b27d-4625-b3d0-ebc6d0f9936f None None] [instance: b99244c8-f6df-4c60-b8be-09fc4e644733] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.247s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk.rescue {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk.rescue" returned: 0 in 0.072s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.322s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.objects.instance [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lazy-loading 'migration_context' on Instance uuid 60f877e9-8032-4781-8692-88853f420a3c {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Start _get_guest_xml network_info=[{"id": "39797b08-9184-4673-a07c-c2123736fc54", "address": "fa:16:3e:71:50:b7", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "vif_mac": "fa:16:3e:71:50:b7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39797b08-91", "ovs_interfaceid": "39797b08-9184-4673-a07c-c2123736fc54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.objects.instance [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lazy-loading 'resources' on Instance uuid 60f877e9-8032-4781-8692-88853f420a3c {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.objects.instance [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lazy-loading 'numa_topology' on Instance uuid 60f877e9-8032-4781-8692-88853f420a3c {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:43:16 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:43:16 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.objects.instance [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lazy-loading 'vcpu_model' on Instance uuid 60f877e9-8032-4781-8692-88853f420a3c {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:41:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-827284706',display_name='tempest-ServerRescueNegativeTestJSON-server-827284706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-827284706',id=35,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7gafhwwNaFwdrqYDxUnK7qviiu8w72xziXFtmugun3TJ+ehJ6SdUX+lpAqyz9MNn0gbwOiswYPEz294I0l7FWrizeZtd/b4guqnHdCcLGRy+g1PZ0sbuxpR4sXj4MbGg==',key_name='tempest-keypair-1429512481',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:41:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f8e068df8094356b16a6480cd231675',ramdisk_id='',reservation_id='r-wbw339d1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1754829282',owner_user_name='tempest-ServerRescueNegativeTestJSON-1754829282-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:41:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62e5b77a149140fd8613d566f41cc23d',uuid=60f877e9-8032-4781-8692-88853f420a3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39797b08-9184-4673-a07c-c2123736fc54", "address": "fa:16:3e:71:50:b7", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "vif_mac": "fa:16:3e:71:50:b7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39797b08-91", "ovs_interfaceid": "39797b08-9184-4673-a07c-c2123736fc54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Converting VIF {"id": "39797b08-9184-4673-a07c-c2123736fc54", "address": "fa:16:3e:71:50:b7", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "vif_mac": "fa:16:3e:71:50:b7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39797b08-91", "ovs_interfaceid": "39797b08-9184-4673-a07c-c2123736fc54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:50:b7,bridge_name='br-int',has_traffic_filtering=True,id=39797b08-9184-4673-a07c-c2123736fc54,network=Network(8a43bbad-aab2-44c9-a7e4-62696d908234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39797b08-91') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.objects.instance [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lazy-loading 'pci_devices' on Instance uuid 60f877e9-8032-4781-8692-88853f420a3c {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:43:16 user nova-compute[72773]:   <uuid>60f877e9-8032-4781-8692-88853f420a3c</uuid>
Aug 16 22:43:16 user nova-compute[72773]:   <name>instance-00000023</name>
Aug 16 22:43:16 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:43:16 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:43:16 user nova-compute[72773]:   <metadata>
Aug 16 22:43:16 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:43:16 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:43:16 user nova-compute[72773]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-827284706</nova:name>
Aug 16 22:43:16 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:43:16</nova:creationTime>
Aug 16 22:43:16 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:43:16 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:43:16 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:43:16 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:43:16 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:43:16 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:43:16 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:43:16 user nova-compute[72773]:       <nova:owner>
Aug 16 22:43:16 user nova-compute[72773]:         <nova:user uuid="62e5b77a149140fd8613d566f41cc23d">tempest-ServerRescueNegativeTestJSON-1754829282-project-member</nova:user>
Aug 16 22:43:16 user nova-compute[72773]:         <nova:project uuid="0f8e068df8094356b16a6480cd231675">tempest-ServerRescueNegativeTestJSON-1754829282</nova:project>
Aug 16 22:43:16 user nova-compute[72773]:       </nova:owner>
Aug 16 22:43:16 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:43:16 user nova-compute[72773]:       <nova:ports>
Aug 16 22:43:16 user nova-compute[72773]:         <nova:port uuid="39797b08-9184-4673-a07c-c2123736fc54">
Aug 16 22:43:16 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 22:43:16 user nova-compute[72773]:         </nova:port>
Aug 16 22:43:16 user nova-compute[72773]:       </nova:ports>
Aug 16 22:43:16 user nova-compute[72773]:     </nova:instance>
Aug 16 22:43:16 user nova-compute[72773]:   </metadata>
Aug 16 22:43:16 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:43:16 user nova-compute[72773]:     <system>
Aug 16 22:43:16 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:43:16 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:43:16 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:43:16 user nova-compute[72773]:       <entry name="serial">60f877e9-8032-4781-8692-88853f420a3c</entry>
Aug 16 22:43:16 user nova-compute[72773]:       <entry name="uuid">60f877e9-8032-4781-8692-88853f420a3c</entry>
Aug 16 22:43:16 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:43:16 user nova-compute[72773]:     </system>
Aug 16 22:43:16 user nova-compute[72773]:   </sysinfo>
Aug 16 22:43:16 user nova-compute[72773]:   <os>
Aug 16 22:43:16 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:43:16 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:43:16 user nova-compute[72773]:   </os>
Aug 16 22:43:16 user nova-compute[72773]:   <features>
Aug 16 22:43:16 user nova-compute[72773]:     <acpi/>
Aug 16 22:43:16 user nova-compute[72773]:     <apic/>
Aug 16 22:43:16 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:43:16 user nova-compute[72773]:   </features>
Aug 16 22:43:16 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:43:16 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:43:16 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:43:16 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:43:16 user nova-compute[72773]:   </clock>
Aug 16 22:43:16 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:43:16 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:43:16 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:43:16 user nova-compute[72773]:   </cpu>
Aug 16 22:43:16 user nova-compute[72773]:   <devices>
Aug 16 22:43:16 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:43:16 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:43:16 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk.rescue"/>
Aug 16 22:43:16 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:43:16 user nova-compute[72773]:     </disk>
Aug 16 22:43:16 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:43:16 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:43:16 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk"/>
Aug 16 22:43:16 user nova-compute[72773]:       <target dev="vdb" bus="virtio"/>
Aug 16 22:43:16 user nova-compute[72773]:     </disk>
Aug 16 22:43:16 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:43:16 user nova-compute[72773]:       <mac address="fa:16:3e:71:50:b7"/>
Aug 16 22:43:16 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:43:16 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:43:16 user nova-compute[72773]:       <target dev="tap39797b08-91"/>
Aug 16 22:43:16 user nova-compute[72773]:     </interface>
Aug 16 22:43:16 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:43:16 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/console.log" append="off"/>
Aug 16 22:43:16 user nova-compute[72773]:     </serial>
Aug 16 22:43:16 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:43:16 user nova-compute[72773]:     <video>
Aug 16 22:43:16 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:43:16 user nova-compute[72773]:     </video>
Aug 16 22:43:16 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:43:16 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:43:16 user nova-compute[72773]:     </rng>
Aug 16 22:43:16 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:43:16 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:43:16 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:43:16 user nova-compute[72773]:     </memballoon>
Aug 16 22:43:16 user nova-compute[72773]:   </devices>
Aug 16 22:43:16 user nova-compute[72773]: </domain>
Aug 16 22:43:16 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:43:16 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Instance destroyed successfully.
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] No VIF found with MAC fa:16:3e:71:50:b7, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:43:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.517s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:43:16 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Deleted allocations for instance 7cf275ce-0647-43af-ad03-24cbac934b59
Aug 16 22:43:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8ed7212a-60a8-4f18-9588-b1adf0ec1f7e tempest-TestShelveInstance-1515246832 tempest-TestShelveInstance-1515246832-project-member] Lock "7cf275ce-0647-43af-ad03-24cbac934b59" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 21.748s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:43:17 user nova-compute[72773]: DEBUG nova.compute.manager [req-acde4237-9abc-4eb6-b114-06c00c583d3f req-bce15d15-ecbb-43d3-a2fa-a9c9b1f8b2a3 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received event network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:43:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-acde4237-9abc-4eb6-b114-06c00c583d3f req-bce15d15-ecbb-43d3-a2fa-a9c9b1f8b2a3 service nova] Acquiring lock "60f877e9-8032-4781-8692-88853f420a3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:43:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-acde4237-9abc-4eb6-b114-06c00c583d3f req-bce15d15-ecbb-43d3-a2fa-a9c9b1f8b2a3 service nova] Lock "60f877e9-8032-4781-8692-88853f420a3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:43:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-acde4237-9abc-4eb6-b114-06c00c583d3f req-bce15d15-ecbb-43d3-a2fa-a9c9b1f8b2a3 service nova] Lock "60f877e9-8032-4781-8692-88853f420a3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:43:17 user nova-compute[72773]: DEBUG nova.compute.manager [req-acde4237-9abc-4eb6-b114-06c00c583d3f req-bce15d15-ecbb-43d3-a2fa-a9c9b1f8b2a3 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] No waiting events found dispatching network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:43:17 user nova-compute[72773]: WARNING nova.compute.manager [req-acde4237-9abc-4eb6-b114-06c00c583d3f req-bce15d15-ecbb-43d3-a2fa-a9c9b1f8b2a3 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received unexpected event network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 for instance with vm_state active and task_state rescuing.
Aug 16 22:43:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:19 user nova-compute[72773]: DEBUG nova.compute.manager [req-319bbd2b-6b19-438f-a8db-4fd7b3a00129 req-6ce1dff4-5e92-40de-80fd-32bb217ddda3 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received event network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:43:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-319bbd2b-6b19-438f-a8db-4fd7b3a00129 req-6ce1dff4-5e92-40de-80fd-32bb217ddda3 service nova] Acquiring lock "60f877e9-8032-4781-8692-88853f420a3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:43:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-319bbd2b-6b19-438f-a8db-4fd7b3a00129 req-6ce1dff4-5e92-40de-80fd-32bb217ddda3 service nova] Lock "60f877e9-8032-4781-8692-88853f420a3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:43:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-319bbd2b-6b19-438f-a8db-4fd7b3a00129 req-6ce1dff4-5e92-40de-80fd-32bb217ddda3 service nova] Lock "60f877e9-8032-4781-8692-88853f420a3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:43:19 user nova-compute[72773]: DEBUG nova.compute.manager [req-319bbd2b-6b19-438f-a8db-4fd7b3a00129 req-6ce1dff4-5e92-40de-80fd-32bb217ddda3 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] No waiting events found dispatching network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:43:19 user nova-compute[72773]: WARNING nova.compute.manager [req-319bbd2b-6b19-438f-a8db-4fd7b3a00129 req-6ce1dff4-5e92-40de-80fd-32bb217ddda3 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received unexpected event network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 for instance with vm_state active and task_state rescuing.
Aug 16 22:43:19 user nova-compute[72773]: DEBUG nova.compute.manager [req-319bbd2b-6b19-438f-a8db-4fd7b3a00129 req-6ce1dff4-5e92-40de-80fd-32bb217ddda3 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received event network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:43:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-319bbd2b-6b19-438f-a8db-4fd7b3a00129 req-6ce1dff4-5e92-40de-80fd-32bb217ddda3 service nova] Acquiring lock "60f877e9-8032-4781-8692-88853f420a3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:43:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-319bbd2b-6b19-438f-a8db-4fd7b3a00129 req-6ce1dff4-5e92-40de-80fd-32bb217ddda3 service nova] Lock "60f877e9-8032-4781-8692-88853f420a3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:43:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-319bbd2b-6b19-438f-a8db-4fd7b3a00129 req-6ce1dff4-5e92-40de-80fd-32bb217ddda3 service nova] Lock "60f877e9-8032-4781-8692-88853f420a3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:43:19 user nova-compute[72773]: DEBUG nova.compute.manager [req-319bbd2b-6b19-438f-a8db-4fd7b3a00129 req-6ce1dff4-5e92-40de-80fd-32bb217ddda3 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] No waiting events found dispatching network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:43:19 user nova-compute[72773]: WARNING nova.compute.manager [req-319bbd2b-6b19-438f-a8db-4fd7b3a00129 req-6ce1dff4-5e92-40de-80fd-32bb217ddda3 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received unexpected event network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 for instance with vm_state active and task_state rescuing.
Aug 16 22:43:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Removed pending event for 60f877e9-8032-4781-8692-88853f420a3c due to event {{(pid=72773) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 22:43:20 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225800.498101, 60f877e9-8032-4781-8692-88853f420a3c => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:43:20 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 60f877e9-8032-4781-8692-88853f420a3c] VM Resumed (Lifecycle Event)
Aug 16 22:43:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:20 user nova-compute[72773]: DEBUG nova.compute.manager [None req-c04836d4-4813-437f-bb3f-a0a618841f92 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:43:20 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:43:20 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:43:20 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 60f877e9-8032-4781-8692-88853f420a3c] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 22:43:20 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225800.498888, 60f877e9-8032-4781-8692-88853f420a3c => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:43:20 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 60f877e9-8032-4781-8692-88853f420a3c] VM Started (Lifecycle Event)
Aug 16 22:43:20 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:43:20 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:43:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:36 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:41 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-671fe32a-0a90-429d-b550-a63913feb75d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "05f47c14-f17f-43d9-b607-bccc9a0c3957" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:43:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-671fe32a-0a90-429d-b550-a63913feb75d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "05f47c14-f17f-43d9-b607-bccc9a0c3957" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:43:43 user nova-compute[72773]: INFO nova.compute.manager [None req-671fe32a-0a90-429d-b550-a63913feb75d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Detaching volume 88ff5034-5a21-43b7-8086-d83b2c142296
Aug 16 22:43:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "030d076d-5099-4236-ae31-6025017eb51e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:43:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "030d076d-5099-4236-ae31-6025017eb51e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:43:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "030d076d-5099-4236-ae31-6025017eb51e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:43:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "030d076d-5099-4236-ae31-6025017eb51e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:43:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "030d076d-5099-4236-ae31-6025017eb51e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:43:43 user nova-compute[72773]: INFO nova.compute.manager [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Terminating instance
Aug 16 22:43:43 user nova-compute[72773]: DEBUG nova.compute.manager [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:43:43 user nova-compute[72773]: INFO nova.virt.block_device [None req-671fe32a-0a90-429d-b550-a63913feb75d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Attempting to driver detach volume 88ff5034-5a21-43b7-8086-d83b2c142296 from mountpoint /dev/vdb
Aug 16 22:43:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-671fe32a-0a90-429d-b550-a63913feb75d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Attempting to detach device vdb from instance 05f47c14-f17f-43d9-b607-bccc9a0c3957 from the persistent domain config. {{(pid=72773) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 22:43:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-671fe32a-0a90-429d-b550-a63913feb75d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:43:43 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:43:43 user nova-compute[72773]:   <source dev="/dev/sde"/>
Aug 16 22:43:43 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:43:43 user nova-compute[72773]:   <serial>88ff5034-5a21-43b7-8086-d83b2c142296</serial>
Aug 16 22:43:43 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 22:43:43 user nova-compute[72773]: </disk>
Aug 16 22:43:43 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:43:43 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-671fe32a-0a90-429d-b550-a63913feb75d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Successfully detached device vdb from instance 05f47c14-f17f-43d9-b607-bccc9a0c3957 from the persistent domain config.
Aug 16 22:43:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-671fe32a-0a90-429d-b550-a63913feb75d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 05f47c14-f17f-43d9-b607-bccc9a0c3957 from the live domain config. {{(pid=72773) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 22:43:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-671fe32a-0a90-429d-b550-a63913feb75d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:43:43 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:43:43 user nova-compute[72773]:   <source dev="/dev/sde"/>
Aug 16 22:43:43 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:43:43 user nova-compute[72773]:   <serial>88ff5034-5a21-43b7-8086-d83b2c142296</serial>
Aug 16 22:43:43 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 22:43:43 user nova-compute[72773]: </disk>
Aug 16 22:43:43 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:43:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:43 user nova-compute[72773]: DEBUG nova.compute.manager [req-26de2a90-2cd6-4e60-9875-411c62f80eb7 req-52898cd6-60a3-40d6-9708-e9009add89fd service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Received event network-vif-unplugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:43:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-26de2a90-2cd6-4e60-9875-411c62f80eb7 req-52898cd6-60a3-40d6-9708-e9009add89fd service nova] Acquiring lock "030d076d-5099-4236-ae31-6025017eb51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:43:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-26de2a90-2cd6-4e60-9875-411c62f80eb7 req-52898cd6-60a3-40d6-9708-e9009add89fd service nova] Lock "030d076d-5099-4236-ae31-6025017eb51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:43:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-26de2a90-2cd6-4e60-9875-411c62f80eb7 req-52898cd6-60a3-40d6-9708-e9009add89fd service nova] Lock "030d076d-5099-4236-ae31-6025017eb51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:43:43 user nova-compute[72773]: DEBUG nova.compute.manager [req-26de2a90-2cd6-4e60-9875-411c62f80eb7 req-52898cd6-60a3-40d6-9708-e9009add89fd service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] No waiting events found dispatching network-vif-unplugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:43:43 user nova-compute[72773]: DEBUG nova.compute.manager [req-26de2a90-2cd6-4e60-9875-411c62f80eb7 req-52898cd6-60a3-40d6-9708-e9009add89fd service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Received event network-vif-unplugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:43:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Received event <DeviceRemovedEvent: 1692225823.8847034, 05f47c14-f17f-43d9-b607-bccc9a0c3957 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72773) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 22:43:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-671fe32a-0a90-429d-b550-a63913feb75d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 05f47c14-f17f-43d9-b607-bccc9a0c3957 {{(pid=72773) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 22:43:43 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-671fe32a-0a90-429d-b550-a63913feb75d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Successfully detached device vdb from instance 05f47c14-f17f-43d9-b607-bccc9a0c3957 from the live domain config.
Aug 16 22:43:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-671fe32a-0a90-429d-b550-a63913feb75d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:43:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-671fe32a-0a90-429d-b550-a63913feb75d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yspoPAQq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:43:43 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-671fe32a-0a90-429d-b550-a63913feb75d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:43:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-671fe32a-0a90-429d-b550-a63913feb75d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:43:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-671fe32a-0a90-429d-b550-a63913feb75d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:43:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-671fe32a-0a90-429d-b550-a63913feb75d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:43:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b09e13-600a-453f-9415-3ec6ba77b802]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbe35ba-bf94-4caa-a240-c6f1acad4750]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-671fe32a-0a90-429d-b550-a63913feb75d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:43:43 user nova-compute[72773]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 (non-flash)
Aug 16 22:43:43 user nova-compute[72773]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)
Aug 16 22:43:43 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:43:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-671fe32a-0a90-429d-b550-a63913feb75d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:43:43 user nova-compute[72773]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 (non-flash)
Aug 16 22:43:43 user nova-compute[72773]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)
Aug 16 22:43:43 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:43:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-671fe32a-0a90-429d-b550-a63913feb75d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef8038e3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296'): ({'sde'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:43:43 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-671fe32a-0a90-429d-b550-a63913feb75d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Removing single pathed devices sde {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:43:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1e3748-d92f-4223-9611-b0f67e2429fb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f5d469-99bf-4110-9597-af827fc72e8e]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-671fe32a-0a90-429d-b550-a63913feb75d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Flushing IO for device /dev/sde {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e021348-021e-4f7d-8dbe-21e0f6ca3042]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-671fe32a-0a90-429d-b550-a63913feb75d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.056s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[36efa942-4d1d-4c19-a42c-115f271837d5]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-671fe32a-0a90-429d-b550-a63913feb75d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-671fe32a-0a90-429d-b550-a63913feb75d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] SCSI volumes sde have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-671fe32a-0a90-429d-b550-a63913feb75d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[be806f03-b254-4fab-a7cd-334fda992c20]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-671fe32a-0a90-429d-b550-a63913feb75d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7e7832-e5a0-4975-89b9-e8e28eeadf80]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-671fe32a-0a90-429d-b550-a63913feb75d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296, portal: 172.16.0.220,3260]
Aug 16 22:43:44 user nova-compute[72773]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296, portal: 172.16.0.220,3260] successful.
Aug 16 22:43:44 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88ff5034-5a21-43b7-8086-d83b2c142296 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[08032eb6-84a0-4d04-ad73-34d8bfcec51e]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-671fe32a-0a90-429d-b550-a63913feb75d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-671fe32a-0a90-429d-b550-a63913feb75d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-671fe32a-0a90-429d-b550-a63913feb75d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] <== disconnect_volume: return (341ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-671fe32a-0a90-429d-b550-a63913feb75d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:43:44 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Instance destroyed successfully.
Aug 16 22:43:44 user nova-compute[72773]: DEBUG nova.objects.instance [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lazy-loading 'resources' on Instance uuid 030d076d-5099-4236-ae31-6025017eb51e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:27:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-481632116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-481632116',id=12,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:29:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f496354017e467e9b7a537c73248fe2',ramdisk_id='',reservation_id='r-1jyekcam',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648946443',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:31:42Z,user_data=None,user_id='42e8c8d0806e45ed9d1126aad24a034b',uuid=030d076d-5099-4236-ae31-6025017eb51e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c", "address": "fa:16:3e:27:b6:2b", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc3b07d-2b", "ovs_interfaceid": "bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Converting VIF {"id": "bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c", "address": "fa:16:3e:27:b6:2b", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc3b07d-2b", "ovs_interfaceid": "bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:b6:2b,bridge_name='br-int',has_traffic_filtering=True,id=bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c,network=Network(0a6ec813-28f9-4716-bf41-20722c69fe20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc3b07d-2b') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG os_vif [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:b6:2b,bridge_name='br-int',has_traffic_filtering=True,id=bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c,network=Network(0a6ec813-28f9-4716-bf41-20722c69fe20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc3b07d-2b') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbdc3b07d-2b, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:43:44 user nova-compute[72773]: INFO os_vif [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:b6:2b,bridge_name='br-int',has_traffic_filtering=True,id=bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c,network=Network(0a6ec813-28f9-4716-bf41-20722c69fe20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc3b07d-2b')
Aug 16 22:43:44 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GWPeHDmK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:43:44 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:43:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a694f72-40b6-46da-b7a1-cb5cc07c46e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ebf072-4a9f-4726-a083-1cece3d3a93c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:43:44 user nova-compute[72773]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)
Aug 16 22:43:44 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 (non-flash)
Aug 16 22:43:44 user nova-compute[72773]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)
Aug 16 22:43:44 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef5c5a2050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706'): ({'sdb'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Removing single pathed devices sdb {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[887f0cc9-3431-4c5a-8a05-8e19bab4ec8b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[702269ec-729d-46f9-a108-a43d209fccdd]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Flushing IO for device /dev/sdb {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75e410c-d840-4e05-aaaf-7029c9b8185c]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c9b9eb-c74c-4181-a608-e135911f53c1]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] SCSI volumes sdb have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16bc361-b036-4a01-bbbd-5c6de98e83cb]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5802b41b-11f4-430c-80aa-40ccab38fe50]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706, portal: 172.16.0.220,3260]
Aug 16 22:43:44 user nova-compute[72773]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706, portal: 172.16.0.220,3260] successful.
Aug 16 22:43:44 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b2bca5-6794-44b5-ae2b-66771ff9d706 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ad7e75-8dd5-477c-bb86-1e35e775f07b]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] <== disconnect_volume: return (288ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:43:44 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Deleting instance files /opt/stack/data/nova/instances/030d076d-5099-4236-ae31-6025017eb51e_del
Aug 16 22:43:44 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Deletion of /opt/stack/data/nova/instances/030d076d-5099-4236-ae31-6025017eb51e_del complete
Aug 16 22:43:44 user nova-compute[72773]: INFO nova.compute.manager [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Took 1.34 seconds to destroy the instance on the hypervisor.
Aug 16 22:43:44 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:43:44 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 030d076d-5099-4236-ae31-6025017eb51e] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:43:45 user nova-compute[72773]: DEBUG nova.objects.instance [None req-671fe32a-0a90-429d-b550-a63913feb75d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lazy-loading 'flavor' on Instance uuid 05f47c14-f17f-43d9-b607-bccc9a0c3957 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:43:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-671fe32a-0a90-429d-b550-a63913feb75d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "05f47c14-f17f-43d9-b607-bccc9a0c3957" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.920s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:43:45 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:43:45 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Took 0.58 seconds to deallocate network for instance.
Aug 16 22:43:45 user nova-compute[72773]: DEBUG nova.compute.manager [req-6edf95b7-ddd0-418f-a221-5583743d19aa req-dc402b8d-730b-4714-a9c4-3620a231f22b service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Received event network-vif-deleted-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:43:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:45 user nova-compute[72773]: DEBUG nova.compute.manager [req-54d8dcaa-78bc-40c9-ad0c-382c0a17bf67 req-15c9a35a-2ecb-4016-ae81-391e3c8e43dd service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Received event network-vif-plugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:43:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-54d8dcaa-78bc-40c9-ad0c-382c0a17bf67 req-15c9a35a-2ecb-4016-ae81-391e3c8e43dd service nova] Acquiring lock "030d076d-5099-4236-ae31-6025017eb51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:43:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-54d8dcaa-78bc-40c9-ad0c-382c0a17bf67 req-15c9a35a-2ecb-4016-ae81-391e3c8e43dd service nova] Lock "030d076d-5099-4236-ae31-6025017eb51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:43:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-54d8dcaa-78bc-40c9-ad0c-382c0a17bf67 req-15c9a35a-2ecb-4016-ae81-391e3c8e43dd service nova] Lock "030d076d-5099-4236-ae31-6025017eb51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:43:45 user nova-compute[72773]: DEBUG nova.compute.manager [req-54d8dcaa-78bc-40c9-ad0c-382c0a17bf67 req-15c9a35a-2ecb-4016-ae81-391e3c8e43dd service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] No waiting events found dispatching network-vif-plugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:43:45 user nova-compute[72773]: WARNING nova.compute.manager [req-54d8dcaa-78bc-40c9-ad0c-382c0a17bf67 req-15c9a35a-2ecb-4016-ae81-391e3c8e43dd service nova] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Received unexpected event network-vif-plugged-bdc3b07d-2b54-4b4c-8f4e-4628ef56b70c for instance with vm_state active and task_state deleting.
Aug 16 22:43:46 user nova-compute[72773]: INFO nova.compute.manager [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Took 0.79 seconds to detach 1 volumes for instance.
Aug 16 22:43:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:43:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:43:46 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:43:46 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:43:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:43:46 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Deleted allocations for instance 030d076d-5099-4236-ae31-6025017eb51e
Aug 16 22:43:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d3242fb7-f0a5-4954-b04b-2078d58b01b7 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "030d076d-5099-4236-ae31-6025017eb51e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.246s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:43:47 user nova-compute[72773]: DEBUG nova.compute.manager [req-efbed947-f0ef-42fa-a4b6-fde6a16843ac req-ab659e56-6a84-4b06-a490-2cbd781d9580 service nova] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Received event network-changed-a032c74c-6676-4542-9419-7338d24d7648 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:43:47 user nova-compute[72773]: DEBUG nova.compute.manager [req-efbed947-f0ef-42fa-a4b6-fde6a16843ac req-ab659e56-6a84-4b06-a490-2cbd781d9580 service nova] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Refreshing instance network info cache due to event network-changed-a032c74c-6676-4542-9419-7338d24d7648. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:43:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-efbed947-f0ef-42fa-a4b6-fde6a16843ac req-ab659e56-6a84-4b06-a490-2cbd781d9580 service nova] Acquiring lock "refresh_cache-85969e4e-3ee6-4f76-9598-960282e030af" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:43:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-efbed947-f0ef-42fa-a4b6-fde6a16843ac req-ab659e56-6a84-4b06-a490-2cbd781d9580 service nova] Acquired lock "refresh_cache-85969e4e-3ee6-4f76-9598-960282e030af" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:43:47 user nova-compute[72773]: DEBUG nova.network.neutron [req-efbed947-f0ef-42fa-a4b6-fde6a16843ac req-ab659e56-6a84-4b06-a490-2cbd781d9580 service nova] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Refreshing network info cache for port a032c74c-6676-4542-9419-7338d24d7648 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:43:48 user nova-compute[72773]: DEBUG nova.network.neutron [req-efbed947-f0ef-42fa-a4b6-fde6a16843ac req-ab659e56-6a84-4b06-a490-2cbd781d9580 service nova] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Updated VIF entry in instance network info cache for port a032c74c-6676-4542-9419-7338d24d7648. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:43:48 user nova-compute[72773]: DEBUG nova.network.neutron [req-efbed947-f0ef-42fa-a4b6-fde6a16843ac req-ab659e56-6a84-4b06-a490-2cbd781d9580 service nova] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Updating instance_info_cache with network_info: [{"id": "a032c74c-6676-4542-9419-7338d24d7648", "address": "fa:16:3e:da:a9:c3", "network": {"id": "fbbd26d0-dfa2-4568-b941-8603e19595eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-767228890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2606202eee724d63a4f3596b520b8867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa032c74c-66", "ovs_interfaceid": "a032c74c-6676-4542-9419-7338d24d7648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:43:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-efbed947-f0ef-42fa-a4b6-fde6a16843ac req-ab659e56-6a84-4b06-a490-2cbd781d9580 service nova] Releasing lock "refresh_cache-85969e4e-3ee6-4f76-9598-960282e030af" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:43:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Acquiring lock "85969e4e-3ee6-4f76-9598-960282e030af" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:43:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "85969e4e-3ee6-4f76-9598-960282e030af" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:43:49 user nova-compute[72773]: DEBUG nova.objects.instance [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lazy-loading 'flavor' on Instance uuid 85969e4e-3ee6-4f76-9598-960282e030af {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:43:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "85969e4e-3ee6-4f76-9598-960282e030af" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:43:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Acquiring lock "85969e4e-3ee6-4f76-9598-960282e030af" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:43:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "85969e4e-3ee6-4f76-9598-960282e030af" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:43:49 user nova-compute[72773]: INFO nova.compute.manager [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Attaching volume 7d084696-69ec-4028-ae2d-8587ea6fecac to /dev/vdb
Aug 16 22:43:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:49 user nova-compute[72773]: DEBUG os_brick.utils [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:43:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:49 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce6173b-1c75-4f03-807c-ee3648e9ce8f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:49 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf663bbf-d7a2-418a-b054-80c456646003]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:43:49 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[441a9765-591a-40ea-8128-52264b1da37e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:49 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ef7de6-b82d-4672-916c-d6ca1dbf52ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:43:49 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:43:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:43:49 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:43:49 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:43:49 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5b6362-0ca3-4d86-aa5a-c3aea8621e21]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:43:49 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:43:49 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:43:49 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:43:49 user nova-compute[72773]: DEBUG os_brick.utils [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:43:49 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Updating existing volume attachment record: 50546a4c-befb-4389-af99-9774de871f0d {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:43:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:54 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:54 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:55 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:43:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:59 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692225824.2782497, 030d076d-5099-4236-ae31-6025017eb51e => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:43:59 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 030d076d-5099-4236-ae31-6025017eb51e] VM Stopped (Lifecycle Event)
Aug 16 22:43:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:43:59 user nova-compute[72773]: DEBUG nova.compute.manager [None req-e0fcae84-cab5-4313-83b1-1aa351f99a26 None None] [instance: 030d076d-5099-4236-ae31-6025017eb51e] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:43:59 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:44:00 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:44:00 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:44:00 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Didn't find any instances for network info cache update. {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 22:44:00 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:44:00 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:44:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LekqjMgu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:44:00 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:44:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:44:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:44:00 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:44:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:44:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:44:00 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:44:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:00 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e93b80-1936-4ee3-bae9-3625d3b5e60f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:44:00 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:44:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:00 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e5da98-1c7d-4cb1-9070-2b9b1ba0b008]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac] added
Aug 16 22:44:00 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:44:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:00 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb18274f-c241-4053-9ca9-0e0c5240c3ec]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dec33a0-d612-4e10-baca-6cc2c2e1e5e9]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LekqjMgu {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LekqjMgu" returned: 0 in 0.031s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ff62cc-e794-4072-9490-b704e5f4bba6]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LekqjMgu'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a49ac9-3ee5-4ca2-8340-5bd3a361adef]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bbcc04-7bf8-462b-987a-d0d387969e1d]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)
Aug 16 22:44:01 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)
Aug 16 22:44:01 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02b2038-2920-46c4-84f2-9b9c0c0817d4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac, portal: 172.16.0.220,3260]
Aug 16 22:44:01 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac, portal: 172.16.0.220,3260] successful.
Aug 16 22:44:01 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1386eff-52a4-4f9c-b59b-3bc569ca9f78]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d74bc56-484e-49ca-aad0-7aa96baa2de8]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)
Aug 16 22:44:01 user nova-compute[72773]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac (non-flash)
Aug 16 22:44:01 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)
Aug 16 22:44:01 user nova-compute[72773]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac (non-flash)
Aug 16 22:44:01 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[690a50c3-69df-485d-ac5e-fb3e07ca1db3]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:01 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: None {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:44:02 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:44:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LekqjMgu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:44:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:44:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23637343365396161', 'path': '/dev/sdb'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:44:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637343365396161', 'path': '/dev/sdb'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:44:02 user nova-compute[72773]: DEBUG nova.objects.instance [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lazy-loading 'flavor' on Instance uuid 85969e4e-3ee6-4f76-9598-960282e030af {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:44:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 22:44:02 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:44:02 user nova-compute[72773]:   <source dev="/dev/sdb"/>
Aug 16 22:44:02 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:44:02 user nova-compute[72773]:   <serial>7d084696-69ec-4028-ae2d-8587ea6fecac</serial>
Aug 16 22:44:02 user nova-compute[72773]: </disk>
Aug 16 22:44:02 user nova-compute[72773]:  {{(pid=72773) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 22:44:02 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:44:02 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:44:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:44:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:44:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] No VIF found with MAC fa:16:3e:da:a9:c3, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:44:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3553a980-8546-4aae-8cd6-d57d964d75fb tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "85969e4e-3ee6-4f76-9598-960282e030af" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.699s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:44:03 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:44:03 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:44:03 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:44:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:44:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:44:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:44:03 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:44:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:04 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:44:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:44:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85969e4e-3ee6-4f76-9598-960282e030af/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85969e4e-3ee6-4f76-9598-960282e030af/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85969e4e-3ee6-4f76-9598-960282e030af/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85969e4e-3ee6-4f76-9598-960282e030af/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:44:07 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:44:07 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:44:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=7888MB free_disk=25.365528106689453GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:44:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:44:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:44:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 956d334e-f190-4625-b144-ab44d2f3321a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:44:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 391a6006-4fe6-4398-a1e8-ae95b5edbf2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:44:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance cf01c401-c424-4b3e-aa5b-439d62b1ae4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:44:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance f4210738-d01e-4408-a15c-aeccada6dd23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:44:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 05f47c14-f17f-43d9-b607-bccc9a0c3957 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:44:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 60f877e9-8032-4781-8692-88853f420a3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:44:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 85969e4e-3ee6-4f76-9598-960282e030af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:44:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:44:07 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:44:08 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:44:08 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:44:08 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:44:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.440s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:44:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Acquiring lock "85969e4e-3ee6-4f76-9598-960282e030af" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:44:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "85969e4e-3ee6-4f76-9598-960282e030af" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:44:08 user nova-compute[72773]: DEBUG nova.objects.instance [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lazy-loading 'flavor' on Instance uuid 85969e4e-3ee6-4f76-9598-960282e030af {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:44:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "85969e4e-3ee6-4f76-9598-960282e030af" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:44:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Acquiring lock "85969e4e-3ee6-4f76-9598-960282e030af" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:44:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "85969e4e-3ee6-4f76-9598-960282e030af" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:44:08 user nova-compute[72773]: INFO nova.compute.manager [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Attaching volume 013ee8c8-daea-4318-bf51-1eb33a12fb9f to /dev/vdc
Aug 16 22:44:08 user nova-compute[72773]: DEBUG os_brick.utils [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:44:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:08 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a10aa0-6ce4-4dcb-8963-7c4abfef66e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:08 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33aed80-3428-41a7-a132-442001a1dcc4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:08 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[67286170-3eb1-4b24-8c59-e7061b9ecbfc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:08 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9d08bc-4195-4a83-bfbb-0e04bd1c18ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:44:08 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:44:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:44:08 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:44:08 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5add2413-8a70-42a9-8aec-b17962d6e1eb]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:08 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:44:08 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:44:08 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:44:08 user nova-compute[72773]: DEBUG os_brick.utils [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:44:08 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Updating existing volume attachment record: ec87ea0f-72c2-494f-8e9b-216492c590ef {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:44:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:10 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:44:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:44:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BLDSskbX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:44:21 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:44:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:44:21 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:44:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:44:21 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:44:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb7a33f-e25b-497f-9956-6444e0b11f5a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:44:21 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.054s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b62117-f501-4aa2-bfe4-2b14e3593046]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f] added
Aug 16 22:44:21 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9a8b10-3bed-4008-b763-236001c1e7e7]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a380f04-3e2f-4fd1-bd0e-9846b30ec6ca]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BLDSskbX {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BLDSskbX" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfda3ecb-f5f7-46b5-909b-cac2612a84f5]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BLDSskbX'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.078s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7900c59-e4ec-41d8-a31a-b4717dd69305]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[215e2777-a50c-4523-aac8-54898c2c183e]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)
Aug 16 22:44:21 user nova-compute[72773]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac (non-flash)
Aug 16 22:44:21 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)
Aug 16 22:44:21 user nova-compute[72773]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac (non-flash)
Aug 16 22:44:21 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[009f95f8-28ff-4067-95ce-cf638277bf85]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f, portal: 172.16.0.220,3260]
Aug 16 22:44:21 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f, portal: 172.16.0.220,3260] successful.
Aug 16 22:44:21 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd17a6b-bcef-4401-9e21-c828605d9a3c]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[079c09e9-bfed-41bb-8d23-e21ff3be5f52]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)
Aug 16 22:44:21 user nova-compute[72773]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac (non-flash)
Aug 16 22:44:21 user nova-compute[72773]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f (non-flash)
Aug 16 22:44:21 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)
Aug 16 22:44:21 user nova-compute[72773]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac (non-flash)
Aug 16 22:44:21 user nova-compute[72773]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f (non-flash)
Aug 16 22:44:21 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.416s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7267ce73-636d-43da-a124-1978886aeccd]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:44:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BLDSskbX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:44:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:22 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.453s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:44:22 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] <== connect_volume: return (1456ms) {'type': 'block', 'scsi_wwn': '23866656137353436', 'path': '/dev/sdd'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:44:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866656137353436', 'path': '/dev/sdd'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:44:22 user nova-compute[72773]: DEBUG nova.objects.instance [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lazy-loading 'flavor' on Instance uuid 85969e4e-3ee6-4f76-9598-960282e030af {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:44:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 22:44:22 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:44:22 user nova-compute[72773]:   <source dev="/dev/sdd"/>
Aug 16 22:44:22 user nova-compute[72773]:   <target dev="vdc" bus="virtio"/>
Aug 16 22:44:22 user nova-compute[72773]:   <serial>013ee8c8-daea-4318-bf51-1eb33a12fb9f</serial>
Aug 16 22:44:22 user nova-compute[72773]: </disk>
Aug 16 22:44:22 user nova-compute[72773]:  {{(pid=72773) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 22:44:23 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:44:23 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:44:23 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:44:23 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] No VIF found with MAC fa:16:3e:da:a9:c3, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:44:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ff11ef42-1a7b-463b-9d74-15248ff81de5 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "85969e4e-3ee6-4f76-9598-960282e030af" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.070s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-26104a4c-5b7d-4ae5-8594-2cf55195532d tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Acquiring lock "85969e4e-3ee6-4f76-9598-960282e030af" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-26104a4c-5b7d-4ae5-8594-2cf55195532d tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "85969e4e-3ee6-4f76-9598-960282e030af" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:44:24 user nova-compute[72773]: INFO nova.compute.manager [None req-26104a4c-5b7d-4ae5-8594-2cf55195532d tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Detaching volume 013ee8c8-daea-4318-bf51-1eb33a12fb9f
Aug 16 22:44:24 user nova-compute[72773]: INFO nova.virt.block_device [None req-26104a4c-5b7d-4ae5-8594-2cf55195532d tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Attempting to driver detach volume 013ee8c8-daea-4318-bf51-1eb33a12fb9f from mountpoint /dev/vdc
Aug 16 22:44:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-26104a4c-5b7d-4ae5-8594-2cf55195532d tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Attempting to detach device vdc from instance 85969e4e-3ee6-4f76-9598-960282e030af from the persistent domain config. {{(pid=72773) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-26104a4c-5b7d-4ae5-8594-2cf55195532d tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:44:24 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:44:24 user nova-compute[72773]:   <source dev="/dev/sdd"/>
Aug 16 22:44:24 user nova-compute[72773]:   <target dev="vdc" bus="virtio"/>
Aug 16 22:44:24 user nova-compute[72773]:   <serial>013ee8c8-daea-4318-bf51-1eb33a12fb9f</serial>
Aug 16 22:44:24 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 22:44:24 user nova-compute[72773]: </disk>
Aug 16 22:44:24 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:44:24 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-26104a4c-5b7d-4ae5-8594-2cf55195532d tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Successfully detached device vdc from instance 85969e4e-3ee6-4f76-9598-960282e030af from the persistent domain config.
Aug 16 22:44:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-26104a4c-5b7d-4ae5-8594-2cf55195532d tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 85969e4e-3ee6-4f76-9598-960282e030af from the live domain config. {{(pid=72773) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-26104a4c-5b7d-4ae5-8594-2cf55195532d tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:44:24 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:44:24 user nova-compute[72773]:   <source dev="/dev/sdd"/>
Aug 16 22:44:24 user nova-compute[72773]:   <target dev="vdc" bus="virtio"/>
Aug 16 22:44:24 user nova-compute[72773]:   <serial>013ee8c8-daea-4318-bf51-1eb33a12fb9f</serial>
Aug 16 22:44:24 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 22:44:24 user nova-compute[72773]: </disk>
Aug 16 22:44:24 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Received event <DeviceRemovedEvent: 1692225864.6371443, 85969e4e-3ee6-4f76-9598-960282e030af => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72773) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-26104a4c-5b7d-4ae5-8594-2cf55195532d tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 85969e4e-3ee6-4f76-9598-960282e030af {{(pid=72773) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 22:44:24 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-26104a4c-5b7d-4ae5-8594-2cf55195532d tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Successfully detached device vdc from instance 85969e4e-3ee6-4f76-9598-960282e030af from the live domain config.
Aug 16 22:44:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26104a4c-5b7d-4ae5-8594-2cf55195532d tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-26104a4c-5b7d-4ae5-8594-2cf55195532d tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BLDSskbX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:44:24 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-26104a4c-5b7d-4ae5-8594-2cf55195532d tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:44:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-26104a4c-5b7d-4ae5-8594-2cf55195532d tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-26104a4c-5b7d-4ae5-8594-2cf55195532d tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-26104a4c-5b7d-4ae5-8594-2cf55195532d tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b4514a-3607-4412-835a-7304bb09d1b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03c422e-d879-4ddd-a98f-66d1abab8fad]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-26104a4c-5b7d-4ae5-8594-2cf55195532d tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)
Aug 16 22:44:24 user nova-compute[72773]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac (non-flash)
Aug 16 22:44:24 user nova-compute[72773]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f (non-flash)
Aug 16 22:44:24 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-26104a4c-5b7d-4ae5-8594-2cf55195532d tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)
Aug 16 22:44:24 user nova-compute[72773]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac (non-flash)
Aug 16 22:44:24 user nova-compute[72773]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f (non-flash)
Aug 16 22:44:24 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-26104a4c-5b7d-4ae5-8594-2cf55195532d tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef5c24fd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f'): ({'sdd'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-26104a4c-5b7d-4ae5-8594-2cf55195532d tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Removing single pathed devices sdd {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c074ca2-411d-4cee-bb75-f7f053c33b82]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f2f52d-6e37-4120-b6d8-ff0ba16bf9a2]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-26104a4c-5b7d-4ae5-8594-2cf55195532d tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Flushing IO for device /dev/sdd {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[782fede7-75c5-431d-b288-963b681bc730]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-26104a4c-5b7d-4ae5-8594-2cf55195532d tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe39f10-623c-4a5b-9cad-66f2f3e721aa]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-26104a4c-5b7d-4ae5-8594-2cf55195532d tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-26104a4c-5b7d-4ae5-8594-2cf55195532d tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] SCSI volumes sdd have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-26104a4c-5b7d-4ae5-8594-2cf55195532d tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[793223c6-1f29-4dfd-b78c-a45d2909f3be]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-26104a4c-5b7d-4ae5-8594-2cf55195532d tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a36f9bf-caa8-4d5a-9d81-f566f747ede2]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-26104a4c-5b7d-4ae5-8594-2cf55195532d tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f, portal: 172.16.0.220,3260]
Aug 16 22:44:24 user nova-compute[72773]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f, portal: 172.16.0.220,3260] successful.
Aug 16 22:44:24 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:013ee8c8-daea-4318-bf51-1eb33a12fb9f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d916d00c-dbe1-4d3f-b4b0-3d4afb8cebc6]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-26104a4c-5b7d-4ae5-8594-2cf55195532d tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-26104a4c-5b7d-4ae5-8594-2cf55195532d tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-26104a4c-5b7d-4ae5-8594-2cf55195532d tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] <== disconnect_volume: return (315ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:44:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26104a4c-5b7d-4ae5-8594-2cf55195532d tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:44:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:25 user nova-compute[72773]: DEBUG nova.objects.instance [None req-26104a4c-5b7d-4ae5-8594-2cf55195532d tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lazy-loading 'flavor' on Instance uuid 85969e4e-3ee6-4f76-9598-960282e030af {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:44:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-26104a4c-5b7d-4ae5-8594-2cf55195532d tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "85969e4e-3ee6-4f76-9598-960282e030af" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.807s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:44:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Acquiring lock "205a7949-e2c1-40d8-8570-04d351a282d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:44:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Lock "205a7949-e2c1-40d8-8570-04d351a282d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:44:28 user nova-compute[72773]: DEBUG nova.compute.manager [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:44:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:44:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:44:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:44:29 user nova-compute[72773]: INFO nova.compute.claims [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Claim successful on node user
Aug 16 22:44:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:29 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:44:29 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:44:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:44:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:44:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:44:29 user nova-compute[72773]: DEBUG nova.network.neutron [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:44:29 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:44:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:44:29 user nova-compute[72773]: DEBUG nova.policy [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '324a8eec167548e7b35985a728cb9fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ab2d64953744b6921313f99fd21ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:44:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:44:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:44:29 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Creating image(s)
Aug 16 22:44:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Acquiring lock "/opt/stack/data/nova/instances/205a7949-e2c1-40d8-8570-04d351a282d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:44:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Lock "/opt/stack/data/nova/instances/205a7949-e2c1-40d8-8570-04d351a282d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:44:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Lock "/opt/stack/data/nova/instances/205a7949-e2c1-40d8-8570-04d351a282d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:44:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.195s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:44:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:44:29 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.192s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/205a7949-e2c1-40d8-8570-04d351a282d1/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/205a7949-e2c1-40d8-8570-04d351a282d1/disk 1073741824" returned: 0 in 0.057s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:44:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:30 user nova-compute[72773]: DEBUG nova.network.neutron [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Successfully created port: dd167a5e-bfa9-4376-93e4-4710d619f441 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:44:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.198s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:30 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Checking if we can resize image /opt/stack/data/nova/instances/205a7949-e2c1-40d8-8570-04d351a282d1/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:44:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205a7949-e2c1-40d8-8570-04d351a282d1/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:44:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205a7949-e2c1-40d8-8570-04d351a282d1/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:44:30 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Cannot resize image /opt/stack/data/nova/instances/205a7949-e2c1-40d8-8570-04d351a282d1/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:44:30 user nova-compute[72773]: DEBUG nova.objects.instance [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Lazy-loading 'migration_context' on Instance uuid 205a7949-e2c1-40d8-8570-04d351a282d1 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:44:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:44:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Ensure instance console log exists: /opt/stack/data/nova/instances/205a7949-e2c1-40d8-8570-04d351a282d1/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:44:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:44:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:44:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:44:31 user nova-compute[72773]: DEBUG nova.network.neutron [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Successfully updated port: dd167a5e-bfa9-4376-93e4-4710d619f441 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:44:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Acquiring lock "refresh_cache-205a7949-e2c1-40d8-8570-04d351a282d1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:44:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Acquired lock "refresh_cache-205a7949-e2c1-40d8-8570-04d351a282d1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:44:31 user nova-compute[72773]: DEBUG nova.network.neutron [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:44:31 user nova-compute[72773]: DEBUG nova.compute.manager [req-ddd3b4a4-1094-4d03-a8db-e553aa0dbd7d req-0480fb89-4504-4064-98ba-9353aecede9f service nova] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Received event network-changed-dd167a5e-bfa9-4376-93e4-4710d619f441 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:44:31 user nova-compute[72773]: DEBUG nova.compute.manager [req-ddd3b4a4-1094-4d03-a8db-e553aa0dbd7d req-0480fb89-4504-4064-98ba-9353aecede9f service nova] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Refreshing instance network info cache due to event network-changed-dd167a5e-bfa9-4376-93e4-4710d619f441. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:44:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ddd3b4a4-1094-4d03-a8db-e553aa0dbd7d req-0480fb89-4504-4064-98ba-9353aecede9f service nova] Acquiring lock "refresh_cache-205a7949-e2c1-40d8-8570-04d351a282d1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:44:31 user nova-compute[72773]: DEBUG nova.network.neutron [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG nova.network.neutron [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Updating instance_info_cache with network_info: [{"id": "dd167a5e-bfa9-4376-93e4-4710d619f441", "address": "fa:16:3e:29:8f:37", "network": {"id": "e203d8a3-baeb-4f14-933b-3f102832c52b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1621308549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ab2d64953744b6921313f99fd21ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd167a5e-bf", "ovs_interfaceid": "dd167a5e-bfa9-4376-93e4-4710d619f441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Releasing lock "refresh_cache-205a7949-e2c1-40d8-8570-04d351a282d1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG nova.compute.manager [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Instance network_info: |[{"id": "dd167a5e-bfa9-4376-93e4-4710d619f441", "address": "fa:16:3e:29:8f:37", "network": {"id": "e203d8a3-baeb-4f14-933b-3f102832c52b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1621308549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ab2d64953744b6921313f99fd21ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd167a5e-bf", "ovs_interfaceid": "dd167a5e-bfa9-4376-93e4-4710d619f441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ddd3b4a4-1094-4d03-a8db-e553aa0dbd7d req-0480fb89-4504-4064-98ba-9353aecede9f service nova] Acquired lock "refresh_cache-205a7949-e2c1-40d8-8570-04d351a282d1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG nova.network.neutron [req-ddd3b4a4-1094-4d03-a8db-e553aa0dbd7d req-0480fb89-4504-4064-98ba-9353aecede9f service nova] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Refreshing network info cache for port dd167a5e-bfa9-4376-93e4-4710d619f441 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Start _get_guest_xml network_info=[{"id": "dd167a5e-bfa9-4376-93e4-4710d619f441", "address": "fa:16:3e:29:8f:37", "network": {"id": "e203d8a3-baeb-4f14-933b-3f102832c52b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1621308549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ab2d64953744b6921313f99fd21ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd167a5e-bf", "ovs_interfaceid": "dd167a5e-bfa9-4376-93e4-4710d619f441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:44:32 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:44:32 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:44:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:44:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-582533255',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-582533255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-5825332',id=38,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIES1mqzY3Sql7tHXGImFIRVq3MCQb+FQxRSY0sJxqtIa11fP3aAPJV2U5a6jykLnXWxoW4xeNGRedZbrQK7VKjxnC8XQevwzomRJ1D2+jDqpn3TFGEiMSvHgwG1+ZFaCw==',key_name='tempest-keypair-1885943282',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51ab2d64953744b6921313f99fd21ae4',ramdisk_id='',reservation_id='r-fy7jb0u2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-148899249',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:44:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='324a8eec167548e7b35985a728cb9fd6',uuid=205a7949-e2c1-40d8-8570-04d351a282d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd167a5e-bfa9-4376-93e4-4710d619f441", "address": "fa:16:3e:29:8f:37", "network": {"id": "e203d8a3-baeb-4f14-933b-3f102832c52b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1621308549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ab2d64953744b6921313f99fd21ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd167a5e-bf", "ovs_interfaceid": "dd167a5e-bfa9-4376-93e4-4710d619f441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Converting VIF {"id": "dd167a5e-bfa9-4376-93e4-4710d619f441", "address": "fa:16:3e:29:8f:37", "network": {"id": "e203d8a3-baeb-4f14-933b-3f102832c52b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1621308549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ab2d64953744b6921313f99fd21ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd167a5e-bf", "ovs_interfaceid": "dd167a5e-bfa9-4376-93e4-4710d619f441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:8f:37,bridge_name='br-int',has_traffic_filtering=True,id=dd167a5e-bfa9-4376-93e4-4710d619f441,network=Network(e203d8a3-baeb-4f14-933b-3f102832c52b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd167a5e-bf') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG nova.objects.instance [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Lazy-loading 'pci_devices' on Instance uuid 205a7949-e2c1-40d8-8570-04d351a282d1 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:44:32 user nova-compute[72773]:   <uuid>205a7949-e2c1-40d8-8570-04d351a282d1</uuid>
Aug 16 22:44:32 user nova-compute[72773]:   <name>instance-00000026</name>
Aug 16 22:44:32 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:44:32 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:44:32 user nova-compute[72773]:   <metadata>
Aug 16 22:44:32 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:44:32 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:44:32 user nova-compute[72773]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-582533255</nova:name>
Aug 16 22:44:32 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:44:32</nova:creationTime>
Aug 16 22:44:32 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:44:32 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:44:32 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:44:32 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:44:32 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:44:32 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:44:32 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:44:32 user nova-compute[72773]:       <nova:owner>
Aug 16 22:44:32 user nova-compute[72773]:         <nova:user uuid="324a8eec167548e7b35985a728cb9fd6">tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member</nova:user>
Aug 16 22:44:32 user nova-compute[72773]:         <nova:project uuid="51ab2d64953744b6921313f99fd21ae4">tempest-TestServerVolumeAttachScenarioOldVersion-148899249</nova:project>
Aug 16 22:44:32 user nova-compute[72773]:       </nova:owner>
Aug 16 22:44:32 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:44:32 user nova-compute[72773]:       <nova:ports>
Aug 16 22:44:32 user nova-compute[72773]:         <nova:port uuid="dd167a5e-bfa9-4376-93e4-4710d619f441">
Aug 16 22:44:32 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 22:44:32 user nova-compute[72773]:         </nova:port>
Aug 16 22:44:32 user nova-compute[72773]:       </nova:ports>
Aug 16 22:44:32 user nova-compute[72773]:     </nova:instance>
Aug 16 22:44:32 user nova-compute[72773]:   </metadata>
Aug 16 22:44:32 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:44:32 user nova-compute[72773]:     <system>
Aug 16 22:44:32 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:44:32 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:44:32 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:44:32 user nova-compute[72773]:       <entry name="serial">205a7949-e2c1-40d8-8570-04d351a282d1</entry>
Aug 16 22:44:32 user nova-compute[72773]:       <entry name="uuid">205a7949-e2c1-40d8-8570-04d351a282d1</entry>
Aug 16 22:44:32 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:44:32 user nova-compute[72773]:     </system>
Aug 16 22:44:32 user nova-compute[72773]:   </sysinfo>
Aug 16 22:44:32 user nova-compute[72773]:   <os>
Aug 16 22:44:32 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:44:32 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:44:32 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:44:32 user nova-compute[72773]:   </os>
Aug 16 22:44:32 user nova-compute[72773]:   <features>
Aug 16 22:44:32 user nova-compute[72773]:     <acpi/>
Aug 16 22:44:32 user nova-compute[72773]:     <apic/>
Aug 16 22:44:32 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:44:32 user nova-compute[72773]:   </features>
Aug 16 22:44:32 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:44:32 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:44:32 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:44:32 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:44:32 user nova-compute[72773]:   </clock>
Aug 16 22:44:32 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:44:32 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:44:32 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:44:32 user nova-compute[72773]:   </cpu>
Aug 16 22:44:32 user nova-compute[72773]:   <devices>
Aug 16 22:44:32 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:44:32 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:44:32 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/205a7949-e2c1-40d8-8570-04d351a282d1/disk"/>
Aug 16 22:44:32 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:44:32 user nova-compute[72773]:     </disk>
Aug 16 22:44:32 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:44:32 user nova-compute[72773]:       <mac address="fa:16:3e:29:8f:37"/>
Aug 16 22:44:32 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:44:32 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:44:32 user nova-compute[72773]:       <target dev="tapdd167a5e-bf"/>
Aug 16 22:44:32 user nova-compute[72773]:     </interface>
Aug 16 22:44:32 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:44:32 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/205a7949-e2c1-40d8-8570-04d351a282d1/console.log" append="off"/>
Aug 16 22:44:32 user nova-compute[72773]:     </serial>
Aug 16 22:44:32 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:44:32 user nova-compute[72773]:     <video>
Aug 16 22:44:32 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:44:32 user nova-compute[72773]:     </video>
Aug 16 22:44:32 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:44:32 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:44:32 user nova-compute[72773]:     </rng>
Aug 16 22:44:32 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:44:32 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:44:32 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:44:32 user nova-compute[72773]:     </memballoon>
Aug 16 22:44:32 user nova-compute[72773]:   </devices>
Aug 16 22:44:32 user nova-compute[72773]: </domain>
Aug 16 22:44:32 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:44:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-582533255',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-582533255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-5825332',id=38,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIES1mqzY3Sql7tHXGImFIRVq3MCQb+FQxRSY0sJxqtIa11fP3aAPJV2U5a6jykLnXWxoW4xeNGRedZbrQK7VKjxnC8XQevwzomRJ1D2+jDqpn3TFGEiMSvHgwG1+ZFaCw==',key_name='tempest-keypair-1885943282',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51ab2d64953744b6921313f99fd21ae4',ramdisk_id='',reservation_id='r-fy7jb0u2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-148899249',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:44:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='324a8eec167548e7b35985a728cb9fd6',uuid=205a7949-e2c1-40d8-8570-04d351a282d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd167a5e-bfa9-4376-93e4-4710d619f441", "address": "fa:16:3e:29:8f:37", "network": {"id": "e203d8a3-baeb-4f14-933b-3f102832c52b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1621308549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ab2d64953744b6921313f99fd21ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd167a5e-bf", "ovs_interfaceid": "dd167a5e-bfa9-4376-93e4-4710d619f441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Converting VIF {"id": "dd167a5e-bfa9-4376-93e4-4710d619f441", "address": "fa:16:3e:29:8f:37", "network": {"id": "e203d8a3-baeb-4f14-933b-3f102832c52b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1621308549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ab2d64953744b6921313f99fd21ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd167a5e-bf", "ovs_interfaceid": "dd167a5e-bfa9-4376-93e4-4710d619f441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:8f:37,bridge_name='br-int',has_traffic_filtering=True,id=dd167a5e-bfa9-4376-93e4-4710d619f441,network=Network(e203d8a3-baeb-4f14-933b-3f102832c52b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd167a5e-bf') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG os_vif [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:8f:37,bridge_name='br-int',has_traffic_filtering=True,id=dd167a5e-bfa9-4376-93e4-4710d619f441,network=Network(e203d8a3-baeb-4f14-933b-3f102832c52b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd167a5e-bf') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd167a5e-bf, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdd167a5e-bf, col_values=(('external_ids', {'iface-id': 'dd167a5e-bfa9-4376-93e4-4710d619f441', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:8f:37', 'vm-uuid': '205a7949-e2c1-40d8-8570-04d351a282d1'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:32 user nova-compute[72773]: INFO os_vif [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:8f:37,bridge_name='br-int',has_traffic_filtering=True,id=dd167a5e-bfa9-4376-93e4-4710d619f441,network=Network(e203d8a3-baeb-4f14-933b-3f102832c52b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd167a5e-bf')
Aug 16 22:44:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] No VIF found with MAC fa:16:3e:29:8f:37, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG nova.network.neutron [req-ddd3b4a4-1094-4d03-a8db-e553aa0dbd7d req-0480fb89-4504-4064-98ba-9353aecede9f service nova] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Updated VIF entry in instance network info cache for port dd167a5e-bfa9-4376-93e4-4710d619f441. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG nova.network.neutron [req-ddd3b4a4-1094-4d03-a8db-e553aa0dbd7d req-0480fb89-4504-4064-98ba-9353aecede9f service nova] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Updating instance_info_cache with network_info: [{"id": "dd167a5e-bfa9-4376-93e4-4710d619f441", "address": "fa:16:3e:29:8f:37", "network": {"id": "e203d8a3-baeb-4f14-933b-3f102832c52b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1621308549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ab2d64953744b6921313f99fd21ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd167a5e-bf", "ovs_interfaceid": "dd167a5e-bfa9-4376-93e4-4710d619f441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:44:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ddd3b4a4-1094-4d03-a8db-e553aa0dbd7d req-0480fb89-4504-4064-98ba-9353aecede9f service nova] Releasing lock "refresh_cache-205a7949-e2c1-40d8-8570-04d351a282d1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:44:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dd4e9b0e-854a-4180-a61e-c20eaebbd846 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "05f47c14-f17f-43d9-b607-bccc9a0c3957" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:44:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dd4e9b0e-854a-4180-a61e-c20eaebbd846 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "05f47c14-f17f-43d9-b607-bccc9a0c3957" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:44:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dd4e9b0e-854a-4180-a61e-c20eaebbd846 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "05f47c14-f17f-43d9-b607-bccc9a0c3957-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:44:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dd4e9b0e-854a-4180-a61e-c20eaebbd846 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "05f47c14-f17f-43d9-b607-bccc9a0c3957-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:44:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dd4e9b0e-854a-4180-a61e-c20eaebbd846 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "05f47c14-f17f-43d9-b607-bccc9a0c3957-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:44:33 user nova-compute[72773]: INFO nova.compute.manager [None req-dd4e9b0e-854a-4180-a61e-c20eaebbd846 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Terminating instance
Aug 16 22:44:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-dd4e9b0e-854a-4180-a61e-c20eaebbd846 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:44:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:34 user nova-compute[72773]: DEBUG nova.compute.manager [req-570eca3a-0a58-40cd-8ded-3eb353f293e8 req-6185ef6f-709d-44d0-901b-26eb8ce56dc5 service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Received event network-vif-unplugged-0b3b8e24-f9dc-4d52-9f47-8505706c1457 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:44:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-570eca3a-0a58-40cd-8ded-3eb353f293e8 req-6185ef6f-709d-44d0-901b-26eb8ce56dc5 service nova] Acquiring lock "05f47c14-f17f-43d9-b607-bccc9a0c3957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:44:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-570eca3a-0a58-40cd-8ded-3eb353f293e8 req-6185ef6f-709d-44d0-901b-26eb8ce56dc5 service nova] Lock "05f47c14-f17f-43d9-b607-bccc9a0c3957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:44:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-570eca3a-0a58-40cd-8ded-3eb353f293e8 req-6185ef6f-709d-44d0-901b-26eb8ce56dc5 service nova] Lock "05f47c14-f17f-43d9-b607-bccc9a0c3957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:44:34 user nova-compute[72773]: DEBUG nova.compute.manager [req-570eca3a-0a58-40cd-8ded-3eb353f293e8 req-6185ef6f-709d-44d0-901b-26eb8ce56dc5 service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] No waiting events found dispatching network-vif-unplugged-0b3b8e24-f9dc-4d52-9f47-8505706c1457 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:44:34 user nova-compute[72773]: DEBUG nova.compute.manager [req-570eca3a-0a58-40cd-8ded-3eb353f293e8 req-6185ef6f-709d-44d0-901b-26eb8ce56dc5 service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Received event network-vif-unplugged-0b3b8e24-f9dc-4d52-9f47-8505706c1457 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:44:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f9d6cbf8-92b7-4472-a347-12ce651a4087 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "956d334e-f190-4625-b144-ab44d2f3321a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:44:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f9d6cbf8-92b7-4472-a347-12ce651a4087 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "956d334e-f190-4625-b144-ab44d2f3321a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:44:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f9d6cbf8-92b7-4472-a347-12ce651a4087 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "956d334e-f190-4625-b144-ab44d2f3321a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:44:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f9d6cbf8-92b7-4472-a347-12ce651a4087 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "956d334e-f190-4625-b144-ab44d2f3321a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:44:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f9d6cbf8-92b7-4472-a347-12ce651a4087 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "956d334e-f190-4625-b144-ab44d2f3321a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:44:34 user nova-compute[72773]: INFO nova.compute.manager [None req-f9d6cbf8-92b7-4472-a347-12ce651a4087 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Terminating instance
Aug 16 22:44:34 user nova-compute[72773]: DEBUG nova.compute.manager [None req-f9d6cbf8-92b7-4472-a347-12ce651a4087 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:44:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:34 user nova-compute[72773]: DEBUG nova.compute.manager [req-0e4d3cad-f90f-42fc-a0cb-ad11fbc5999f req-26336fd4-6acf-4be7-8675-3447a15e68e3 service nova] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Received event network-vif-unplugged-d1807881-ec54-4e55-8f2e-6f8046efd351 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:44:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0e4d3cad-f90f-42fc-a0cb-ad11fbc5999f req-26336fd4-6acf-4be7-8675-3447a15e68e3 service nova] Acquiring lock "956d334e-f190-4625-b144-ab44d2f3321a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:44:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0e4d3cad-f90f-42fc-a0cb-ad11fbc5999f req-26336fd4-6acf-4be7-8675-3447a15e68e3 service nova] Lock "956d334e-f190-4625-b144-ab44d2f3321a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:44:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0e4d3cad-f90f-42fc-a0cb-ad11fbc5999f req-26336fd4-6acf-4be7-8675-3447a15e68e3 service nova] Lock "956d334e-f190-4625-b144-ab44d2f3321a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:44:34 user nova-compute[72773]: DEBUG nova.compute.manager [req-0e4d3cad-f90f-42fc-a0cb-ad11fbc5999f req-26336fd4-6acf-4be7-8675-3447a15e68e3 service nova] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] No waiting events found dispatching network-vif-unplugged-d1807881-ec54-4e55-8f2e-6f8046efd351 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:44:34 user nova-compute[72773]: DEBUG nova.compute.manager [req-0e4d3cad-f90f-42fc-a0cb-ad11fbc5999f req-26336fd4-6acf-4be7-8675-3447a15e68e3 service nova] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Received event network-vif-unplugged-d1807881-ec54-4e55-8f2e-6f8046efd351 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:44:34 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Instance destroyed successfully.
Aug 16 22:44:34 user nova-compute[72773]: DEBUG nova.objects.instance [None req-dd4e9b0e-854a-4180-a61e-c20eaebbd846 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lazy-loading 'resources' on Instance uuid 05f47c14-f17f-43d9-b607-bccc9a0c3957 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:44:34 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-dd4e9b0e-854a-4180-a61e-c20eaebbd846 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T22:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1640374506',display_name='tempest-ServerActionsTestOtherA-server-1404163079',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1640374506',id=34,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBzvtDCwVci75U1rhvQ1Z9tY7UhERzUXkVpq7AVmjX8jpuQ8EldOLMxDXCgz1AaMzVkstK/rHc9w+j5Cm539WNo3fmDL3Nm1hTQWdxZWqybvyBt+XNmwDqSnz7VNnsE+g==',key_name='tempest-keypair-821177163',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:41:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3dc03400ff4448682ebba991a7e8af6',ramdisk_id='',reservation_id='r-t8bd36d0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1807466388',owner_user_name='tempest-ServerActionsTestOtherA-1807466388-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:41:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02982f15d1a640a5bc77069a906f3e9a',uuid=05f47c14-f17f-43d9-b607-bccc9a0c3957,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "address": "fa:16:3e:73:0f:a0", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3b8e24-f9", "ovs_interfaceid": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:44:34 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-dd4e9b0e-854a-4180-a61e-c20eaebbd846 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Converting VIF {"id": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "address": "fa:16:3e:73:0f:a0", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b3b8e24-f9", "ovs_interfaceid": "0b3b8e24-f9dc-4d52-9f47-8505706c1457", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:44:34 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-dd4e9b0e-854a-4180-a61e-c20eaebbd846 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:0f:a0,bridge_name='br-int',has_traffic_filtering=True,id=0b3b8e24-f9dc-4d52-9f47-8505706c1457,network=Network(1a1a40b0-631c-4f41-9ece-17cd713adfd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b3b8e24-f9') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:44:34 user nova-compute[72773]: DEBUG os_vif [None req-dd4e9b0e-854a-4180-a61e-c20eaebbd846 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:0f:a0,bridge_name='br-int',has_traffic_filtering=True,id=0b3b8e24-f9dc-4d52-9f47-8505706c1457,network=Network(1a1a40b0-631c-4f41-9ece-17cd713adfd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b3b8e24-f9') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:44:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b3b8e24-f9, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:44:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:44:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:34 user nova-compute[72773]: INFO os_vif [None req-dd4e9b0e-854a-4180-a61e-c20eaebbd846 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:0f:a0,bridge_name='br-int',has_traffic_filtering=True,id=0b3b8e24-f9dc-4d52-9f47-8505706c1457,network=Network(1a1a40b0-631c-4f41-9ece-17cd713adfd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b3b8e24-f9')
Aug 16 22:44:34 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-dd4e9b0e-854a-4180-a61e-c20eaebbd846 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Deleting instance files /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957_del
Aug 16 22:44:34 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-dd4e9b0e-854a-4180-a61e-c20eaebbd846 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Deletion of /opt/stack/data/nova/instances/05f47c14-f17f-43d9-b607-bccc9a0c3957_del complete
Aug 16 22:44:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:34 user nova-compute[72773]: INFO nova.compute.manager [None req-dd4e9b0e-854a-4180-a61e-c20eaebbd846 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 16 22:44:34 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-dd4e9b0e-854a-4180-a61e-c20eaebbd846 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:44:34 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:44:34 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:44:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:35 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Instance destroyed successfully.
Aug 16 22:44:35 user nova-compute[72773]: DEBUG nova.objects.instance [None req-f9d6cbf8-92b7-4472-a347-12ce651a4087 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lazy-loading 'resources' on Instance uuid 956d334e-f190-4625-b144-ab44d2f3321a {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:44:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-f9d6cbf8-92b7-4472-a347-12ce651a4087 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:24:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-509745796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-509745796',id=1,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:25:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f496354017e467e9b7a537c73248fe2',ramdisk_id='',reservation_id='r-ogm3kd31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648946443',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:26:48Z,user_data=None,user_id='42e8c8d0806e45ed9d1126aad24a034b',uuid=956d334e-f190-4625-b144-ab44d2f3321a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1807881-ec54-4e55-8f2e-6f8046efd351", "address": "fa:16:3e:b5:0f:ad", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1807881-ec", "ovs_interfaceid": "d1807881-ec54-4e55-8f2e-6f8046efd351", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:44:35 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-f9d6cbf8-92b7-4472-a347-12ce651a4087 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Converting VIF {"id": "d1807881-ec54-4e55-8f2e-6f8046efd351", "address": "fa:16:3e:b5:0f:ad", "network": {"id": "0a6ec813-28f9-4716-bf41-20722c69fe20", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-963013193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f496354017e467e9b7a537c73248fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1807881-ec", "ovs_interfaceid": "d1807881-ec54-4e55-8f2e-6f8046efd351", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:44:35 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-f9d6cbf8-92b7-4472-a347-12ce651a4087 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:0f:ad,bridge_name='br-int',has_traffic_filtering=True,id=d1807881-ec54-4e55-8f2e-6f8046efd351,network=Network(0a6ec813-28f9-4716-bf41-20722c69fe20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1807881-ec') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:44:35 user nova-compute[72773]: DEBUG os_vif [None req-f9d6cbf8-92b7-4472-a347-12ce651a4087 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:0f:ad,bridge_name='br-int',has_traffic_filtering=True,id=d1807881-ec54-4e55-8f2e-6f8046efd351,network=Network(0a6ec813-28f9-4716-bf41-20722c69fe20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1807881-ec') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:44:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1807881-ec, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:44:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:44:35 user nova-compute[72773]: INFO os_vif [None req-f9d6cbf8-92b7-4472-a347-12ce651a4087 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:0f:ad,bridge_name='br-int',has_traffic_filtering=True,id=d1807881-ec54-4e55-8f2e-6f8046efd351,network=Network(0a6ec813-28f9-4716-bf41-20722c69fe20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1807881-ec')
Aug 16 22:44:35 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-f9d6cbf8-92b7-4472-a347-12ce651a4087 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Deleting instance files /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a_del
Aug 16 22:44:35 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-f9d6cbf8-92b7-4472-a347-12ce651a4087 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Deletion of /opt/stack/data/nova/instances/956d334e-f190-4625-b144-ab44d2f3321a_del complete
Aug 16 22:44:35 user nova-compute[72773]: INFO nova.compute.manager [None req-f9d6cbf8-92b7-4472-a347-12ce651a4087 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Took 1.05 seconds to destroy the instance on the hypervisor.
Aug 16 22:44:35 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-f9d6cbf8-92b7-4472-a347-12ce651a4087 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:44:35 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:44:35 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:44:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG nova.compute.manager [req-17f93155-4b98-43af-9e5a-09f82c28d1f9 req-c87730f7-8a7a-47ee-a06c-b3f68a8571b2 service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Received event network-vif-plugged-0b3b8e24-f9dc-4d52-9f47-8505706c1457 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-17f93155-4b98-43af-9e5a-09f82c28d1f9 req-c87730f7-8a7a-47ee-a06c-b3f68a8571b2 service nova] Acquiring lock "05f47c14-f17f-43d9-b607-bccc9a0c3957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-17f93155-4b98-43af-9e5a-09f82c28d1f9 req-c87730f7-8a7a-47ee-a06c-b3f68a8571b2 service nova] Lock "05f47c14-f17f-43d9-b607-bccc9a0c3957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-17f93155-4b98-43af-9e5a-09f82c28d1f9 req-c87730f7-8a7a-47ee-a06c-b3f68a8571b2 service nova] Lock "05f47c14-f17f-43d9-b607-bccc9a0c3957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG nova.compute.manager [req-17f93155-4b98-43af-9e5a-09f82c28d1f9 req-c87730f7-8a7a-47ee-a06c-b3f68a8571b2 service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] No waiting events found dispatching network-vif-plugged-0b3b8e24-f9dc-4d52-9f47-8505706c1457 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:44:36 user nova-compute[72773]: WARNING nova.compute.manager [req-17f93155-4b98-43af-9e5a-09f82c28d1f9 req-c87730f7-8a7a-47ee-a06c-b3f68a8571b2 service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Received unexpected event network-vif-plugged-0b3b8e24-f9dc-4d52-9f47-8505706c1457 for instance with vm_state active and task_state deleting.
Aug 16 22:44:36 user nova-compute[72773]: DEBUG nova.compute.manager [req-17f93155-4b98-43af-9e5a-09f82c28d1f9 req-c87730f7-8a7a-47ee-a06c-b3f68a8571b2 service nova] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Received event network-vif-plugged-dd167a5e-bfa9-4376-93e4-4710d619f441 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-17f93155-4b98-43af-9e5a-09f82c28d1f9 req-c87730f7-8a7a-47ee-a06c-b3f68a8571b2 service nova] Acquiring lock "205a7949-e2c1-40d8-8570-04d351a282d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-17f93155-4b98-43af-9e5a-09f82c28d1f9 req-c87730f7-8a7a-47ee-a06c-b3f68a8571b2 service nova] Lock "205a7949-e2c1-40d8-8570-04d351a282d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-17f93155-4b98-43af-9e5a-09f82c28d1f9 req-c87730f7-8a7a-47ee-a06c-b3f68a8571b2 service nova] Lock "205a7949-e2c1-40d8-8570-04d351a282d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG nova.compute.manager [req-17f93155-4b98-43af-9e5a-09f82c28d1f9 req-c87730f7-8a7a-47ee-a06c-b3f68a8571b2 service nova] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] No waiting events found dispatching network-vif-plugged-dd167a5e-bfa9-4376-93e4-4710d619f441 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:44:36 user nova-compute[72773]: WARNING nova.compute.manager [req-17f93155-4b98-43af-9e5a-09f82c28d1f9 req-c87730f7-8a7a-47ee-a06c-b3f68a8571b2 service nova] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Received unexpected event network-vif-plugged-dd167a5e-bfa9-4376-93e4-4710d619f441 for instance with vm_state building and task_state spawning.
Aug 16 22:44:36 user nova-compute[72773]: DEBUG nova.compute.manager [req-17f93155-4b98-43af-9e5a-09f82c28d1f9 req-c87730f7-8a7a-47ee-a06c-b3f68a8571b2 service nova] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Received event network-vif-plugged-dd167a5e-bfa9-4376-93e4-4710d619f441 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-17f93155-4b98-43af-9e5a-09f82c28d1f9 req-c87730f7-8a7a-47ee-a06c-b3f68a8571b2 service nova] Acquiring lock "205a7949-e2c1-40d8-8570-04d351a282d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-17f93155-4b98-43af-9e5a-09f82c28d1f9 req-c87730f7-8a7a-47ee-a06c-b3f68a8571b2 service nova] Lock "205a7949-e2c1-40d8-8570-04d351a282d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-17f93155-4b98-43af-9e5a-09f82c28d1f9 req-c87730f7-8a7a-47ee-a06c-b3f68a8571b2 service nova] Lock "205a7949-e2c1-40d8-8570-04d351a282d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG nova.compute.manager [req-17f93155-4b98-43af-9e5a-09f82c28d1f9 req-c87730f7-8a7a-47ee-a06c-b3f68a8571b2 service nova] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] No waiting events found dispatching network-vif-plugged-dd167a5e-bfa9-4376-93e4-4710d619f441 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:44:36 user nova-compute[72773]: WARNING nova.compute.manager [req-17f93155-4b98-43af-9e5a-09f82c28d1f9 req-c87730f7-8a7a-47ee-a06c-b3f68a8571b2 service nova] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Received unexpected event network-vif-plugged-dd167a5e-bfa9-4376-93e4-4710d619f441 for instance with vm_state building and task_state spawning.
Aug 16 22:44:36 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:44:36 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Took 0.97 seconds to deallocate network for instance.
Aug 16 22:44:36 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:44:36 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Took 1.51 seconds to deallocate network for instance.
Aug 16 22:44:36 user nova-compute[72773]: DEBUG nova.compute.manager [req-05394e37-34f6-4c0a-937e-ee17cd57df10 req-560273a8-5b53-4b58-bdd1-f353e00ba61e service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Received event network-vif-deleted-0b3b8e24-f9dc-4d52-9f47-8505706c1457 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:44:36 user nova-compute[72773]: INFO nova.compute.manager [req-05394e37-34f6-4c0a-937e-ee17cd57df10 req-560273a8-5b53-4b58-bdd1-f353e00ba61e service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Neutron deleted interface 0b3b8e24-f9dc-4d52-9f47-8505706c1457; detaching it from the instance and deleting it from the info cache
Aug 16 22:44:36 user nova-compute[72773]: DEBUG nova.network.neutron [req-05394e37-34f6-4c0a-937e-ee17cd57df10 req-560273a8-5b53-4b58-bdd1-f353e00ba61e service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG nova.compute.manager [req-05394e37-34f6-4c0a-937e-ee17cd57df10 req-560273a8-5b53-4b58-bdd1-f353e00ba61e service nova] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Detach interface failed, port_id=0b3b8e24-f9dc-4d52-9f47-8505706c1457, reason: Instance 05f47c14-f17f-43d9-b607-bccc9a0c3957 could not be found. {{(pid=72773) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f9d6cbf8-92b7-4472-a347-12ce651a4087 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f9d6cbf8-92b7-4472-a347-12ce651a4087 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dd4e9b0e-854a-4180-a61e-c20eaebbd846 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG nova.compute.manager [req-fbb59cb3-2093-4da9-8ff1-2a90c78c1216 req-1ad7c17f-279f-44e1-a7ac-39820e8c2985 service nova] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Received event network-vif-plugged-d1807881-ec54-4e55-8f2e-6f8046efd351 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fbb59cb3-2093-4da9-8ff1-2a90c78c1216 req-1ad7c17f-279f-44e1-a7ac-39820e8c2985 service nova] Acquiring lock "956d334e-f190-4625-b144-ab44d2f3321a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fbb59cb3-2093-4da9-8ff1-2a90c78c1216 req-1ad7c17f-279f-44e1-a7ac-39820e8c2985 service nova] Lock "956d334e-f190-4625-b144-ab44d2f3321a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fbb59cb3-2093-4da9-8ff1-2a90c78c1216 req-1ad7c17f-279f-44e1-a7ac-39820e8c2985 service nova] Lock "956d334e-f190-4625-b144-ab44d2f3321a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG nova.compute.manager [req-fbb59cb3-2093-4da9-8ff1-2a90c78c1216 req-1ad7c17f-279f-44e1-a7ac-39820e8c2985 service nova] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] No waiting events found dispatching network-vif-plugged-d1807881-ec54-4e55-8f2e-6f8046efd351 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:44:36 user nova-compute[72773]: WARNING nova.compute.manager [req-fbb59cb3-2093-4da9-8ff1-2a90c78c1216 req-1ad7c17f-279f-44e1-a7ac-39820e8c2985 service nova] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Received unexpected event network-vif-plugged-d1807881-ec54-4e55-8f2e-6f8046efd351 for instance with vm_state deleted and task_state None.
Aug 16 22:44:36 user nova-compute[72773]: DEBUG nova.compute.manager [req-fbb59cb3-2093-4da9-8ff1-2a90c78c1216 req-1ad7c17f-279f-44e1-a7ac-39820e8c2985 service nova] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Received event network-vif-plugged-d1807881-ec54-4e55-8f2e-6f8046efd351 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fbb59cb3-2093-4da9-8ff1-2a90c78c1216 req-1ad7c17f-279f-44e1-a7ac-39820e8c2985 service nova] Acquiring lock "956d334e-f190-4625-b144-ab44d2f3321a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fbb59cb3-2093-4da9-8ff1-2a90c78c1216 req-1ad7c17f-279f-44e1-a7ac-39820e8c2985 service nova] Lock "956d334e-f190-4625-b144-ab44d2f3321a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fbb59cb3-2093-4da9-8ff1-2a90c78c1216 req-1ad7c17f-279f-44e1-a7ac-39820e8c2985 service nova] Lock "956d334e-f190-4625-b144-ab44d2f3321a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG nova.compute.manager [req-fbb59cb3-2093-4da9-8ff1-2a90c78c1216 req-1ad7c17f-279f-44e1-a7ac-39820e8c2985 service nova] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] No waiting events found dispatching network-vif-plugged-d1807881-ec54-4e55-8f2e-6f8046efd351 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:44:36 user nova-compute[72773]: WARNING nova.compute.manager [req-fbb59cb3-2093-4da9-8ff1-2a90c78c1216 req-1ad7c17f-279f-44e1-a7ac-39820e8c2985 service nova] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Received unexpected event network-vif-plugged-d1807881-ec54-4e55-8f2e-6f8046efd351 for instance with vm_state deleted and task_state None.
Aug 16 22:44:36 user nova-compute[72773]: DEBUG nova.compute.manager [req-fbb59cb3-2093-4da9-8ff1-2a90c78c1216 req-1ad7c17f-279f-44e1-a7ac-39820e8c2985 service nova] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Received event network-vif-plugged-d1807881-ec54-4e55-8f2e-6f8046efd351 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fbb59cb3-2093-4da9-8ff1-2a90c78c1216 req-1ad7c17f-279f-44e1-a7ac-39820e8c2985 service nova] Acquiring lock "956d334e-f190-4625-b144-ab44d2f3321a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fbb59cb3-2093-4da9-8ff1-2a90c78c1216 req-1ad7c17f-279f-44e1-a7ac-39820e8c2985 service nova] Lock "956d334e-f190-4625-b144-ab44d2f3321a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fbb59cb3-2093-4da9-8ff1-2a90c78c1216 req-1ad7c17f-279f-44e1-a7ac-39820e8c2985 service nova] Lock "956d334e-f190-4625-b144-ab44d2f3321a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG nova.compute.manager [req-fbb59cb3-2093-4da9-8ff1-2a90c78c1216 req-1ad7c17f-279f-44e1-a7ac-39820e8c2985 service nova] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] No waiting events found dispatching network-vif-plugged-d1807881-ec54-4e55-8f2e-6f8046efd351 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:44:36 user nova-compute[72773]: WARNING nova.compute.manager [req-fbb59cb3-2093-4da9-8ff1-2a90c78c1216 req-1ad7c17f-279f-44e1-a7ac-39820e8c2985 service nova] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Received unexpected event network-vif-plugged-d1807881-ec54-4e55-8f2e-6f8046efd351 for instance with vm_state deleted and task_state None.
Aug 16 22:44:36 user nova-compute[72773]: DEBUG nova.compute.manager [req-fbb59cb3-2093-4da9-8ff1-2a90c78c1216 req-1ad7c17f-279f-44e1-a7ac-39820e8c2985 service nova] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Received event network-vif-plugged-d1807881-ec54-4e55-8f2e-6f8046efd351 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fbb59cb3-2093-4da9-8ff1-2a90c78c1216 req-1ad7c17f-279f-44e1-a7ac-39820e8c2985 service nova] Acquiring lock "956d334e-f190-4625-b144-ab44d2f3321a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fbb59cb3-2093-4da9-8ff1-2a90c78c1216 req-1ad7c17f-279f-44e1-a7ac-39820e8c2985 service nova] Lock "956d334e-f190-4625-b144-ab44d2f3321a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fbb59cb3-2093-4da9-8ff1-2a90c78c1216 req-1ad7c17f-279f-44e1-a7ac-39820e8c2985 service nova] Lock "956d334e-f190-4625-b144-ab44d2f3321a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG nova.compute.manager [req-fbb59cb3-2093-4da9-8ff1-2a90c78c1216 req-1ad7c17f-279f-44e1-a7ac-39820e8c2985 service nova] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] No waiting events found dispatching network-vif-plugged-d1807881-ec54-4e55-8f2e-6f8046efd351 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:44:36 user nova-compute[72773]: WARNING nova.compute.manager [req-fbb59cb3-2093-4da9-8ff1-2a90c78c1216 req-1ad7c17f-279f-44e1-a7ac-39820e8c2985 service nova] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Received unexpected event network-vif-plugged-d1807881-ec54-4e55-8f2e-6f8046efd351 for instance with vm_state deleted and task_state None.
Aug 16 22:44:36 user nova-compute[72773]: DEBUG nova.compute.manager [req-fbb59cb3-2093-4da9-8ff1-2a90c78c1216 req-1ad7c17f-279f-44e1-a7ac-39820e8c2985 service nova] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Received event network-vif-deleted-d1807881-ec54-4e55-8f2e-6f8046efd351 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-f9d6cbf8-92b7-4472-a347-12ce651a4087 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-f9d6cbf8-92b7-4472-a347-12ce651a4087 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225876.9850469, 205a7949-e2c1-40d8-8570-04d351a282d1 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:44:36 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] VM Resumed (Lifecycle Event)
Aug 16 22:44:36 user nova-compute[72773]: DEBUG nova.compute.manager [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:44:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f9d6cbf8-92b7-4472-a347-12ce651a4087 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.519s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:44:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dd4e9b0e-854a-4180-a61e-c20eaebbd846 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.490s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:44:37 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Instance spawned successfully.
Aug 16 22:44:37 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:44:37 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:44:37 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:44:37 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:44:37 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:44:37 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:44:37 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:44:37 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:44:37 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:44:37 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-f9d6cbf8-92b7-4472-a347-12ce651a4087 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Deleted allocations for instance 956d334e-f190-4625-b144-ab44d2f3321a
Aug 16 22:44:37 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:44:37 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225876.987012, 205a7949-e2c1-40d8-8570-04d351a282d1 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:44:37 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] VM Started (Lifecycle Event)
Aug 16 22:44:37 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:44:37 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:44:37 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:44:37 user nova-compute[72773]: INFO nova.compute.manager [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Took 7.49 seconds to spawn the instance on the hypervisor.
Aug 16 22:44:37 user nova-compute[72773]: DEBUG nova.compute.manager [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:44:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f9d6cbf8-92b7-4472-a347-12ce651a4087 tempest-ServerBootFromVolumeStableRescueTest-1648946443 tempest-ServerBootFromVolumeStableRescueTest-1648946443-project-member] Lock "956d334e-f190-4625-b144-ab44d2f3321a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.878s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:44:37 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-dd4e9b0e-854a-4180-a61e-c20eaebbd846 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:44:37 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-dd4e9b0e-854a-4180-a61e-c20eaebbd846 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:44:37 user nova-compute[72773]: INFO nova.compute.manager [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Took 8.33 seconds to build instance.
Aug 16 22:44:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-cb9263bb-fe7c-47d4-989c-0983effd019a tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Lock "205a7949-e2c1-40d8-8570-04d351a282d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.452s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:44:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dd4e9b0e-854a-4180-a61e-c20eaebbd846 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:44:37 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-dd4e9b0e-854a-4180-a61e-c20eaebbd846 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Deleted allocations for instance 05f47c14-f17f-43d9-b607-bccc9a0c3957
Aug 16 22:44:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dd4e9b0e-854a-4180-a61e-c20eaebbd846 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "05f47c14-f17f-43d9-b607-bccc9a0c3957" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.934s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:44:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:49 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692225874.7160218, 05f47c14-f17f-43d9-b607-bccc9a0c3957 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:44:49 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] VM Stopped (Lifecycle Event)
Aug 16 22:44:49 user nova-compute[72773]: DEBUG nova.compute.manager [None req-2e8b70ff-6a88-4ea8-bc6f-f6b44f3d2a0e None None] [instance: 05f47c14-f17f-43d9-b607-bccc9a0c3957] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:44:50 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692225875.2744284, 956d334e-f190-4625-b144-ab44d2f3321a => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:44:50 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] VM Stopped (Lifecycle Event)
Aug 16 22:44:50 user nova-compute[72773]: DEBUG nova.compute.manager [None req-60e7097a-c0a4-4208-b1c5-a063f8855092 None None] [instance: 956d334e-f190-4625-b144-ab44d2f3321a] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:44:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:44:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 22:44:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:44:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:44:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:44:56 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:45:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:00 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:45:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:02 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:45:02 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:45:02 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Rebuilding the list of instances to heal {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 22:45:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-391a6006-4fe6-4398-a1e8-ae95b5edbf2b" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:45:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-391a6006-4fe6-4398-a1e8-ae95b5edbf2b" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:45:02 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 22:45:02 user nova-compute[72773]: DEBUG nova.objects.instance [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lazy-loading 'info_cache' on Instance uuid 391a6006-4fe6-4398-a1e8-ae95b5edbf2b {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:45:03 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Updating instance_info_cache with network_info: [{"id": "6961298d-d62e-4f7b-b97e-4198a325816c", "address": "fa:16:3e:2d:58:d4", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6961298d-d6", "ovs_interfaceid": "6961298d-d62e-4f7b-b97e-4198a325816c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:45:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-391a6006-4fe6-4398-a1e8-ae95b5edbf2b" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:45:03 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 22:45:03 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:45:03 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:45:04 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:45:04 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:45:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:05 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:45:05 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:45:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:45:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:45:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:45:05 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:45:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205a7949-e2c1-40d8-8570-04d351a282d1/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:45:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205a7949-e2c1-40d8-8570-04d351a282d1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:45:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205a7949-e2c1-40d8-8570-04d351a282d1/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:45:05 user nova-compute[72773]: INFO nova.compute.manager [None req-16eb2d21-0bbb-4860-ba75-30ddf7ee7ff6 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Unrescuing
Aug 16 22:45:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-16eb2d21-0bbb-4860-ba75-30ddf7ee7ff6 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "refresh_cache-60f877e9-8032-4781-8692-88853f420a3c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:45:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-16eb2d21-0bbb-4860-ba75-30ddf7ee7ff6 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquired lock "refresh_cache-60f877e9-8032-4781-8692-88853f420a3c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:45:05 user nova-compute[72773]: DEBUG nova.network.neutron [None req-16eb2d21-0bbb-4860-ba75-30ddf7ee7ff6 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:45:05 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205a7949-e2c1-40d8-8570-04d351a282d1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:45:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:45:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:45:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:45:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:45:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:45:06 user nova-compute[72773]: DEBUG nova.network.neutron [None req-16eb2d21-0bbb-4860-ba75-30ddf7ee7ff6 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Updating instance_info_cache with network_info: [{"id": "39797b08-9184-4673-a07c-c2123736fc54", "address": "fa:16:3e:71:50:b7", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39797b08-91", "ovs_interfaceid": "39797b08-9184-4673-a07c-c2123736fc54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:45:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-16eb2d21-0bbb-4860-ba75-30ddf7ee7ff6 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Releasing lock "refresh_cache-60f877e9-8032-4781-8692-88853f420a3c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:45:06 user nova-compute[72773]: DEBUG nova.objects.instance [None req-16eb2d21-0bbb-4860-ba75-30ddf7ee7ff6 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lazy-loading 'flavor' on Instance uuid 60f877e9-8032-4781-8692-88853f420a3c {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:45:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:45:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:45:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:45:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:45:06 user nova-compute[72773]: DEBUG nova.compute.manager [req-65d945f9-f734-4450-866c-18814c920817 req-7aa4cb61-c44f-4443-8233-85d6d30ce33b service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received event network-vif-unplugged-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:45:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-65d945f9-f734-4450-866c-18814c920817 req-7aa4cb61-c44f-4443-8233-85d6d30ce33b service nova] Acquiring lock "60f877e9-8032-4781-8692-88853f420a3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:45:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-65d945f9-f734-4450-866c-18814c920817 req-7aa4cb61-c44f-4443-8233-85d6d30ce33b service nova] Lock "60f877e9-8032-4781-8692-88853f420a3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:45:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-65d945f9-f734-4450-866c-18814c920817 req-7aa4cb61-c44f-4443-8233-85d6d30ce33b service nova] Lock "60f877e9-8032-4781-8692-88853f420a3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:45:06 user nova-compute[72773]: DEBUG nova.compute.manager [req-65d945f9-f734-4450-866c-18814c920817 req-7aa4cb61-c44f-4443-8233-85d6d30ce33b service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] No waiting events found dispatching network-vif-unplugged-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:45:06 user nova-compute[72773]: WARNING nova.compute.manager [req-65d945f9-f734-4450-866c-18814c920817 req-7aa4cb61-c44f-4443-8233-85d6d30ce33b service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received unexpected event network-vif-unplugged-39797b08-9184-4673-a07c-c2123736fc54 for instance with vm_state rescued and task_state unrescuing.
Aug 16 22:45:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:45:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:45:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:45:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:45:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:07 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Instance destroyed successfully.
Aug 16 22:45:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:45:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:45:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:45:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:45:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:45:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:45:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:45:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:45:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85969e4e-3ee6-4f76-9598-960282e030af/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:45:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85969e4e-3ee6-4f76-9598-960282e030af/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:45:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85969e4e-3ee6-4f76-9598-960282e030af/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:45:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85969e4e-3ee6-4f76-9598-960282e030af/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:45:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:45:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:09 user nova-compute[72773]: DEBUG nova.compute.manager [req-4210b374-c65b-488f-9efc-8e4e29e14745 req-95cf0683-12d4-4d50-b35d-3bd66bb1177d service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received event network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:45:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4210b374-c65b-488f-9efc-8e4e29e14745 req-95cf0683-12d4-4d50-b35d-3bd66bb1177d service nova] Acquiring lock "60f877e9-8032-4781-8692-88853f420a3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:45:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4210b374-c65b-488f-9efc-8e4e29e14745 req-95cf0683-12d4-4d50-b35d-3bd66bb1177d service nova] Lock "60f877e9-8032-4781-8692-88853f420a3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:45:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4210b374-c65b-488f-9efc-8e4e29e14745 req-95cf0683-12d4-4d50-b35d-3bd66bb1177d service nova] Lock "60f877e9-8032-4781-8692-88853f420a3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:45:09 user nova-compute[72773]: DEBUG nova.compute.manager [req-4210b374-c65b-488f-9efc-8e4e29e14745 req-95cf0683-12d4-4d50-b35d-3bd66bb1177d service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] No waiting events found dispatching network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:45:09 user nova-compute[72773]: WARNING nova.compute.manager [req-4210b374-c65b-488f-9efc-8e4e29e14745 req-95cf0683-12d4-4d50-b35d-3bd66bb1177d service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received unexpected event network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 for instance with vm_state rescued and task_state unrescuing.
Aug 16 22:45:09 user nova-compute[72773]: DEBUG nova.compute.manager [req-4210b374-c65b-488f-9efc-8e4e29e14745 req-95cf0683-12d4-4d50-b35d-3bd66bb1177d service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received event network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:45:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4210b374-c65b-488f-9efc-8e4e29e14745 req-95cf0683-12d4-4d50-b35d-3bd66bb1177d service nova] Acquiring lock "60f877e9-8032-4781-8692-88853f420a3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:45:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4210b374-c65b-488f-9efc-8e4e29e14745 req-95cf0683-12d4-4d50-b35d-3bd66bb1177d service nova] Lock "60f877e9-8032-4781-8692-88853f420a3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:45:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4210b374-c65b-488f-9efc-8e4e29e14745 req-95cf0683-12d4-4d50-b35d-3bd66bb1177d service nova] Lock "60f877e9-8032-4781-8692-88853f420a3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:45:09 user nova-compute[72773]: DEBUG nova.compute.manager [req-4210b374-c65b-488f-9efc-8e4e29e14745 req-95cf0683-12d4-4d50-b35d-3bd66bb1177d service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] No waiting events found dispatching network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:45:09 user nova-compute[72773]: WARNING nova.compute.manager [req-4210b374-c65b-488f-9efc-8e4e29e14745 req-95cf0683-12d4-4d50-b35d-3bd66bb1177d service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received unexpected event network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 for instance with vm_state rescued and task_state unrescuing.
Aug 16 22:45:09 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:45:09 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:45:09 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=7925MB free_disk=25.469051361083984GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:45:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:45:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:45:09 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 391a6006-4fe6-4398-a1e8-ae95b5edbf2b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:45:09 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance cf01c401-c424-4b3e-aa5b-439d62b1ae4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:45:09 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance f4210738-d01e-4408-a15c-aeccada6dd23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:45:09 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 60f877e9-8032-4781-8692-88853f420a3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:45:09 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 85969e4e-3ee6-4f76-9598-960282e030af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:45:09 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 205a7949-e2c1-40d8-8570-04d351a282d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:45:09 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:45:09 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:45:09 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:45:09 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:45:09 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:45:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.375s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:45:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:10 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Removed pending event for 60f877e9-8032-4781-8692-88853f420a3c due to event {{(pid=72773) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 22:45:10 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225910.827124, 60f877e9-8032-4781-8692-88853f420a3c => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:45:10 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 60f877e9-8032-4781-8692-88853f420a3c] VM Resumed (Lifecycle Event)
Aug 16 22:45:10 user nova-compute[72773]: DEBUG nova.compute.manager [None req-16eb2d21-0bbb-4860-ba75-30ddf7ee7ff6 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:45:10 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:45:10 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:45:10 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 60f877e9-8032-4781-8692-88853f420a3c] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 22:45:10 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225910.8282871, 60f877e9-8032-4781-8692-88853f420a3c => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:45:10 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 60f877e9-8032-4781-8692-88853f420a3c] VM Started (Lifecycle Event)
Aug 16 22:45:10 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:45:10 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:45:11 user nova-compute[72773]: DEBUG nova.compute.manager [req-f00c2128-d4f8-4c89-801d-333dcda35e06 req-87d7fbaa-b452-440f-9d9a-5bcc69710e2f service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received event network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:45:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f00c2128-d4f8-4c89-801d-333dcda35e06 req-87d7fbaa-b452-440f-9d9a-5bcc69710e2f service nova] Acquiring lock "60f877e9-8032-4781-8692-88853f420a3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:45:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f00c2128-d4f8-4c89-801d-333dcda35e06 req-87d7fbaa-b452-440f-9d9a-5bcc69710e2f service nova] Lock "60f877e9-8032-4781-8692-88853f420a3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:45:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f00c2128-d4f8-4c89-801d-333dcda35e06 req-87d7fbaa-b452-440f-9d9a-5bcc69710e2f service nova] Lock "60f877e9-8032-4781-8692-88853f420a3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:45:11 user nova-compute[72773]: DEBUG nova.compute.manager [req-f00c2128-d4f8-4c89-801d-333dcda35e06 req-87d7fbaa-b452-440f-9d9a-5bcc69710e2f service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] No waiting events found dispatching network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:45:11 user nova-compute[72773]: WARNING nova.compute.manager [req-f00c2128-d4f8-4c89-801d-333dcda35e06 req-87d7fbaa-b452-440f-9d9a-5bcc69710e2f service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received unexpected event network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 for instance with vm_state active and task_state None.
Aug 16 22:45:11 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:45:11 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:45:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3ba1532b-c7d9-49a0-bee4-9bc3b9cd6238 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Acquiring lock "85969e4e-3ee6-4f76-9598-960282e030af" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:45:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3ba1532b-c7d9-49a0-bee4-9bc3b9cd6238 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "85969e4e-3ee6-4f76-9598-960282e030af" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:45:14 user nova-compute[72773]: INFO nova.compute.manager [None req-3ba1532b-c7d9-49a0-bee4-9bc3b9cd6238 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Detaching volume 7d084696-69ec-4028-ae2d-8587ea6fecac
Aug 16 22:45:15 user nova-compute[72773]: INFO nova.virt.block_device [None req-3ba1532b-c7d9-49a0-bee4-9bc3b9cd6238 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Attempting to driver detach volume 7d084696-69ec-4028-ae2d-8587ea6fecac from mountpoint /dev/vdb
Aug 16 22:45:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-3ba1532b-c7d9-49a0-bee4-9bc3b9cd6238 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Attempting to detach device vdb from instance 85969e4e-3ee6-4f76-9598-960282e030af from the persistent domain config. {{(pid=72773) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-3ba1532b-c7d9-49a0-bee4-9bc3b9cd6238 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:45:15 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:45:15 user nova-compute[72773]:   <source dev="/dev/sdb"/>
Aug 16 22:45:15 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:45:15 user nova-compute[72773]:   <serial>7d084696-69ec-4028-ae2d-8587ea6fecac</serial>
Aug 16 22:45:15 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:45:15 user nova-compute[72773]: </disk>
Aug 16 22:45:15 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:45:15 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-3ba1532b-c7d9-49a0-bee4-9bc3b9cd6238 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Successfully detached device vdb from instance 85969e4e-3ee6-4f76-9598-960282e030af from the persistent domain config.
Aug 16 22:45:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-3ba1532b-c7d9-49a0-bee4-9bc3b9cd6238 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 85969e4e-3ee6-4f76-9598-960282e030af from the live domain config. {{(pid=72773) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-3ba1532b-c7d9-49a0-bee4-9bc3b9cd6238 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:45:15 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:45:15 user nova-compute[72773]:   <source dev="/dev/sdb"/>
Aug 16 22:45:15 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:45:15 user nova-compute[72773]:   <serial>7d084696-69ec-4028-ae2d-8587ea6fecac</serial>
Aug 16 22:45:15 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:45:15 user nova-compute[72773]: </disk>
Aug 16 22:45:15 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Received event <DeviceRemovedEvent: 1692225915.6022956, 85969e4e-3ee6-4f76-9598-960282e030af => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72773) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-3ba1532b-c7d9-49a0-bee4-9bc3b9cd6238 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 85969e4e-3ee6-4f76-9598-960282e030af {{(pid=72773) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 22:45:15 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-3ba1532b-c7d9-49a0-bee4-9bc3b9cd6238 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Successfully detached device vdb from instance 85969e4e-3ee6-4f76-9598-960282e030af from the live domain config.
Aug 16 22:45:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ba1532b-c7d9-49a0-bee4-9bc3b9cd6238 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba1532b-c7d9-49a0-bee4-9bc3b9cd6238 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LekqjMgu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:45:15 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-3ba1532b-c7d9-49a0-bee4-9bc3b9cd6238 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:45:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-3ba1532b-c7d9-49a0-bee4-9bc3b9cd6238 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-3ba1532b-c7d9-49a0-bee4-9bc3b9cd6238 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba1532b-c7d9-49a0-bee4-9bc3b9cd6238 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e59fc1-5535-4faf-bc65-7fc76b92e0dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b9cb1c-f810-44a9-9498-86fb9187953f]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba1532b-c7d9-49a0-bee4-9bc3b9cd6238 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)
Aug 16 22:45:15 user nova-compute[72773]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac (non-flash)
Aug 16 22:45:15 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba1532b-c7d9-49a0-bee4-9bc3b9cd6238 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)
Aug 16 22:45:15 user nova-compute[72773]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac (non-flash)
Aug 16 22:45:15 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba1532b-c7d9-49a0-bee4-9bc3b9cd6238 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef5c415c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac'): ({'sdb'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-3ba1532b-c7d9-49a0-bee4-9bc3b9cd6238 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Removing single pathed devices sdb {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[cacb70c8-5567-453e-b495-fd94d05ea40b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ac6ee9-ac5b-49f8-a4cb-6b8d26777fd1]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-3ba1532b-c7d9-49a0-bee4-9bc3b9cd6238 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Flushing IO for device /dev/sdb {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e444c213-13c9-44d2-a78e-67fc9440923f]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-3ba1532b-c7d9-49a0-bee4-9bc3b9cd6238 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[30926431-29cf-4dcd-bb21-c6eb6e7f1d7b]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-3ba1532b-c7d9-49a0-bee4-9bc3b9cd6238 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-3ba1532b-c7d9-49a0-bee4-9bc3b9cd6238 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] SCSI volumes sdb have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba1532b-c7d9-49a0-bee4-9bc3b9cd6238 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5fd80b-625d-442c-851d-6537df5ef948]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba1532b-c7d9-49a0-bee4-9bc3b9cd6238 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6dacb9-6467-4157-9ac5-852ea0b188d1]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba1532b-c7d9-49a0-bee4-9bc3b9cd6238 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac, portal: 172.16.0.220,3260]
Aug 16 22:45:15 user nova-compute[72773]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac, portal: 172.16.0.220,3260] successful.
Aug 16 22:45:15 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d084696-69ec-4028-ae2d-8587ea6fecac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[76048b33-7ae7-4478-af28-6b6fad42afb4]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba1532b-c7d9-49a0-bee4-9bc3b9cd6238 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-3ba1532b-c7d9-49a0-bee4-9bc3b9cd6238 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba1532b-c7d9-49a0-bee4-9bc3b9cd6238 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] <== disconnect_volume: return (339ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:45:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ba1532b-c7d9-49a0-bee4-9bc3b9cd6238 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:45:16 user nova-compute[72773]: DEBUG nova.objects.instance [None req-3ba1532b-c7d9-49a0-bee4-9bc3b9cd6238 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lazy-loading 'flavor' on Instance uuid 85969e4e-3ee6-4f76-9598-960282e030af {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:45:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-3ba1532b-c7d9-49a0-bee4-9bc3b9cd6238 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "85969e4e-3ee6-4f76-9598-960282e030af" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.061s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:45:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:45:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:36 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "f97d8a95-e281-496b-bb62-81747a5c2ffc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:45:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:45:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:45:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:45:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:45:40 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:45:40 user nova-compute[72773]: INFO nova.compute.claims [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Claim successful on node user
Aug 16 22:45:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:40 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:45:40 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:45:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.352s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:45:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:45:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:45:40 user nova-compute[72773]: DEBUG nova.network.neutron [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:45:40 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:45:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:45:40 user nova-compute[72773]: DEBUG nova.policy [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7b76435f64e47169f3ca08aebb8e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da6170d60c4d41b14c342700a5dd83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:45:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:45:40 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:45:40 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Creating image(s)
Aug 16 22:45:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "/opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:45:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "/opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:45:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "/opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:45:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:45:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.177s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:45:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:45:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:45:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:45:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.176s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:45:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:45:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk 1073741824" returned: 0 in 0.055s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:45:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:45:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:45:41 user nova-compute[72773]: DEBUG nova.network.neutron [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Successfully created port: 3c0ffcbd-768e-4040-8765-663fa495a3ab {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:45:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.174s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:45:41 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:45:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:45:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:45:41 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Cannot resize image /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:45:41 user nova-compute[72773]: DEBUG nova.objects.instance [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lazy-loading 'migration_context' on Instance uuid f97d8a95-e281-496b-bb62-81747a5c2ffc {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:45:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:45:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Ensure instance console log exists: /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:45:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:45:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:45:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:45:42 user nova-compute[72773]: DEBUG nova.network.neutron [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Successfully updated port: 3c0ffcbd-768e-4040-8765-663fa495a3ab {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:45:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "refresh_cache-f97d8a95-e281-496b-bb62-81747a5c2ffc" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:45:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquired lock "refresh_cache-f97d8a95-e281-496b-bb62-81747a5c2ffc" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:45:42 user nova-compute[72773]: DEBUG nova.network.neutron [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:45:42 user nova-compute[72773]: DEBUG nova.compute.manager [req-64d14834-0def-4625-b6c9-0658ee2e59b7 req-d1717528-63ae-4952-a8ea-e04c87a4d31d service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Received event network-changed-3c0ffcbd-768e-4040-8765-663fa495a3ab {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:45:42 user nova-compute[72773]: DEBUG nova.compute.manager [req-64d14834-0def-4625-b6c9-0658ee2e59b7 req-d1717528-63ae-4952-a8ea-e04c87a4d31d service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Refreshing instance network info cache due to event network-changed-3c0ffcbd-768e-4040-8765-663fa495a3ab. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:45:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-64d14834-0def-4625-b6c9-0658ee2e59b7 req-d1717528-63ae-4952-a8ea-e04c87a4d31d service nova] Acquiring lock "refresh_cache-f97d8a95-e281-496b-bb62-81747a5c2ffc" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:45:42 user nova-compute[72773]: DEBUG nova.network.neutron [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG nova.network.neutron [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Updating instance_info_cache with network_info: [{"id": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "address": "fa:16:3e:12:35:93", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0ffcbd-76", "ovs_interfaceid": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Releasing lock "refresh_cache-f97d8a95-e281-496b-bb62-81747a5c2ffc" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG nova.compute.manager [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Instance network_info: |[{"id": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "address": "fa:16:3e:12:35:93", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0ffcbd-76", "ovs_interfaceid": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-64d14834-0def-4625-b6c9-0658ee2e59b7 req-d1717528-63ae-4952-a8ea-e04c87a4d31d service nova] Acquired lock "refresh_cache-f97d8a95-e281-496b-bb62-81747a5c2ffc" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG nova.network.neutron [req-64d14834-0def-4625-b6c9-0658ee2e59b7 req-d1717528-63ae-4952-a8ea-e04c87a4d31d service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Refreshing network info cache for port 3c0ffcbd-768e-4040-8765-663fa495a3ab {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Start _get_guest_xml network_info=[{"id": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "address": "fa:16:3e:12:35:93", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0ffcbd-76", "ovs_interfaceid": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:45:43 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:45:43 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:45:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-901024509',display_name='tempest-AttachVolumeTestJSON-server-901024509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-901024509',id=39,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMwC80zAC+DDm1/aQS1yIwW3iohkON4IwgRB4Qo30pRKnd56Cla0ZmEd6mFqvSws8dEJWHuZr06ofoAXldMYoVLEZx3MfxCSPNlh2DAJMCkFmy36ylUG4yyQmmfHxBPSw==',key_name='tempest-keypair-1482365818',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6da6170d60c4d41b14c342700a5dd83',ramdisk_id='',reservation_id='r-20vqu8m3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-317922803',owner_user_name='tempest-AttachVolumeTestJSON-317922803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:45:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7b76435f64e47169f3ca08aebb8e766',uuid=f97d8a95-e281-496b-bb62-81747a5c2ffc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "address": "fa:16:3e:12:35:93", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0ffcbd-76", "ovs_interfaceid": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Converting VIF {"id": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "address": "fa:16:3e:12:35:93", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0ffcbd-76", "ovs_interfaceid": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:35:93,bridge_name='br-int',has_traffic_filtering=True,id=3c0ffcbd-768e-4040-8765-663fa495a3ab,network=Network(3348a6ff-bdcc-49e3-bb0a-4839999ec213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c0ffcbd-76') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG nova.objects.instance [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lazy-loading 'pci_devices' on Instance uuid f97d8a95-e281-496b-bb62-81747a5c2ffc {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:45:43 user nova-compute[72773]:   <uuid>f97d8a95-e281-496b-bb62-81747a5c2ffc</uuid>
Aug 16 22:45:43 user nova-compute[72773]:   <name>instance-00000027</name>
Aug 16 22:45:43 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:45:43 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:45:43 user nova-compute[72773]:   <metadata>
Aug 16 22:45:43 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:45:43 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:45:43 user nova-compute[72773]:       <nova:name>tempest-AttachVolumeTestJSON-server-901024509</nova:name>
Aug 16 22:45:43 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:45:43</nova:creationTime>
Aug 16 22:45:43 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:45:43 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:45:43 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:45:43 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:45:43 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:45:43 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:45:43 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:45:43 user nova-compute[72773]:       <nova:owner>
Aug 16 22:45:43 user nova-compute[72773]:         <nova:user uuid="e7b76435f64e47169f3ca08aebb8e766">tempest-AttachVolumeTestJSON-317922803-project-member</nova:user>
Aug 16 22:45:43 user nova-compute[72773]:         <nova:project uuid="a6da6170d60c4d41b14c342700a5dd83">tempest-AttachVolumeTestJSON-317922803</nova:project>
Aug 16 22:45:43 user nova-compute[72773]:       </nova:owner>
Aug 16 22:45:43 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:45:43 user nova-compute[72773]:       <nova:ports>
Aug 16 22:45:43 user nova-compute[72773]:         <nova:port uuid="3c0ffcbd-768e-4040-8765-663fa495a3ab">
Aug 16 22:45:43 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 22:45:43 user nova-compute[72773]:         </nova:port>
Aug 16 22:45:43 user nova-compute[72773]:       </nova:ports>
Aug 16 22:45:43 user nova-compute[72773]:     </nova:instance>
Aug 16 22:45:43 user nova-compute[72773]:   </metadata>
Aug 16 22:45:43 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:45:43 user nova-compute[72773]:     <system>
Aug 16 22:45:43 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:45:43 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:45:43 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:45:43 user nova-compute[72773]:       <entry name="serial">f97d8a95-e281-496b-bb62-81747a5c2ffc</entry>
Aug 16 22:45:43 user nova-compute[72773]:       <entry name="uuid">f97d8a95-e281-496b-bb62-81747a5c2ffc</entry>
Aug 16 22:45:43 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:45:43 user nova-compute[72773]:     </system>
Aug 16 22:45:43 user nova-compute[72773]:   </sysinfo>
Aug 16 22:45:43 user nova-compute[72773]:   <os>
Aug 16 22:45:43 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:45:43 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:45:43 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:45:43 user nova-compute[72773]:   </os>
Aug 16 22:45:43 user nova-compute[72773]:   <features>
Aug 16 22:45:43 user nova-compute[72773]:     <acpi/>
Aug 16 22:45:43 user nova-compute[72773]:     <apic/>
Aug 16 22:45:43 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:45:43 user nova-compute[72773]:   </features>
Aug 16 22:45:43 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:45:43 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:45:43 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:45:43 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:45:43 user nova-compute[72773]:   </clock>
Aug 16 22:45:43 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:45:43 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:45:43 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:45:43 user nova-compute[72773]:   </cpu>
Aug 16 22:45:43 user nova-compute[72773]:   <devices>
Aug 16 22:45:43 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:45:43 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:45:43 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk"/>
Aug 16 22:45:43 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:45:43 user nova-compute[72773]:     </disk>
Aug 16 22:45:43 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:45:43 user nova-compute[72773]:       <mac address="fa:16:3e:12:35:93"/>
Aug 16 22:45:43 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:45:43 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:45:43 user nova-compute[72773]:       <target dev="tap3c0ffcbd-76"/>
Aug 16 22:45:43 user nova-compute[72773]:     </interface>
Aug 16 22:45:43 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:45:43 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/console.log" append="off"/>
Aug 16 22:45:43 user nova-compute[72773]:     </serial>
Aug 16 22:45:43 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:45:43 user nova-compute[72773]:     <video>
Aug 16 22:45:43 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:45:43 user nova-compute[72773]:     </video>
Aug 16 22:45:43 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:45:43 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:45:43 user nova-compute[72773]:     </rng>
Aug 16 22:45:43 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:45:43 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:45:43 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:45:43 user nova-compute[72773]:     </memballoon>
Aug 16 22:45:43 user nova-compute[72773]:   </devices>
Aug 16 22:45:43 user nova-compute[72773]: </domain>
Aug 16 22:45:43 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-901024509',display_name='tempest-AttachVolumeTestJSON-server-901024509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-901024509',id=39,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMwC80zAC+DDm1/aQS1yIwW3iohkON4IwgRB4Qo30pRKnd56Cla0ZmEd6mFqvSws8dEJWHuZr06ofoAXldMYoVLEZx3MfxCSPNlh2DAJMCkFmy36ylUG4yyQmmfHxBPSw==',key_name='tempest-keypair-1482365818',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6da6170d60c4d41b14c342700a5dd83',ramdisk_id='',reservation_id='r-20vqu8m3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-317922803',owner_user_name='tempest-AttachVolumeTestJSON-317922803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:45:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7b76435f64e47169f3ca08aebb8e766',uuid=f97d8a95-e281-496b-bb62-81747a5c2ffc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "address": "fa:16:3e:12:35:93", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0ffcbd-76", "ovs_interfaceid": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Converting VIF {"id": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "address": "fa:16:3e:12:35:93", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0ffcbd-76", "ovs_interfaceid": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:35:93,bridge_name='br-int',has_traffic_filtering=True,id=3c0ffcbd-768e-4040-8765-663fa495a3ab,network=Network(3348a6ff-bdcc-49e3-bb0a-4839999ec213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c0ffcbd-76') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG os_vif [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:35:93,bridge_name='br-int',has_traffic_filtering=True,id=3c0ffcbd-768e-4040-8765-663fa495a3ab,network=Network(3348a6ff-bdcc-49e3-bb0a-4839999ec213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c0ffcbd-76') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c0ffcbd-76, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3c0ffcbd-76, col_values=(('external_ids', {'iface-id': '3c0ffcbd-768e-4040-8765-663fa495a3ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:35:93', 'vm-uuid': 'f97d8a95-e281-496b-bb62-81747a5c2ffc'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:43 user nova-compute[72773]: INFO os_vif [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:35:93,bridge_name='br-int',has_traffic_filtering=True,id=3c0ffcbd-768e-4040-8765-663fa495a3ab,network=Network(3348a6ff-bdcc-49e3-bb0a-4839999ec213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c0ffcbd-76')
Aug 16 22:45:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] No VIF found with MAC fa:16:3e:12:35:93, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG nova.network.neutron [req-64d14834-0def-4625-b6c9-0658ee2e59b7 req-d1717528-63ae-4952-a8ea-e04c87a4d31d service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Updated VIF entry in instance network info cache for port 3c0ffcbd-768e-4040-8765-663fa495a3ab. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG nova.network.neutron [req-64d14834-0def-4625-b6c9-0658ee2e59b7 req-d1717528-63ae-4952-a8ea-e04c87a4d31d service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Updating instance_info_cache with network_info: [{"id": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "address": "fa:16:3e:12:35:93", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0ffcbd-76", "ovs_interfaceid": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:45:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-64d14834-0def-4625-b6c9-0658ee2e59b7 req-d1717528-63ae-4952-a8ea-e04c87a4d31d service nova] Releasing lock "refresh_cache-f97d8a95-e281-496b-bb62-81747a5c2ffc" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:45:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:44 user nova-compute[72773]: DEBUG nova.compute.manager [req-a6e8aac3-284a-4001-9c5c-ffc324d690e3 req-e4a74352-4107-45aa-8b1b-769db9f23320 service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Received event network-vif-plugged-3c0ffcbd-768e-4040-8765-663fa495a3ab {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:45:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a6e8aac3-284a-4001-9c5c-ffc324d690e3 req-e4a74352-4107-45aa-8b1b-769db9f23320 service nova] Acquiring lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:45:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a6e8aac3-284a-4001-9c5c-ffc324d690e3 req-e4a74352-4107-45aa-8b1b-769db9f23320 service nova] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:45:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a6e8aac3-284a-4001-9c5c-ffc324d690e3 req-e4a74352-4107-45aa-8b1b-769db9f23320 service nova] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:45:44 user nova-compute[72773]: DEBUG nova.compute.manager [req-a6e8aac3-284a-4001-9c5c-ffc324d690e3 req-e4a74352-4107-45aa-8b1b-769db9f23320 service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] No waiting events found dispatching network-vif-plugged-3c0ffcbd-768e-4040-8765-663fa495a3ab {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:45:44 user nova-compute[72773]: WARNING nova.compute.manager [req-a6e8aac3-284a-4001-9c5c-ffc324d690e3 req-e4a74352-4107-45aa-8b1b-769db9f23320 service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Received unexpected event network-vif-plugged-3c0ffcbd-768e-4040-8765-663fa495a3ab for instance with vm_state building and task_state spawning.
Aug 16 22:45:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:46 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225946.7043111, f97d8a95-e281-496b-bb62-81747a5c2ffc => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:45:46 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] VM Resumed (Lifecycle Event)
Aug 16 22:45:46 user nova-compute[72773]: DEBUG nova.compute.manager [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:45:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:45:46 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Instance spawned successfully.
Aug 16 22:45:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:45:46 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:45:46 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:45:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:45:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:45:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:45:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:45:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:45:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:45:46 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:45:46 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692225946.7066324, f97d8a95-e281-496b-bb62-81747a5c2ffc => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:45:46 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] VM Started (Lifecycle Event)
Aug 16 22:45:46 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:45:46 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:45:46 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:45:46 user nova-compute[72773]: INFO nova.compute.manager [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Took 6.10 seconds to spawn the instance on the hypervisor.
Aug 16 22:45:46 user nova-compute[72773]: DEBUG nova.compute.manager [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:45:46 user nova-compute[72773]: DEBUG nova.compute.manager [req-e1b9645f-c1f8-4fcd-8e16-d1b36566c2a5 req-493b9ca3-453f-4789-955c-9df0a2b8f2e8 service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Received event network-vif-plugged-3c0ffcbd-768e-4040-8765-663fa495a3ab {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:45:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e1b9645f-c1f8-4fcd-8e16-d1b36566c2a5 req-493b9ca3-453f-4789-955c-9df0a2b8f2e8 service nova] Acquiring lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:45:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e1b9645f-c1f8-4fcd-8e16-d1b36566c2a5 req-493b9ca3-453f-4789-955c-9df0a2b8f2e8 service nova] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:45:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e1b9645f-c1f8-4fcd-8e16-d1b36566c2a5 req-493b9ca3-453f-4789-955c-9df0a2b8f2e8 service nova] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:45:46 user nova-compute[72773]: DEBUG nova.compute.manager [req-e1b9645f-c1f8-4fcd-8e16-d1b36566c2a5 req-493b9ca3-453f-4789-955c-9df0a2b8f2e8 service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] No waiting events found dispatching network-vif-plugged-3c0ffcbd-768e-4040-8765-663fa495a3ab {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:45:46 user nova-compute[72773]: WARNING nova.compute.manager [req-e1b9645f-c1f8-4fcd-8e16-d1b36566c2a5 req-493b9ca3-453f-4789-955c-9df0a2b8f2e8 service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Received unexpected event network-vif-plugged-3c0ffcbd-768e-4040-8765-663fa495a3ab for instance with vm_state building and task_state spawning.
Aug 16 22:45:46 user nova-compute[72773]: INFO nova.compute.manager [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Took 6.76 seconds to build instance.
Aug 16 22:45:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ba4af4d8-4b8d-417c-b578-33165aee64f7 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.918s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:45:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:45:57 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:45:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:01 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:46:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:03 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:46:03 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:46:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-cf01c401-c424-4b3e-aa5b-439d62b1ae4c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:46:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-cf01c401-c424-4b3e-aa5b-439d62b1ae4c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:46:03 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 22:46:03 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Updating instance_info_cache with network_info: [{"id": "96243341-8834-4a23-9bf3-964374e14014", "address": "fa:16:3e:c6:b4:53", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96243341-88", "ovs_interfaceid": "96243341-8834-4a23-9bf3-964374e14014", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:46:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-cf01c401-c424-4b3e-aa5b-439d62b1ae4c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:46:04 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 22:46:04 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:46:04 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:46:04 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:46:04 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:46:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e8da3e3f-2b89-4485-81b7-1eea5e0a80b2 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Acquiring lock "85969e4e-3ee6-4f76-9598-960282e030af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:46:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e8da3e3f-2b89-4485-81b7-1eea5e0a80b2 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "85969e4e-3ee6-4f76-9598-960282e030af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:46:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e8da3e3f-2b89-4485-81b7-1eea5e0a80b2 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Acquiring lock "85969e4e-3ee6-4f76-9598-960282e030af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:46:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e8da3e3f-2b89-4485-81b7-1eea5e0a80b2 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "85969e4e-3ee6-4f76-9598-960282e030af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:46:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e8da3e3f-2b89-4485-81b7-1eea5e0a80b2 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "85969e4e-3ee6-4f76-9598-960282e030af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:46:05 user nova-compute[72773]: INFO nova.compute.manager [None req-e8da3e3f-2b89-4485-81b7-1eea5e0a80b2 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Terminating instance
Aug 16 22:46:05 user nova-compute[72773]: DEBUG nova.compute.manager [None req-e8da3e3f-2b89-4485-81b7-1eea5e0a80b2 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:46:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:05 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:46:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:05 user nova-compute[72773]: DEBUG nova.compute.manager [req-8433c7f7-e80a-4653-aaf3-a84691c1171f req-ccfcd48f-84d3-4f03-8ca4-71259dd2939b service nova] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Received event network-vif-unplugged-a032c74c-6676-4542-9419-7338d24d7648 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:46:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-8433c7f7-e80a-4653-aaf3-a84691c1171f req-ccfcd48f-84d3-4f03-8ca4-71259dd2939b service nova] Acquiring lock "85969e4e-3ee6-4f76-9598-960282e030af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:46:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-8433c7f7-e80a-4653-aaf3-a84691c1171f req-ccfcd48f-84d3-4f03-8ca4-71259dd2939b service nova] Lock "85969e4e-3ee6-4f76-9598-960282e030af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:46:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-8433c7f7-e80a-4653-aaf3-a84691c1171f req-ccfcd48f-84d3-4f03-8ca4-71259dd2939b service nova] Lock "85969e4e-3ee6-4f76-9598-960282e030af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:46:05 user nova-compute[72773]: DEBUG nova.compute.manager [req-8433c7f7-e80a-4653-aaf3-a84691c1171f req-ccfcd48f-84d3-4f03-8ca4-71259dd2939b service nova] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] No waiting events found dispatching network-vif-unplugged-a032c74c-6676-4542-9419-7338d24d7648 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:46:05 user nova-compute[72773]: DEBUG nova.compute.manager [req-8433c7f7-e80a-4653-aaf3-a84691c1171f req-ccfcd48f-84d3-4f03-8ca4-71259dd2939b service nova] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Received event network-vif-unplugged-a032c74c-6676-4542-9419-7338d24d7648 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:46:06 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Instance destroyed successfully.
Aug 16 22:46:06 user nova-compute[72773]: DEBUG nova.objects.instance [None req-e8da3e3f-2b89-4485-81b7-1eea5e0a80b2 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lazy-loading 'resources' on Instance uuid 85969e4e-3ee6-4f76-9598-960282e030af {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:46:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-e8da3e3f-2b89-4485-81b7-1eea5e0a80b2 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:41:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1269750788',display_name='tempest-TestServerVolumeAttachmentScenario-server-1269750788',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1269750788',id=37,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6X9D0XVGcAmhFA21Y5OQ72eetWcx2oEQJIvkKEwFRGZBwe+WkHDNvKRtM8hMwe1DNjIre98T3PDfrbg/q/HMNPTUd4uSP7/c0dUwsP8OaSvh2rjaqzl+HJcSgQtuw1xQ==',key_name='tempest-keypair-563107463',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:42:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2606202eee724d63a4f3596b520b8867',ramdisk_id='',reservation_id='r-x2akdsl5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-100847313',owner_user_name='tempest-TestServerVolumeAttachmentScenario-100847313-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:42:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f871d59634eb4b08a3671b860be5dbf9',uuid=85969e4e-3ee6-4f76-9598-960282e030af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a032c74c-6676-4542-9419-7338d24d7648", "address": "fa:16:3e:da:a9:c3", "network": {"id": "fbbd26d0-dfa2-4568-b941-8603e19595eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-767228890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2606202eee724d63a4f3596b520b8867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa032c74c-66", "ovs_interfaceid": "a032c74c-6676-4542-9419-7338d24d7648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:46:06 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-e8da3e3f-2b89-4485-81b7-1eea5e0a80b2 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Converting VIF {"id": "a032c74c-6676-4542-9419-7338d24d7648", "address": "fa:16:3e:da:a9:c3", "network": {"id": "fbbd26d0-dfa2-4568-b941-8603e19595eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-767228890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2606202eee724d63a4f3596b520b8867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa032c74c-66", "ovs_interfaceid": "a032c74c-6676-4542-9419-7338d24d7648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:46:06 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-e8da3e3f-2b89-4485-81b7-1eea5e0a80b2 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:a9:c3,bridge_name='br-int',has_traffic_filtering=True,id=a032c74c-6676-4542-9419-7338d24d7648,network=Network(fbbd26d0-dfa2-4568-b941-8603e19595eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa032c74c-66') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:46:06 user nova-compute[72773]: DEBUG os_vif [None req-e8da3e3f-2b89-4485-81b7-1eea5e0a80b2 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:a9:c3,bridge_name='br-int',has_traffic_filtering=True,id=a032c74c-6676-4542-9419-7338d24d7648,network=Network(fbbd26d0-dfa2-4568-b941-8603e19595eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa032c74c-66') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:46:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa032c74c-66, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:46:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:46:06 user nova-compute[72773]: INFO os_vif [None req-e8da3e3f-2b89-4485-81b7-1eea5e0a80b2 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:a9:c3,bridge_name='br-int',has_traffic_filtering=True,id=a032c74c-6676-4542-9419-7338d24d7648,network=Network(fbbd26d0-dfa2-4568-b941-8603e19595eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa032c74c-66')
Aug 16 22:46:06 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-e8da3e3f-2b89-4485-81b7-1eea5e0a80b2 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Deleting instance files /opt/stack/data/nova/instances/85969e4e-3ee6-4f76-9598-960282e030af_del
Aug 16 22:46:06 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-e8da3e3f-2b89-4485-81b7-1eea5e0a80b2 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Deletion of /opt/stack/data/nova/instances/85969e4e-3ee6-4f76-9598-960282e030af_del complete
Aug 16 22:46:06 user nova-compute[72773]: INFO nova.compute.manager [None req-e8da3e3f-2b89-4485-81b7-1eea5e0a80b2 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 16 22:46:06 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-e8da3e3f-2b89-4485-81b7-1eea5e0a80b2 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:46:06 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:46:06 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:46:06 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:46:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:46:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:46:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:46:06 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:46:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205a7949-e2c1-40d8-8570-04d351a282d1/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205a7949-e2c1-40d8-8570-04d351a282d1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205a7949-e2c1-40d8-8570-04d351a282d1/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205a7949-e2c1-40d8-8570-04d351a282d1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:07 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:46:07 user nova-compute[72773]: DEBUG nova.compute.manager [req-0eca7e78-f5c8-446a-b89e-629f0d1e074f req-8b9c214c-c2d0-402d-80fa-df74b63a4d7d service nova] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Received event network-vif-deleted-a032c74c-6676-4542-9419-7338d24d7648 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:46:07 user nova-compute[72773]: INFO nova.compute.manager [req-0eca7e78-f5c8-446a-b89e-629f0d1e074f req-8b9c214c-c2d0-402d-80fa-df74b63a4d7d service nova] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Neutron deleted interface a032c74c-6676-4542-9419-7338d24d7648; detaching it from the instance and deleting it from the info cache
Aug 16 22:46:07 user nova-compute[72773]: DEBUG nova.network.neutron [req-0eca7e78-f5c8-446a-b89e-629f0d1e074f req-8b9c214c-c2d0-402d-80fa-df74b63a4d7d service nova] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:46:07 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Took 1.27 seconds to deallocate network for instance.
Aug 16 22:46:07 user nova-compute[72773]: DEBUG nova.compute.manager [req-0eca7e78-f5c8-446a-b89e-629f0d1e074f req-8b9c214c-c2d0-402d-80fa-df74b63a4d7d service nova] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Detach interface failed, port_id=a032c74c-6676-4542-9419-7338d24d7648, reason: Instance 85969e4e-3ee6-4f76-9598-960282e030af could not be found. {{(pid=72773) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 22:46:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e8da3e3f-2b89-4485-81b7-1eea5e0a80b2 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:46:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e8da3e3f-2b89-4485-81b7-1eea5e0a80b2 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:46:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:07 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-e8da3e3f-2b89-4485-81b7-1eea5e0a80b2 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Refreshing inventories for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 22:46:07 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-e8da3e3f-2b89-4485-81b7-1eea5e0a80b2 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Updating ProviderTree inventory for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 22:46:07 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-e8da3e3f-2b89-4485-81b7-1eea5e0a80b2 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Updating inventory in ProviderTree for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 22:46:07 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-e8da3e3f-2b89-4485-81b7-1eea5e0a80b2 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Refreshing aggregate associations for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e, aggregates: None {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 22:46:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:07 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-e8da3e3f-2b89-4485-81b7-1eea5e0a80b2 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Refreshing trait associations for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 22:46:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:08 user nova-compute[72773]: DEBUG nova.compute.manager [req-d2972715-c3e1-4b2c-86bd-8d412858e645 req-e4332031-9f8c-453c-b12b-f8fbb36a02ce service nova] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Received event network-vif-plugged-a032c74c-6676-4542-9419-7338d24d7648 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:46:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d2972715-c3e1-4b2c-86bd-8d412858e645 req-e4332031-9f8c-453c-b12b-f8fbb36a02ce service nova] Acquiring lock "85969e4e-3ee6-4f76-9598-960282e030af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:46:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d2972715-c3e1-4b2c-86bd-8d412858e645 req-e4332031-9f8c-453c-b12b-f8fbb36a02ce service nova] Lock "85969e4e-3ee6-4f76-9598-960282e030af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:46:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d2972715-c3e1-4b2c-86bd-8d412858e645 req-e4332031-9f8c-453c-b12b-f8fbb36a02ce service nova] Lock "85969e4e-3ee6-4f76-9598-960282e030af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:46:08 user nova-compute[72773]: DEBUG nova.compute.manager [req-d2972715-c3e1-4b2c-86bd-8d412858e645 req-e4332031-9f8c-453c-b12b-f8fbb36a02ce service nova] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] No waiting events found dispatching network-vif-plugged-a032c74c-6676-4542-9419-7338d24d7648 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:46:08 user nova-compute[72773]: WARNING nova.compute.manager [req-d2972715-c3e1-4b2c-86bd-8d412858e645 req-e4332031-9f8c-453c-b12b-f8fbb36a02ce service nova] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Received unexpected event network-vif-plugged-a032c74c-6676-4542-9419-7338d24d7648 for instance with vm_state deleted and task_state None.
Aug 16 22:46:08 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-e8da3e3f-2b89-4485-81b7-1eea5e0a80b2 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:46:08 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-e8da3e3f-2b89-4485-81b7-1eea5e0a80b2 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:46:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e8da3e3f-2b89-4485-81b7-1eea5e0a80b2 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.673s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:46:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:08 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-e8da3e3f-2b89-4485-81b7-1eea5e0a80b2 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Deleted allocations for instance 85969e4e-3ee6-4f76-9598-960282e030af
Aug 16 22:46:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e8da3e3f-2b89-4485-81b7-1eea5e0a80b2 tempest-TestServerVolumeAttachmentScenario-100847313 tempest-TestServerVolumeAttachmentScenario-100847313-project-member] Lock "85969e4e-3ee6-4f76-9598-960282e030af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.068s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:46:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:09 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:46:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:09 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:46:09 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:46:09 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=7984MB free_disk=25.465476989746094GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:46:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:46:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:46:09 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 391a6006-4fe6-4398-a1e8-ae95b5edbf2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:46:09 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance cf01c401-c424-4b3e-aa5b-439d62b1ae4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:46:09 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance f4210738-d01e-4408-a15c-aeccada6dd23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:46:09 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 60f877e9-8032-4781-8692-88853f420a3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:46:09 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 205a7949-e2c1-40d8-8570-04d351a282d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:46:09 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance f97d8a95-e281-496b-bb62-81747a5c2ffc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:46:09 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:46:09 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:46:10 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:46:10 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:46:10 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:46:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.352s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:46:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:12 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:46:12 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:46:12 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Cleaning up deleted instances {{(pid=72773) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 22:46:12 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] There are 0 instances to clean {{(pid=72773) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 22:46:12 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:46:12 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Cleaning up deleted instances with incomplete migration  {{(pid=72773) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 22:46:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:17 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:46:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-b5550957-b7d2-4de8-b39b-70e7de9ebf5e req-6cea27e8-c806-4014-8c7b-e0dd82862873 service nova] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Received event network-changed-dd167a5e-bfa9-4376-93e4-4710d619f441 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:46:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-b5550957-b7d2-4de8-b39b-70e7de9ebf5e req-6cea27e8-c806-4014-8c7b-e0dd82862873 service nova] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Refreshing instance network info cache due to event network-changed-dd167a5e-bfa9-4376-93e4-4710d619f441. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:46:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b5550957-b7d2-4de8-b39b-70e7de9ebf5e req-6cea27e8-c806-4014-8c7b-e0dd82862873 service nova] Acquiring lock "refresh_cache-205a7949-e2c1-40d8-8570-04d351a282d1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:46:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b5550957-b7d2-4de8-b39b-70e7de9ebf5e req-6cea27e8-c806-4014-8c7b-e0dd82862873 service nova] Acquired lock "refresh_cache-205a7949-e2c1-40d8-8570-04d351a282d1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:46:20 user nova-compute[72773]: DEBUG nova.network.neutron [req-b5550957-b7d2-4de8-b39b-70e7de9ebf5e req-6cea27e8-c806-4014-8c7b-e0dd82862873 service nova] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Refreshing network info cache for port dd167a5e-bfa9-4376-93e4-4710d619f441 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:46:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:20 user nova-compute[72773]: DEBUG nova.network.neutron [req-b5550957-b7d2-4de8-b39b-70e7de9ebf5e req-6cea27e8-c806-4014-8c7b-e0dd82862873 service nova] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Updated VIF entry in instance network info cache for port dd167a5e-bfa9-4376-93e4-4710d619f441. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:46:20 user nova-compute[72773]: DEBUG nova.network.neutron [req-b5550957-b7d2-4de8-b39b-70e7de9ebf5e req-6cea27e8-c806-4014-8c7b-e0dd82862873 service nova] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Updating instance_info_cache with network_info: [{"id": "dd167a5e-bfa9-4376-93e4-4710d619f441", "address": "fa:16:3e:29:8f:37", "network": {"id": "e203d8a3-baeb-4f14-933b-3f102832c52b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1621308549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ab2d64953744b6921313f99fd21ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd167a5e-bf", "ovs_interfaceid": "dd167a5e-bfa9-4376-93e4-4710d619f441", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:46:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b5550957-b7d2-4de8-b39b-70e7de9ebf5e req-6cea27e8-c806-4014-8c7b-e0dd82862873 service nova] Releasing lock "refresh_cache-205a7949-e2c1-40d8-8570-04d351a282d1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:46:21 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692225966.0553124, 85969e4e-3ee6-4f76-9598-960282e030af => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:46:21 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] VM Stopped (Lifecycle Event)
Aug 16 22:46:21 user nova-compute[72773]: DEBUG nova.compute.manager [None req-6f86d924-79ef-4bd4-8bf2-13195e4ad434 None None] [instance: 85969e4e-3ee6-4f76-9598-960282e030af] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:46:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Acquiring lock "205a7949-e2c1-40d8-8570-04d351a282d1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:46:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Lock "205a7949-e2c1-40d8-8570-04d351a282d1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:46:24 user nova-compute[72773]: DEBUG nova.objects.instance [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Lazy-loading 'flavor' on Instance uuid 205a7949-e2c1-40d8-8570-04d351a282d1 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:46:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Lock "205a7949-e2c1-40d8-8570-04d351a282d1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:46:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Acquiring lock "205a7949-e2c1-40d8-8570-04d351a282d1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:46:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Lock "205a7949-e2c1-40d8-8570-04d351a282d1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:46:24 user nova-compute[72773]: INFO nova.compute.manager [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Attaching volume f2e35b6f-b426-48c6-9627-f3764ec0c02e to /dev/vdb
Aug 16 22:46:24 user nova-compute[72773]: DEBUG os_brick.utils [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:46:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:24 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4732713-a1ff-44fb-9261-99d639060212]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:24 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2480a3de-7f5f-40a6-9f0c-5486d8c30ee7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:24 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1c6c5c-dc4c-4792-b227-ad0134b65076]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:24 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e719ee6-cfe5-4239-b8b5-dda68ed9bbea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:46:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:46:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:46:24 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:46:24 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4e70dd-b6a9-413c-bca7-9ebff1127ca6]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:46:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:46:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:46:24 user nova-compute[72773]: DEBUG os_brick.utils [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:46:24 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Updating existing volume attachment record: c2f1810b-44e2-4a0c-934a-41128865b187 {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:46:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DNeKopcX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:46:35 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:46:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:46:35 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:46:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:46:35 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:46:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2657fb4a-583a-4981-8eaa-e30cf84d12a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:46:35 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e3ccdb-7550-41b2-ba42-dc81d5e832f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e] added
Aug 16 22:46:35 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[777f27b7-26bd-474b-8690-3324f282f11b]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4757a358-1cc6-4234-9cdd-106d857ec4f4]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DNeKopcX {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DNeKopcX" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[64da5a86-4352-46f6-8417-c5225813f79c]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DNeKopcX'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e29c75-841c-4f5b-98b2-53a0fa83a587]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1aed40-1eaf-4407-b553-f7e458ba9a4e]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)
Aug 16 22:46:35 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)
Aug 16 22:46:35 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ea5545-2c09-458c-8736-ae0195855c84]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e, portal: 172.16.0.220,3260]
Aug 16 22:46:35 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e, portal: 172.16.0.220,3260] successful.
Aug 16 22:46:35 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd389e9-92fb-4878-9ae2-3b94e624ef58]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e893422-7276-46a9-901e-b4f994946c7d]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)
Aug 16 22:46:35 user nova-compute[72773]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e (non-flash)
Aug 16 22:46:35 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)
Aug 16 22:46:35 user nova-compute[72773]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e (non-flash)
Aug 16 22:46:35 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3677d545-ced4-4583-a19c-a16d226c313d]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:35 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: None {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:46:36 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:36 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:46:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DNeKopcX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:46:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:46:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23931636138666532', 'path': '/dev/sdb'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:46:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931636138666532', 'path': '/dev/sdb'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:46:36 user nova-compute[72773]: DEBUG nova.objects.instance [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Lazy-loading 'flavor' on Instance uuid 205a7949-e2c1-40d8-8570-04d351a282d1 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:46:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 22:46:36 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:46:36 user nova-compute[72773]:   <source dev="/dev/sdb"/>
Aug 16 22:46:36 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:46:36 user nova-compute[72773]:   <serial>f2e35b6f-b426-48c6-9627-f3764ec0c02e</serial>
Aug 16 22:46:36 user nova-compute[72773]: </disk>
Aug 16 22:46:36 user nova-compute[72773]:  {{(pid=72773) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:46:37 user nova-compute[72773]: INFO nova.compute.claims [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Claim successful on node user
Aug 16 22:46:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] No VIF found with MAC fa:16:3e:29:8f:37, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.386s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1e620b31-db0f-4712-a291-72b04c0ebce1 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Lock "205a7949-e2c1-40d8-8570-04d351a282d1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.856s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:46:37 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:46:37 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:46:37 user nova-compute[72773]: INFO nova.virt.block_device [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Booting with volume a86656d3-d9ce-4fe1-80ad-025c266d87d9 at /dev/vda
Aug 16 22:46:37 user nova-compute[72773]: DEBUG os_brick.utils [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG nova.policy [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '02982f15d1a640a5bc77069a906f3e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3dc03400ff4448682ebba991a7e8af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[691f86dc-0db9-4df2-b944-b51eded7f841]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bbdc62-1991-4623-a606-112635feb7d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e415be6-1e8f-4ee4-bdf9-752ff61f5585]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2ee387-4599-4e08-8f04-212393b6e593]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:46:37 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:46:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e961784f-fd0d-4cbc-b9b9-8a851be1f05b]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG os_brick.utils [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:46:37 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Updating existing volume attachment record: 4c43ae0c-d422-49e1-a15b-4b06b2c9c7ad {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:46:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-bd8ad102-807c-463a-89ce-cf5c49fa7c5e tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Acquiring lock "205a7949-e2c1-40d8-8570-04d351a282d1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:46:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-bd8ad102-807c-463a-89ce-cf5c49fa7c5e tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Lock "205a7949-e2c1-40d8-8570-04d351a282d1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:46:38 user nova-compute[72773]: INFO nova.compute.manager [None req-bd8ad102-807c-463a-89ce-cf5c49fa7c5e tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Detaching volume f2e35b6f-b426-48c6-9627-f3764ec0c02e
Aug 16 22:46:38 user nova-compute[72773]: INFO nova.virt.block_device [None req-bd8ad102-807c-463a-89ce-cf5c49fa7c5e tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Attempting to driver detach volume f2e35b6f-b426-48c6-9627-f3764ec0c02e from mountpoint /dev/vdb
Aug 16 22:46:38 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-bd8ad102-807c-463a-89ce-cf5c49fa7c5e tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Attempting to detach device vdb from instance 205a7949-e2c1-40d8-8570-04d351a282d1 from the persistent domain config. {{(pid=72773) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 22:46:38 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-bd8ad102-807c-463a-89ce-cf5c49fa7c5e tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:46:38 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:46:38 user nova-compute[72773]:   <source dev="/dev/sdb"/>
Aug 16 22:46:38 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:46:38 user nova-compute[72773]:   <serial>f2e35b6f-b426-48c6-9627-f3764ec0c02e</serial>
Aug 16 22:46:38 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:46:38 user nova-compute[72773]: </disk>
Aug 16 22:46:38 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:46:38 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-bd8ad102-807c-463a-89ce-cf5c49fa7c5e tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Successfully detached device vdb from instance 205a7949-e2c1-40d8-8570-04d351a282d1 from the persistent domain config.
Aug 16 22:46:38 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-bd8ad102-807c-463a-89ce-cf5c49fa7c5e tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 205a7949-e2c1-40d8-8570-04d351a282d1 from the live domain config. {{(pid=72773) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 22:46:38 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-bd8ad102-807c-463a-89ce-cf5c49fa7c5e tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:46:38 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:46:38 user nova-compute[72773]:   <source dev="/dev/sdb"/>
Aug 16 22:46:38 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:46:38 user nova-compute[72773]:   <serial>f2e35b6f-b426-48c6-9627-f3764ec0c02e</serial>
Aug 16 22:46:38 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:46:38 user nova-compute[72773]: </disk>
Aug 16 22:46:38 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Received event <DeviceRemovedEvent: 1692225999.1857293, 205a7949-e2c1-40d8-8570-04d351a282d1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72773) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-bd8ad102-807c-463a-89ce-cf5c49fa7c5e tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 205a7949-e2c1-40d8-8570-04d351a282d1 {{(pid=72773) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 22:46:39 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-bd8ad102-807c-463a-89ce-cf5c49fa7c5e tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Successfully detached device vdb from instance 205a7949-e2c1-40d8-8570-04d351a282d1 from the live domain config.
Aug 16 22:46:39 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd8ad102-807c-463a-89ce-cf5c49fa7c5e tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8ad102-807c-463a-89ce-cf5c49fa7c5e tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DNeKopcX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:46:39 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-bd8ad102-807c-463a-89ce-cf5c49fa7c5e tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:46:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-bd8ad102-807c-463a-89ce-cf5c49fa7c5e tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-bd8ad102-807c-463a-89ce-cf5c49fa7c5e tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8ad102-807c-463a-89ce-cf5c49fa7c5e tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[971ba5b9-bacd-444d-b73b-3ff3b228c7d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0ff3e6-c30d-4c18-9761-6d2e22687caa]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8ad102-807c-463a-89ce-cf5c49fa7c5e tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)
Aug 16 22:46:39 user nova-compute[72773]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e (non-flash)
Aug 16 22:46:39 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8ad102-807c-463a-89ce-cf5c49fa7c5e tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)
Aug 16 22:46:39 user nova-compute[72773]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e (non-flash)
Aug 16 22:46:39 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8ad102-807c-463a-89ce-cf5c49fa7c5e tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef802baa70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e'): ({'sdb'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-bd8ad102-807c-463a-89ce-cf5c49fa7c5e tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Removing single pathed devices sdb {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[078b5573-1f20-4787-9cd3-753e234de72d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20942a2-0d01-4b90-89f9-af1eef98042b]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-bd8ad102-807c-463a-89ce-cf5c49fa7c5e tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Flushing IO for device /dev/sdb {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a3b6e8-9c7e-41ed-9993-04aaee4cc275]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-bd8ad102-807c-463a-89ce-cf5c49fa7c5e tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8716fa77-3905-45a0-9265-7ce67756b071]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-bd8ad102-807c-463a-89ce-cf5c49fa7c5e tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-bd8ad102-807c-463a-89ce-cf5c49fa7c5e tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] SCSI volumes sdb have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8ad102-807c-463a-89ce-cf5c49fa7c5e tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d099de4-8bcb-44ee-87df-423918d2374f]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8ad102-807c-463a-89ce-cf5c49fa7c5e tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[292c011e-68a8-4382-8f21-94a5b641f3b2]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8ad102-807c-463a-89ce-cf5c49fa7c5e tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e, portal: 172.16.0.220,3260]
Aug 16 22:46:39 user nova-compute[72773]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e, portal: 172.16.0.220,3260] successful.
Aug 16 22:46:39 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Successfully created port: b6c7b3aa-98f1-48d5-95e2-d1080cfde93d {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2e35b6f-b426-48c6-9627-f3764ec0c02e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba9e2fe-d1be-4309-b56e-038a1dffc852]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8ad102-807c-463a-89ce-cf5c49fa7c5e tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-bd8ad102-807c-463a-89ce-cf5c49fa7c5e tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8ad102-807c-463a-89ce-cf5c49fa7c5e tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] <== disconnect_volume: return (303ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:46:39 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd8ad102-807c-463a-89ce-cf5c49fa7c5e tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:46:40 user nova-compute[72773]: DEBUG nova.objects.instance [None req-bd8ad102-807c-463a-89ce-cf5c49fa7c5e tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Lazy-loading 'flavor' on Instance uuid 205a7949-e2c1-40d8-8570-04d351a282d1 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:46:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-bd8ad102-807c-463a-89ce-cf5c49fa7c5e tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Lock "205a7949-e2c1-40d8-8570-04d351a282d1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.690s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:46:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:41 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Successfully updated port: b6c7b3aa-98f1-48d5-95e2-d1080cfde93d {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:46:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "refresh_cache-43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:46:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquired lock "refresh_cache-43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:46:41 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:46:41 user nova-compute[72773]: DEBUG nova.compute.manager [req-3ae8323b-d57c-4e24-b5a0-c79958a47cd0 req-7e974d36-407b-49be-a22a-036ee8adde96 service nova] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Received event network-changed-b6c7b3aa-98f1-48d5-95e2-d1080cfde93d {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:46:41 user nova-compute[72773]: DEBUG nova.compute.manager [req-3ae8323b-d57c-4e24-b5a0-c79958a47cd0 req-7e974d36-407b-49be-a22a-036ee8adde96 service nova] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Refreshing instance network info cache due to event network-changed-b6c7b3aa-98f1-48d5-95e2-d1080cfde93d. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:46:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3ae8323b-d57c-4e24-b5a0-c79958a47cd0 req-7e974d36-407b-49be-a22a-036ee8adde96 service nova] Acquiring lock "refresh_cache-43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:46:41 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:41 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:46:41 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:41 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Updating instance_info_cache with network_info: [{"id": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "address": "fa:16:3e:e2:fd:fb", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c7b3aa-98", "ovs_interfaceid": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:46:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Releasing lock "refresh_cache-43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:46:41 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Instance network_info: |[{"id": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "address": "fa:16:3e:e2:fd:fb", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c7b3aa-98", "ovs_interfaceid": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:46:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3ae8323b-d57c-4e24-b5a0-c79958a47cd0 req-7e974d36-407b-49be-a22a-036ee8adde96 service nova] Acquired lock "refresh_cache-43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:46:41 user nova-compute[72773]: DEBUG nova.network.neutron [req-3ae8323b-d57c-4e24-b5a0-c79958a47cd0 req-7e974d36-407b-49be-a22a-036ee8adde96 service nova] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Refreshing network info cache for port b6c7b3aa-98f1-48d5-95e2-d1080cfde93d {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:46:42 user nova-compute[72773]: DEBUG nova.network.neutron [req-3ae8323b-d57c-4e24-b5a0-c79958a47cd0 req-7e974d36-407b-49be-a22a-036ee8adde96 service nova] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Updated VIF entry in instance network info cache for port b6c7b3aa-98f1-48d5-95e2-d1080cfde93d. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:46:42 user nova-compute[72773]: DEBUG nova.network.neutron [req-3ae8323b-d57c-4e24-b5a0-c79958a47cd0 req-7e974d36-407b-49be-a22a-036ee8adde96 service nova] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Updating instance_info_cache with network_info: [{"id": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "address": "fa:16:3e:e2:fd:fb", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c7b3aa-98", "ovs_interfaceid": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:46:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3ae8323b-d57c-4e24-b5a0-c79958a47cd0 req-7e974d36-407b-49be-a22a-036ee8adde96 service nova] Releasing lock "refresh_cache-43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:46:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:46:48 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Creating image(s)
Aug 16 22:46:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Did not create local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Ensure instance console log exists: /opt/stack/data/nova/instances/43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Start _get_guest_xml network_info=[{"id": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "address": "fa:16:3e:e2:fd:fb", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c7b3aa-98", "ovs_interfaceid": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '4c43ae0c-d422-49e1-a15b-4b06b2c9c7ad', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eYTcvEMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1', 'attached_at': '', 'detached_at': '', 'volume_id': 'a86656d3-d9ce-4fe1-80ad-025c266d87d9', 'serial': 'a86656d3-d9ce-4fe1-80ad-025c266d87d9'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:46:48 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:46:48 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:46:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eYTcvEMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:46:48 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:46:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:46:48 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:46:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:46:48 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[78701b8b-3779-4005-9847-60c229755b5a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:46:48 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce87259a-b9b4-4fc5-8ba8-55e8b110785f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9] added
Aug 16 22:46:48 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afd5ccb-392d-47cb-be04-1f1e36d82c7a]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[346b7774-aa0f-4025-beff-93b2534b1b8e]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eYTcvEMN {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eYTcvEMN" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0207169b-2240-4279-b82a-91423e46f69b]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eYTcvEMN'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a88761-1ba0-4161-87d9-dd7222bc88b1]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbef7c5a-dcb8-4f3c-a69f-ef836e9c00e4]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)
Aug 16 22:46:48 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)
Aug 16 22:46:48 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1356673-4f8a-4e9f-9a5a-e9342ce33231]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9, portal: 172.16.0.220,3260]
Aug 16 22:46:48 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9, portal: 172.16.0.220,3260] successful.
Aug 16 22:46:48 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[97296f8d-d49a-4f54-b2e5-baff597d0ce1]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb3693a-5a9f-444b-a07c-9eda6841a8c0]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)
Aug 16 22:46:48 user nova-compute[72773]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:46:48 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)
Aug 16 22:46:48 user nova-compute[72773]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:46:48 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ba74f0-2b99-45f8-828e-e2abd5c4933e]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:46:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eYTcvEMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:46:49 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:46:49 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26230323834303136', 'path': '/dev/sdb'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:46:49 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230323834303136', 'path': '/dev/sdb'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:46:49 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:46:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1934884323',display_name='tempest-ServerActionsTestOtherA-server-1934884323',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1934884323',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8jX+pTxaeDXA5y4Lt3+HYLzwoWoj7w8Q+TaAP2Om+ZW/RXrMR/7moMcaLV8Y+iO6BXYhMxPummGFIv4FNE2LpZt+HlA5XAu1WYM2d9vz6WjOr3TWc3giU1qDh4/LEA9A==',key_name='tempest-keypair-283817410',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3dc03400ff4448682ebba991a7e8af6',ramdisk_id='',reservation_id='r-p7bzcemu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1807466388',owner_user_name='tempest-ServerActionsTestOtherA-1807466388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:46:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02982f15d1a640a5bc77069a906f3e9a',uuid=43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "address": "fa:16:3e:e2:fd:fb", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c7b3aa-98", "ovs_interfaceid": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:46:49 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Converting VIF {"id": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "address": "fa:16:3e:e2:fd:fb", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c7b3aa-98", "ovs_interfaceid": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:46:49 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:fd:fb,bridge_name='br-int',has_traffic_filtering=True,id=b6c7b3aa-98f1-48d5-95e2-d1080cfde93d,network=Network(1a1a40b0-631c-4f41-9ece-17cd713adfd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6c7b3aa-98') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:46:49 user nova-compute[72773]: DEBUG nova.objects.instance [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lazy-loading 'pci_devices' on Instance uuid 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:46:50 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:46:50 user nova-compute[72773]:   <uuid>43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1</uuid>
Aug 16 22:46:50 user nova-compute[72773]:   <name>instance-00000028</name>
Aug 16 22:46:50 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:46:50 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:46:50 user nova-compute[72773]:   <metadata>
Aug 16 22:46:50 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:46:50 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:46:50 user nova-compute[72773]:       <nova:name>tempest-ServerActionsTestOtherA-server-1934884323</nova:name>
Aug 16 22:46:50 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:46:48</nova:creationTime>
Aug 16 22:46:50 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:46:50 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:46:50 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:46:50 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:46:50 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:46:50 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:46:50 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:46:50 user nova-compute[72773]:       <nova:owner>
Aug 16 22:46:50 user nova-compute[72773]:         <nova:user uuid="02982f15d1a640a5bc77069a906f3e9a">tempest-ServerActionsTestOtherA-1807466388-project-member</nova:user>
Aug 16 22:46:50 user nova-compute[72773]:         <nova:project uuid="e3dc03400ff4448682ebba991a7e8af6">tempest-ServerActionsTestOtherA-1807466388</nova:project>
Aug 16 22:46:50 user nova-compute[72773]:       </nova:owner>
Aug 16 22:46:50 user nova-compute[72773]:       <nova:ports>
Aug 16 22:46:50 user nova-compute[72773]:         <nova:port uuid="b6c7b3aa-98f1-48d5-95e2-d1080cfde93d">
Aug 16 22:46:50 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 22:46:50 user nova-compute[72773]:         </nova:port>
Aug 16 22:46:50 user nova-compute[72773]:       </nova:ports>
Aug 16 22:46:50 user nova-compute[72773]:     </nova:instance>
Aug 16 22:46:50 user nova-compute[72773]:   </metadata>
Aug 16 22:46:50 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:46:50 user nova-compute[72773]:     <system>
Aug 16 22:46:50 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:46:50 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:46:50 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:46:50 user nova-compute[72773]:       <entry name="serial">43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1</entry>
Aug 16 22:46:50 user nova-compute[72773]:       <entry name="uuid">43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1</entry>
Aug 16 22:46:50 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:46:50 user nova-compute[72773]:     </system>
Aug 16 22:46:50 user nova-compute[72773]:   </sysinfo>
Aug 16 22:46:50 user nova-compute[72773]:   <os>
Aug 16 22:46:50 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:46:50 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:46:50 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:46:50 user nova-compute[72773]:   </os>
Aug 16 22:46:50 user nova-compute[72773]:   <features>
Aug 16 22:46:50 user nova-compute[72773]:     <acpi/>
Aug 16 22:46:50 user nova-compute[72773]:     <apic/>
Aug 16 22:46:50 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:46:50 user nova-compute[72773]:   </features>
Aug 16 22:46:50 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:46:50 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:46:50 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:46:50 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:46:50 user nova-compute[72773]:   </clock>
Aug 16 22:46:50 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:46:50 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:46:50 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:46:50 user nova-compute[72773]:   </cpu>
Aug 16 22:46:50 user nova-compute[72773]:   <devices>
Aug 16 22:46:50 user nova-compute[72773]:     <disk type="block" device="disk">
Aug 16 22:46:50 user nova-compute[72773]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:46:50 user nova-compute[72773]:       <source dev="/dev/sdb"/>
Aug 16 22:46:50 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:46:50 user nova-compute[72773]:       <serial>a86656d3-d9ce-4fe1-80ad-025c266d87d9</serial>
Aug 16 22:46:50 user nova-compute[72773]:     </disk>
Aug 16 22:46:50 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:46:50 user nova-compute[72773]:       <mac address="fa:16:3e:e2:fd:fb"/>
Aug 16 22:46:50 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:46:50 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:46:50 user nova-compute[72773]:       <target dev="tapb6c7b3aa-98"/>
Aug 16 22:46:50 user nova-compute[72773]:     </interface>
Aug 16 22:46:50 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:46:50 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1/console.log" append="off"/>
Aug 16 22:46:50 user nova-compute[72773]:     </serial>
Aug 16 22:46:50 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:46:50 user nova-compute[72773]:     <video>
Aug 16 22:46:50 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:46:50 user nova-compute[72773]:     </video>
Aug 16 22:46:50 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:46:50 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:46:50 user nova-compute[72773]:     </rng>
Aug 16 22:46:50 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:46:50 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:46:50 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:46:50 user nova-compute[72773]:     </memballoon>
Aug 16 22:46:50 user nova-compute[72773]:   </devices>
Aug 16 22:46:50 user nova-compute[72773]: </domain>
Aug 16 22:46:50 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:46:50 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:46:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1934884323',display_name='tempest-ServerActionsTestOtherA-server-1934884323',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1934884323',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8jX+pTxaeDXA5y4Lt3+HYLzwoWoj7w8Q+TaAP2Om+ZW/RXrMR/7moMcaLV8Y+iO6BXYhMxPummGFIv4FNE2LpZt+HlA5XAu1WYM2d9vz6WjOr3TWc3giU1qDh4/LEA9A==',key_name='tempest-keypair-283817410',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3dc03400ff4448682ebba991a7e8af6',ramdisk_id='',reservation_id='r-p7bzcemu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1807466388',owner_user_name='tempest-ServerActionsTestOtherA-1807466388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:46:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02982f15d1a640a5bc77069a906f3e9a',uuid=43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "address": "fa:16:3e:e2:fd:fb", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c7b3aa-98", "ovs_interfaceid": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:46:50 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Converting VIF {"id": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "address": "fa:16:3e:e2:fd:fb", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c7b3aa-98", "ovs_interfaceid": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:46:50 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:fd:fb,bridge_name='br-int',has_traffic_filtering=True,id=b6c7b3aa-98f1-48d5-95e2-d1080cfde93d,network=Network(1a1a40b0-631c-4f41-9ece-17cd713adfd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6c7b3aa-98') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:46:50 user nova-compute[72773]: DEBUG os_vif [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:fd:fb,bridge_name='br-int',has_traffic_filtering=True,id=b6c7b3aa-98f1-48d5-95e2-d1080cfde93d,network=Network(1a1a40b0-631c-4f41-9ece-17cd713adfd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6c7b3aa-98') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:46:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:46:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:46:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6c7b3aa-98, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:46:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb6c7b3aa-98, col_values=(('external_ids', {'iface-id': 'b6c7b3aa-98f1-48d5-95e2-d1080cfde93d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:fd:fb', 'vm-uuid': '43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:46:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:46:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:50 user nova-compute[72773]: INFO os_vif [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:fd:fb,bridge_name='br-int',has_traffic_filtering=True,id=b6c7b3aa-98f1-48d5-95e2-d1080cfde93d,network=Network(1a1a40b0-631c-4f41-9ece-17cd713adfd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6c7b3aa-98')
Aug 16 22:46:50 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:46:50 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] No VIF found with MAC fa:16:3e:e2:fd:fb, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:46:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Acquiring lock "bc6fff46-be38-4089-a6ba-de75e0d7baab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:46:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "bc6fff46-be38-4089-a6ba-de75e0d7baab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:46:51 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:46:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:46:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:46:51 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:46:51 user nova-compute[72773]: INFO nova.compute.claims [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Claim successful on node user
Aug 16 22:46:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:51 user nova-compute[72773]: DEBUG nova.compute.manager [req-535f0f0b-622f-40a2-8567-c4dcff9678e9 req-6fd5f90c-7587-446f-b23b-af69ff7b9b03 service nova] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Received event network-vif-plugged-b6c7b3aa-98f1-48d5-95e2-d1080cfde93d {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:46:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-535f0f0b-622f-40a2-8567-c4dcff9678e9 req-6fd5f90c-7587-446f-b23b-af69ff7b9b03 service nova] Acquiring lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:46:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-535f0f0b-622f-40a2-8567-c4dcff9678e9 req-6fd5f90c-7587-446f-b23b-af69ff7b9b03 service nova] Lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:46:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-535f0f0b-622f-40a2-8567-c4dcff9678e9 req-6fd5f90c-7587-446f-b23b-af69ff7b9b03 service nova] Lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:46:51 user nova-compute[72773]: DEBUG nova.compute.manager [req-535f0f0b-622f-40a2-8567-c4dcff9678e9 req-6fd5f90c-7587-446f-b23b-af69ff7b9b03 service nova] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] No waiting events found dispatching network-vif-plugged-b6c7b3aa-98f1-48d5-95e2-d1080cfde93d {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:46:51 user nova-compute[72773]: WARNING nova.compute.manager [req-535f0f0b-622f-40a2-8567-c4dcff9678e9 req-6fd5f90c-7587-446f-b23b-af69ff7b9b03 service nova] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Received unexpected event network-vif-plugged-b6c7b3aa-98f1-48d5-95e2-d1080cfde93d for instance with vm_state building and task_state spawning.
Aug 16 22:46:51 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:46:51 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:46:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:46:51 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:46:51 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:46:51 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:46:51 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:46:51 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:46:51 user nova-compute[72773]: DEBUG nova.policy [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7a9bfc4519a64911b5613b3a96a461eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9da6df5003942baa7e7da93c0e3bc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:46:51 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:46:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:46:51 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Creating image(s)
Aug 16 22:46:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:46:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "/opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:46:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "/opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:46:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.181s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:46:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:46:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.188s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk 1073741824" returned: 0 in 0.059s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:46:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.182s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:52 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:46:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:52 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Successfully created port: 1b80812a-4fad-4669-83d7-fae725016671 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:46:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:52 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Cannot resize image /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:46:52 user nova-compute[72773]: DEBUG nova.objects.instance [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lazy-loading 'migration_context' on Instance uuid bc6fff46-be38-4089-a6ba-de75e0d7baab {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:46:52 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:46:52 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Ensure instance console log exists: /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:46:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:46:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:46:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Successfully updated port: 1b80812a-4fad-4669-83d7-fae725016671 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Acquiring lock "refresh_cache-bc6fff46-be38-4089-a6ba-de75e0d7baab" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Acquired lock "refresh_cache-bc6fff46-be38-4089-a6ba-de75e0d7baab" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.compute.manager [req-e136fee5-5b01-430e-8316-15dbd50a767a req-13eb7adf-c465-4228-88c2-ef6a42e68f28 service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Received event network-changed-1b80812a-4fad-4669-83d7-fae725016671 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.compute.manager [req-e136fee5-5b01-430e-8316-15dbd50a767a req-13eb7adf-c465-4228-88c2-ef6a42e68f28 service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Refreshing instance network info cache due to event network-changed-1b80812a-4fad-4669-83d7-fae725016671. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e136fee5-5b01-430e-8316-15dbd50a767a req-13eb7adf-c465-4228-88c2-ef6a42e68f28 service nova] Acquiring lock "refresh_cache-bc6fff46-be38-4089-a6ba-de75e0d7baab" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.compute.manager [req-519f757a-81e1-4e3f-821f-10f1ec3b435b req-06d3820c-b46d-4562-8f43-559cd5c0a682 service nova] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Received event network-vif-plugged-b6c7b3aa-98f1-48d5-95e2-d1080cfde93d {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-519f757a-81e1-4e3f-821f-10f1ec3b435b req-06d3820c-b46d-4562-8f43-559cd5c0a682 service nova] Acquiring lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-519f757a-81e1-4e3f-821f-10f1ec3b435b req-06d3820c-b46d-4562-8f43-559cd5c0a682 service nova] Lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-519f757a-81e1-4e3f-821f-10f1ec3b435b req-06d3820c-b46d-4562-8f43-559cd5c0a682 service nova] Lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.compute.manager [req-519f757a-81e1-4e3f-821f-10f1ec3b435b req-06d3820c-b46d-4562-8f43-559cd5c0a682 service nova] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] No waiting events found dispatching network-vif-plugged-b6c7b3aa-98f1-48d5-95e2-d1080cfde93d {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:46:53 user nova-compute[72773]: WARNING nova.compute.manager [req-519f757a-81e1-4e3f-821f-10f1ec3b435b req-06d3820c-b46d-4562-8f43-559cd5c0a682 service nova] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Received unexpected event network-vif-plugged-b6c7b3aa-98f1-48d5-95e2-d1080cfde93d for instance with vm_state building and task_state spawning.
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692226013.6464627, 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:46:53 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] VM Resumed (Lifecycle Event)
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:46:53 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Instance spawned successfully.
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:46:53 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692226013.6480463, 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:46:53 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] VM Started (Lifecycle Event)
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Updating instance_info_cache with network_info: [{"id": "1b80812a-4fad-4669-83d7-fae725016671", "address": "fa:16:3e:87:bb:32", "network": {"id": "f9944803-97d3-451e-ade8-b8cc953c48e3", "bridge": "br-int", "label": "tempest-TestStampPattern-997567034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9da6df5003942baa7e7da93c0e3bc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b80812a-4f", "ovs_interfaceid": "1b80812a-4fad-4669-83d7-fae725016671", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:46:53 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:46:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Releasing lock "refresh_cache-bc6fff46-be38-4089-a6ba-de75e0d7baab" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Instance network_info: |[{"id": "1b80812a-4fad-4669-83d7-fae725016671", "address": "fa:16:3e:87:bb:32", "network": {"id": "f9944803-97d3-451e-ade8-b8cc953c48e3", "bridge": "br-int", "label": "tempest-TestStampPattern-997567034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9da6df5003942baa7e7da93c0e3bc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b80812a-4f", "ovs_interfaceid": "1b80812a-4fad-4669-83d7-fae725016671", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e136fee5-5b01-430e-8316-15dbd50a767a req-13eb7adf-c465-4228-88c2-ef6a42e68f28 service nova] Acquired lock "refresh_cache-bc6fff46-be38-4089-a6ba-de75e0d7baab" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.network.neutron [req-e136fee5-5b01-430e-8316-15dbd50a767a req-13eb7adf-c465-4228-88c2-ef6a42e68f28 service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Refreshing network info cache for port 1b80812a-4fad-4669-83d7-fae725016671 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Start _get_guest_xml network_info=[{"id": "1b80812a-4fad-4669-83d7-fae725016671", "address": "fa:16:3e:87:bb:32", "network": {"id": "f9944803-97d3-451e-ade8-b8cc953c48e3", "bridge": "br-int", "label": "tempest-TestStampPattern-997567034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9da6df5003942baa7e7da93c0e3bc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b80812a-4f", "ovs_interfaceid": "1b80812a-4fad-4669-83d7-fae725016671", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:46:53 user nova-compute[72773]: INFO nova.compute.manager [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Took 5.22 seconds to spawn the instance on the hypervisor.
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:46:53 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:46:53 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:46:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-947253699',display_name='tempest-TestStampPattern-server-947253699',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-947253699',id=41,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzC0aSRz7xXngfuyAWDxc33KMp1GyfHt4lts9ifm5UwE3d17y1lNQi+MHuQTetPPkxrDXwXT5pk8rTxZLOsiBLgU5JxY5FTEUoncDvpwTM+Osg9cwYLjr/DyE/wbeHeRQ==',key_name='tempest-TestStampPattern-749194713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9da6df5003942baa7e7da93c0e3bc79',ramdisk_id='',reservation_id='r-5ljg97yr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-552569719',owner_user_name='tempest-TestStampPattern-552569719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:46:52Z,user_data=None,user_id='7a9bfc4519a64911b5613b3a96a461eb',uuid=bc6fff46-be38-4089-a6ba-de75e0d7baab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b80812a-4fad-4669-83d7-fae725016671", "address": "fa:16:3e:87:bb:32", "network": {"id": "f9944803-97d3-451e-ade8-b8cc953c48e3", "bridge": "br-int", "label": "tempest-TestStampPattern-997567034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9da6df5003942baa7e7da93c0e3bc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b80812a-4f", "ovs_interfaceid": "1b80812a-4fad-4669-83d7-fae725016671", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Converting VIF {"id": "1b80812a-4fad-4669-83d7-fae725016671", "address": "fa:16:3e:87:bb:32", "network": {"id": "f9944803-97d3-451e-ade8-b8cc953c48e3", "bridge": "br-int", "label": "tempest-TestStampPattern-997567034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9da6df5003942baa7e7da93c0e3bc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b80812a-4f", "ovs_interfaceid": "1b80812a-4fad-4669-83d7-fae725016671", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:bb:32,bridge_name='br-int',has_traffic_filtering=True,id=1b80812a-4fad-4669-83d7-fae725016671,network=Network(f9944803-97d3-451e-ade8-b8cc953c48e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b80812a-4f') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.objects.instance [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lazy-loading 'pci_devices' on Instance uuid bc6fff46-be38-4089-a6ba-de75e0d7baab {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:46:53 user nova-compute[72773]: INFO nova.compute.manager [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Took 16.74 seconds to build instance.
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:46:53 user nova-compute[72773]:   <uuid>bc6fff46-be38-4089-a6ba-de75e0d7baab</uuid>
Aug 16 22:46:53 user nova-compute[72773]:   <name>instance-00000029</name>
Aug 16 22:46:53 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:46:53 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:46:53 user nova-compute[72773]:   <metadata>
Aug 16 22:46:53 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:46:53 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:46:53 user nova-compute[72773]:       <nova:name>tempest-TestStampPattern-server-947253699</nova:name>
Aug 16 22:46:53 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:46:53</nova:creationTime>
Aug 16 22:46:53 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:46:53 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:46:53 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:46:53 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:46:53 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:46:53 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:46:53 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:46:53 user nova-compute[72773]:       <nova:owner>
Aug 16 22:46:53 user nova-compute[72773]:         <nova:user uuid="7a9bfc4519a64911b5613b3a96a461eb">tempest-TestStampPattern-552569719-project-member</nova:user>
Aug 16 22:46:53 user nova-compute[72773]:         <nova:project uuid="b9da6df5003942baa7e7da93c0e3bc79">tempest-TestStampPattern-552569719</nova:project>
Aug 16 22:46:53 user nova-compute[72773]:       </nova:owner>
Aug 16 22:46:53 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:46:53 user nova-compute[72773]:       <nova:ports>
Aug 16 22:46:53 user nova-compute[72773]:         <nova:port uuid="1b80812a-4fad-4669-83d7-fae725016671">
Aug 16 22:46:53 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 22:46:53 user nova-compute[72773]:         </nova:port>
Aug 16 22:46:53 user nova-compute[72773]:       </nova:ports>
Aug 16 22:46:53 user nova-compute[72773]:     </nova:instance>
Aug 16 22:46:53 user nova-compute[72773]:   </metadata>
Aug 16 22:46:53 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:46:53 user nova-compute[72773]:     <system>
Aug 16 22:46:53 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:46:53 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:46:53 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:46:53 user nova-compute[72773]:       <entry name="serial">bc6fff46-be38-4089-a6ba-de75e0d7baab</entry>
Aug 16 22:46:53 user nova-compute[72773]:       <entry name="uuid">bc6fff46-be38-4089-a6ba-de75e0d7baab</entry>
Aug 16 22:46:53 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:46:53 user nova-compute[72773]:     </system>
Aug 16 22:46:53 user nova-compute[72773]:   </sysinfo>
Aug 16 22:46:53 user nova-compute[72773]:   <os>
Aug 16 22:46:53 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:46:53 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:46:53 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:46:53 user nova-compute[72773]:   </os>
Aug 16 22:46:53 user nova-compute[72773]:   <features>
Aug 16 22:46:53 user nova-compute[72773]:     <acpi/>
Aug 16 22:46:53 user nova-compute[72773]:     <apic/>
Aug 16 22:46:53 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:46:53 user nova-compute[72773]:   </features>
Aug 16 22:46:53 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:46:53 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:46:53 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:46:53 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:46:53 user nova-compute[72773]:   </clock>
Aug 16 22:46:53 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:46:53 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:46:53 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:46:53 user nova-compute[72773]:   </cpu>
Aug 16 22:46:53 user nova-compute[72773]:   <devices>
Aug 16 22:46:53 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:46:53 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:46:53 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk"/>
Aug 16 22:46:53 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:46:53 user nova-compute[72773]:     </disk>
Aug 16 22:46:53 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:46:53 user nova-compute[72773]:       <mac address="fa:16:3e:87:bb:32"/>
Aug 16 22:46:53 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:46:53 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:46:53 user nova-compute[72773]:       <target dev="tap1b80812a-4f"/>
Aug 16 22:46:53 user nova-compute[72773]:     </interface>
Aug 16 22:46:53 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:46:53 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/console.log" append="off"/>
Aug 16 22:46:53 user nova-compute[72773]:     </serial>
Aug 16 22:46:53 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:46:53 user nova-compute[72773]:     <video>
Aug 16 22:46:53 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:46:53 user nova-compute[72773]:     </video>
Aug 16 22:46:53 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:46:53 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:46:53 user nova-compute[72773]:     </rng>
Aug 16 22:46:53 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:46:53 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:46:53 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:46:53 user nova-compute[72773]:     </memballoon>
Aug 16 22:46:53 user nova-compute[72773]:   </devices>
Aug 16 22:46:53 user nova-compute[72773]: </domain>
Aug 16 22:46:53 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:46:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-947253699',display_name='tempest-TestStampPattern-server-947253699',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-947253699',id=41,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzC0aSRz7xXngfuyAWDxc33KMp1GyfHt4lts9ifm5UwE3d17y1lNQi+MHuQTetPPkxrDXwXT5pk8rTxZLOsiBLgU5JxY5FTEUoncDvpwTM+Osg9cwYLjr/DyE/wbeHeRQ==',key_name='tempest-TestStampPattern-749194713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9da6df5003942baa7e7da93c0e3bc79',ramdisk_id='',reservation_id='r-5ljg97yr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-552569719',owner_user_name='tempest-TestStampPattern-552569719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:46:52Z,user_data=None,user_id='7a9bfc4519a64911b5613b3a96a461eb',uuid=bc6fff46-be38-4089-a6ba-de75e0d7baab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b80812a-4fad-4669-83d7-fae725016671", "address": "fa:16:3e:87:bb:32", "network": {"id": "f9944803-97d3-451e-ade8-b8cc953c48e3", "bridge": "br-int", "label": "tempest-TestStampPattern-997567034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9da6df5003942baa7e7da93c0e3bc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b80812a-4f", "ovs_interfaceid": "1b80812a-4fad-4669-83d7-fae725016671", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Converting VIF {"id": "1b80812a-4fad-4669-83d7-fae725016671", "address": "fa:16:3e:87:bb:32", "network": {"id": "f9944803-97d3-451e-ade8-b8cc953c48e3", "bridge": "br-int", "label": "tempest-TestStampPattern-997567034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9da6df5003942baa7e7da93c0e3bc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b80812a-4f", "ovs_interfaceid": "1b80812a-4fad-4669-83d7-fae725016671", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:bb:32,bridge_name='br-int',has_traffic_filtering=True,id=1b80812a-4fad-4669-83d7-fae725016671,network=Network(f9944803-97d3-451e-ade8-b8cc953c48e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b80812a-4f') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG os_vif [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:bb:32,bridge_name='br-int',has_traffic_filtering=True,id=1b80812a-4fad-4669-83d7-fae725016671,network=Network(f9944803-97d3-451e-ade8-b8cc953c48e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b80812a-4f') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b80812a-4f, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1b80812a-4f, col_values=(('external_ids', {'iface-id': '1b80812a-4fad-4669-83d7-fae725016671', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:bb:32', 'vm-uuid': 'bc6fff46-be38-4089-a6ba-de75e0d7baab'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a0cd0869-e896-4652-bef3-d26389b8e589 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.862s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:53 user nova-compute[72773]: INFO os_vif [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:bb:32,bridge_name='br-int',has_traffic_filtering=True,id=1b80812a-4fad-4669-83d7-fae725016671,network=Network(f9944803-97d3-451e-ade8-b8cc953c48e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b80812a-4f')
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:46:53 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] No VIF found with MAC fa:16:3e:87:bb:32, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:46:54 user nova-compute[72773]: DEBUG nova.network.neutron [req-e136fee5-5b01-430e-8316-15dbd50a767a req-13eb7adf-c465-4228-88c2-ef6a42e68f28 service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Updated VIF entry in instance network info cache for port 1b80812a-4fad-4669-83d7-fae725016671. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:46:54 user nova-compute[72773]: DEBUG nova.network.neutron [req-e136fee5-5b01-430e-8316-15dbd50a767a req-13eb7adf-c465-4228-88c2-ef6a42e68f28 service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Updating instance_info_cache with network_info: [{"id": "1b80812a-4fad-4669-83d7-fae725016671", "address": "fa:16:3e:87:bb:32", "network": {"id": "f9944803-97d3-451e-ade8-b8cc953c48e3", "bridge": "br-int", "label": "tempest-TestStampPattern-997567034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9da6df5003942baa7e7da93c0e3bc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b80812a-4f", "ovs_interfaceid": "1b80812a-4fad-4669-83d7-fae725016671", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:46:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e136fee5-5b01-430e-8316-15dbd50a767a req-13eb7adf-c465-4228-88c2-ef6a42e68f28 service nova] Releasing lock "refresh_cache-bc6fff46-be38-4089-a6ba-de75e0d7baab" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:46:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:55 user nova-compute[72773]: DEBUG nova.compute.manager [req-c9583573-74f1-4caf-9ac0-5bb94b563a12 req-d19256dc-2092-4a28-900c-1a05286ac550 service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Received event network-vif-plugged-1b80812a-4fad-4669-83d7-fae725016671 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:46:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c9583573-74f1-4caf-9ac0-5bb94b563a12 req-d19256dc-2092-4a28-900c-1a05286ac550 service nova] Acquiring lock "bc6fff46-be38-4089-a6ba-de75e0d7baab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:46:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c9583573-74f1-4caf-9ac0-5bb94b563a12 req-d19256dc-2092-4a28-900c-1a05286ac550 service nova] Lock "bc6fff46-be38-4089-a6ba-de75e0d7baab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:46:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c9583573-74f1-4caf-9ac0-5bb94b563a12 req-d19256dc-2092-4a28-900c-1a05286ac550 service nova] Lock "bc6fff46-be38-4089-a6ba-de75e0d7baab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:46:55 user nova-compute[72773]: DEBUG nova.compute.manager [req-c9583573-74f1-4caf-9ac0-5bb94b563a12 req-d19256dc-2092-4a28-900c-1a05286ac550 service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] No waiting events found dispatching network-vif-plugged-1b80812a-4fad-4669-83d7-fae725016671 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:46:55 user nova-compute[72773]: WARNING nova.compute.manager [req-c9583573-74f1-4caf-9ac0-5bb94b563a12 req-d19256dc-2092-4a28-900c-1a05286ac550 service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Received unexpected event network-vif-plugged-1b80812a-4fad-4669-83d7-fae725016671 for instance with vm_state building and task_state spawning.
Aug 16 22:46:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:57 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692226017.4172132, bc6fff46-be38-4089-a6ba-de75e0d7baab => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:46:57 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] VM Resumed (Lifecycle Event)
Aug 16 22:46:57 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:46:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:46:57 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Instance spawned successfully.
Aug 16 22:46:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:46:57 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:46:57 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:46:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:46:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:46:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:46:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:46:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:46:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:46:57 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:46:57 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692226017.4228652, bc6fff46-be38-4089-a6ba-de75e0d7baab => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:46:57 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] VM Started (Lifecycle Event)
Aug 16 22:46:57 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:46:57 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:46:57 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:46:57 user nova-compute[72773]: INFO nova.compute.manager [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Took 5.65 seconds to spawn the instance on the hypervisor.
Aug 16 22:46:57 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:46:57 user nova-compute[72773]: INFO nova.compute.manager [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Took 6.41 seconds to build instance.
Aug 16 22:46:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7503e0e0-d577-4c01-ae33-d0d70c952f1f tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "bc6fff46-be38-4089-a6ba-de75e0d7baab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.583s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:46:57 user nova-compute[72773]: DEBUG nova.compute.manager [req-bedad8b4-f818-4934-809f-4e62d61ee092 req-97e9d0a3-e213-4d08-a5bd-fb4940f5cbad service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Received event network-vif-plugged-1b80812a-4fad-4669-83d7-fae725016671 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:46:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-bedad8b4-f818-4934-809f-4e62d61ee092 req-97e9d0a3-e213-4d08-a5bd-fb4940f5cbad service nova] Acquiring lock "bc6fff46-be38-4089-a6ba-de75e0d7baab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:46:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-bedad8b4-f818-4934-809f-4e62d61ee092 req-97e9d0a3-e213-4d08-a5bd-fb4940f5cbad service nova] Lock "bc6fff46-be38-4089-a6ba-de75e0d7baab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:46:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-bedad8b4-f818-4934-809f-4e62d61ee092 req-97e9d0a3-e213-4d08-a5bd-fb4940f5cbad service nova] Lock "bc6fff46-be38-4089-a6ba-de75e0d7baab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:46:57 user nova-compute[72773]: DEBUG nova.compute.manager [req-bedad8b4-f818-4934-809f-4e62d61ee092 req-97e9d0a3-e213-4d08-a5bd-fb4940f5cbad service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] No waiting events found dispatching network-vif-plugged-1b80812a-4fad-4669-83d7-fae725016671 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:46:57 user nova-compute[72773]: WARNING nova.compute.manager [req-bedad8b4-f818-4934-809f-4e62d61ee092 req-97e9d0a3-e213-4d08-a5bd-fb4940f5cbad service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Received unexpected event network-vif-plugged-1b80812a-4fad-4669-83d7-fae725016671 for instance with vm_state active and task_state None.
Aug 16 22:46:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-6237bd6d-f934-40a4-9d6b-eac431636093 req-434e91af-a919-423b-b15e-7d2e50fdbc86 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received event network-changed-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:46:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-6237bd6d-f934-40a4-9d6b-eac431636093 req-434e91af-a919-423b-b15e-7d2e50fdbc86 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Refreshing instance network info cache due to event network-changed-39797b08-9184-4673-a07c-c2123736fc54. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:46:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6237bd6d-f934-40a4-9d6b-eac431636093 req-434e91af-a919-423b-b15e-7d2e50fdbc86 service nova] Acquiring lock "refresh_cache-60f877e9-8032-4781-8692-88853f420a3c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:46:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6237bd6d-f934-40a4-9d6b-eac431636093 req-434e91af-a919-423b-b15e-7d2e50fdbc86 service nova] Acquired lock "refresh_cache-60f877e9-8032-4781-8692-88853f420a3c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:46:58 user nova-compute[72773]: DEBUG nova.network.neutron [req-6237bd6d-f934-40a4-9d6b-eac431636093 req-434e91af-a919-423b-b15e-7d2e50fdbc86 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Refreshing network info cache for port 39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:46:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:46:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e0ccfb83-69b2-4897-8453-b32c125e77d9 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "60f877e9-8032-4781-8692-88853f420a3c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:46:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e0ccfb83-69b2-4897-8453-b32c125e77d9 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "60f877e9-8032-4781-8692-88853f420a3c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:46:59 user nova-compute[72773]: INFO nova.compute.manager [None req-e0ccfb83-69b2-4897-8453-b32c125e77d9 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Detaching volume f7fded2d-3c3a-4184-9aba-0a3f80e01531
Aug 16 22:46:59 user nova-compute[72773]: DEBUG nova.network.neutron [req-6237bd6d-f934-40a4-9d6b-eac431636093 req-434e91af-a919-423b-b15e-7d2e50fdbc86 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Updated VIF entry in instance network info cache for port 39797b08-9184-4673-a07c-c2123736fc54. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:46:59 user nova-compute[72773]: DEBUG nova.network.neutron [req-6237bd6d-f934-40a4-9d6b-eac431636093 req-434e91af-a919-423b-b15e-7d2e50fdbc86 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Updating instance_info_cache with network_info: [{"id": "39797b08-9184-4673-a07c-c2123736fc54", "address": "fa:16:3e:71:50:b7", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39797b08-91", "ovs_interfaceid": "39797b08-9184-4673-a07c-c2123736fc54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:46:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6237bd6d-f934-40a4-9d6b-eac431636093 req-434e91af-a919-423b-b15e-7d2e50fdbc86 service nova] Releasing lock "refresh_cache-60f877e9-8032-4781-8692-88853f420a3c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:46:59 user nova-compute[72773]: INFO nova.virt.block_device [None req-e0ccfb83-69b2-4897-8453-b32c125e77d9 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Attempting to driver detach volume f7fded2d-3c3a-4184-9aba-0a3f80e01531 from mountpoint /dev/vdb
Aug 16 22:46:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e0ccfb83-69b2-4897-8453-b32c125e77d9 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Attempting to detach device vdb from instance 60f877e9-8032-4781-8692-88853f420a3c from the persistent domain config. {{(pid=72773) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 22:46:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-e0ccfb83-69b2-4897-8453-b32c125e77d9 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:46:59 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:46:59 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 22:46:59 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:46:59 user nova-compute[72773]:   <serial>f7fded2d-3c3a-4184-9aba-0a3f80e01531</serial>
Aug 16 22:46:59 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:46:59 user nova-compute[72773]: </disk>
Aug 16 22:46:59 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:46:59 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:46:59 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-e0ccfb83-69b2-4897-8453-b32c125e77d9 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Successfully detached device vdb from instance 60f877e9-8032-4781-8692-88853f420a3c from the persistent domain config.
Aug 16 22:46:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e0ccfb83-69b2-4897-8453-b32c125e77d9 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 60f877e9-8032-4781-8692-88853f420a3c from the live domain config. {{(pid=72773) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 22:46:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-e0ccfb83-69b2-4897-8453-b32c125e77d9 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:46:59 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:46:59 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 22:46:59 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:46:59 user nova-compute[72773]:   <serial>f7fded2d-3c3a-4184-9aba-0a3f80e01531</serial>
Aug 16 22:46:59 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:46:59 user nova-compute[72773]: </disk>
Aug 16 22:46:59 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:46:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Received event <DeviceRemovedEvent: 1692226019.8865561, 60f877e9-8032-4781-8692-88853f420a3c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72773) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 22:46:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e0ccfb83-69b2-4897-8453-b32c125e77d9 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 60f877e9-8032-4781-8692-88853f420a3c {{(pid=72773) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 22:46:59 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-e0ccfb83-69b2-4897-8453-b32c125e77d9 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Successfully detached device vdb from instance 60f877e9-8032-4781-8692-88853f420a3c from the live domain config.
Aug 16 22:46:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0ccfb83-69b2-4897-8453-b32c125e77d9 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:46:59 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ccfb83-69b2-4897-8453-b32c125e77d9 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FoInbRuW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:46:59 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-e0ccfb83-69b2-4897-8453-b32c125e77d9 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:46:59 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-e0ccfb83-69b2-4897-8453-b32c125e77d9 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:46:59 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-e0ccfb83-69b2-4897-8453-b32c125e77d9 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:46:59 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ccfb83-69b2-4897-8453-b32c125e77d9 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:46:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:59 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee73f0bb-b6d0-4352-b3ad-197d36d0314b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:59 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5536c81-37f1-4a1a-848f-c0ff56c003b3]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:59 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ccfb83-69b2-4897-8453-b32c125e77d9 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)
Aug 16 22:46:59 user nova-compute[72773]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:46:59 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:46:59 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ccfb83-69b2-4897-8453-b32c125e77d9 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 (non-flash)
Aug 16 22:46:59 user nova-compute[72773]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:46:59 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:46:59 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ccfb83-69b2-4897-8453-b32c125e77d9 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef5c24f1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531'): ({'sdc'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:46:59 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-e0ccfb83-69b2-4897-8453-b32c125e77d9 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Removing single pathed devices sdc {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:46:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:46:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:46:59 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[194cf7c2-d25c-4b70-880e-157d72ced949]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:46:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:00 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d3a49d-70ce-44fb-ae0d-4fd8af0f255d]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:47:00 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-e0ccfb83-69b2-4897-8453-b32c125e77d9 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Flushing IO for device /dev/sdc {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:47:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:00 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[172a4ac5-cbda-4806-9fe7-d93ace071e24]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:47:00 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-e0ccfb83-69b2-4897-8453-b32c125e77d9 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:47:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:00 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f06910-e569-4032-891f-fedc051c3ab0]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:47:00 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-e0ccfb83-69b2-4897-8453-b32c125e77d9 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:47:00 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-e0ccfb83-69b2-4897-8453-b32c125e77d9 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:47:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ccfb83-69b2-4897-8453-b32c125e77d9 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:47:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:00 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff2c8d7-53d5-43fe-a68f-6e2227af3be9]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:47:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ccfb83-69b2-4897-8453-b32c125e77d9 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:47:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:00 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4280b0-ac10-4d5e-813f-d8202d98f2d9]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:47:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ccfb83-69b2-4897-8453-b32c125e77d9 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531, portal: 172.16.0.220,3260]
Aug 16 22:47:00 user nova-compute[72773]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531, portal: 172.16.0.220,3260] successful.
Aug 16 22:47:00 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:47:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7fded2d-3c3a-4184-9aba-0a3f80e01531 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:00 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5833bc-18ae-48ec-9c2e-822d24ff194a]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:47:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ccfb83-69b2-4897-8453-b32c125e77d9 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:47:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-e0ccfb83-69b2-4897-8453-b32c125e77d9 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:47:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ccfb83-69b2-4897-8453-b32c125e77d9 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] <== disconnect_volume: return (290ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:47:00 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0ccfb83-69b2-4897-8453-b32c125e77d9 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:47:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:00 user nova-compute[72773]: DEBUG nova.compute.manager [req-0fb43779-3dc3-43f1-aa53-c1e89b9ddeb5 req-a905e214-adb4-4d6b-83a5-1de356ab6cba service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received event network-changed-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:47:00 user nova-compute[72773]: DEBUG nova.compute.manager [req-0fb43779-3dc3-43f1-aa53-c1e89b9ddeb5 req-a905e214-adb4-4d6b-83a5-1de356ab6cba service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Refreshing instance network info cache due to event network-changed-39797b08-9184-4673-a07c-c2123736fc54. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:47:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0fb43779-3dc3-43f1-aa53-c1e89b9ddeb5 req-a905e214-adb4-4d6b-83a5-1de356ab6cba service nova] Acquiring lock "refresh_cache-60f877e9-8032-4781-8692-88853f420a3c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:47:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0fb43779-3dc3-43f1-aa53-c1e89b9ddeb5 req-a905e214-adb4-4d6b-83a5-1de356ab6cba service nova] Acquired lock "refresh_cache-60f877e9-8032-4781-8692-88853f420a3c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:47:00 user nova-compute[72773]: DEBUG nova.network.neutron [req-0fb43779-3dc3-43f1-aa53-c1e89b9ddeb5 req-a905e214-adb4-4d6b-83a5-1de356ab6cba service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Refreshing network info cache for port 39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:47:00 user nova-compute[72773]: DEBUG nova.objects.instance [None req-e0ccfb83-69b2-4897-8453-b32c125e77d9 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lazy-loading 'flavor' on Instance uuid 60f877e9-8032-4781-8692-88853f420a3c {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:47:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e0ccfb83-69b2-4897-8453-b32c125e77d9 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "60f877e9-8032-4781-8692-88853f420a3c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.736s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:47:01 user nova-compute[72773]: DEBUG nova.network.neutron [req-0fb43779-3dc3-43f1-aa53-c1e89b9ddeb5 req-a905e214-adb4-4d6b-83a5-1de356ab6cba service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Updated VIF entry in instance network info cache for port 39797b08-9184-4673-a07c-c2123736fc54. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:47:01 user nova-compute[72773]: DEBUG nova.network.neutron [req-0fb43779-3dc3-43f1-aa53-c1e89b9ddeb5 req-a905e214-adb4-4d6b-83a5-1de356ab6cba service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Updating instance_info_cache with network_info: [{"id": "39797b08-9184-4673-a07c-c2123736fc54", "address": "fa:16:3e:71:50:b7", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39797b08-91", "ovs_interfaceid": "39797b08-9184-4673-a07c-c2123736fc54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:47:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0fb43779-3dc3-43f1-aa53-c1e89b9ddeb5 req-a905e214-adb4-4d6b-83a5-1de356ab6cba service nova] Releasing lock "refresh_cache-60f877e9-8032-4781-8692-88853f420a3c" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:47:02 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:47:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:04 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:47:04 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:47:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-f4210738-d01e-4408-a15c-aeccada6dd23" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:47:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-f4210738-d01e-4408-a15c-aeccada6dd23" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:47:04 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 22:47:05 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Updating instance_info_cache with network_info: [{"id": "bb573e79-a106-40c5-8c53-ab73eb6ba240", "address": "fa:16:3e:1e:80:9b", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb573e79-a1", "ovs_interfaceid": "bb573e79-a106-40c5-8c53-ab73eb6ba240", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:47:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-f4210738-d01e-4408-a15c-aeccada6dd23" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:47:05 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 22:47:05 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:47:05 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:47:05 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:47:06 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:47:06 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:47:08 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:47:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:47:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:47:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:47:08 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:47:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205a7949-e2c1-40d8-8570-04d351a282d1/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205a7949-e2c1-40d8-8570-04d351a282d1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205a7949-e2c1-40d8-8570-04d351a282d1/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:47:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205a7949-e2c1-40d8-8570-04d351a282d1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:09 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:47:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:12 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:47:12 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:47:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=7726MB free_disk=25.45046615600586GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:47:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:47:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:47:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 391a6006-4fe6-4398-a1e8-ae95b5edbf2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:47:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance cf01c401-c424-4b3e-aa5b-439d62b1ae4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:47:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance f4210738-d01e-4408-a15c-aeccada6dd23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:47:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 60f877e9-8032-4781-8692-88853f420a3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:47:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 205a7949-e2c1-40d8-8570-04d351a282d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:47:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance f97d8a95-e281-496b-bb62-81747a5c2ffc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:47:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:47:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance bc6fff46-be38-4089-a6ba-de75e0d7baab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:47:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:47:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:47:12 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:47:12 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:47:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:47:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.398s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:47:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:15 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:47:15 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:47:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:31 user nova-compute[72773]: DEBUG nova.compute.manager [req-3b731ec0-bd03-41af-8c64-d97ac1faaa85 req-28fdd049-68bb-4dc3-8b3f-23896ecc9ead service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Received event network-changed-3c0ffcbd-768e-4040-8765-663fa495a3ab {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:47:31 user nova-compute[72773]: DEBUG nova.compute.manager [req-3b731ec0-bd03-41af-8c64-d97ac1faaa85 req-28fdd049-68bb-4dc3-8b3f-23896ecc9ead service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Refreshing instance network info cache due to event network-changed-3c0ffcbd-768e-4040-8765-663fa495a3ab. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:47:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3b731ec0-bd03-41af-8c64-d97ac1faaa85 req-28fdd049-68bb-4dc3-8b3f-23896ecc9ead service nova] Acquiring lock "refresh_cache-f97d8a95-e281-496b-bb62-81747a5c2ffc" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:47:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3b731ec0-bd03-41af-8c64-d97ac1faaa85 req-28fdd049-68bb-4dc3-8b3f-23896ecc9ead service nova] Acquired lock "refresh_cache-f97d8a95-e281-496b-bb62-81747a5c2ffc" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:47:31 user nova-compute[72773]: DEBUG nova.network.neutron [req-3b731ec0-bd03-41af-8c64-d97ac1faaa85 req-28fdd049-68bb-4dc3-8b3f-23896ecc9ead service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Refreshing network info cache for port 3c0ffcbd-768e-4040-8765-663fa495a3ab {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:47:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:31 user nova-compute[72773]: DEBUG nova.network.neutron [req-3b731ec0-bd03-41af-8c64-d97ac1faaa85 req-28fdd049-68bb-4dc3-8b3f-23896ecc9ead service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Updated VIF entry in instance network info cache for port 3c0ffcbd-768e-4040-8765-663fa495a3ab. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:47:31 user nova-compute[72773]: DEBUG nova.network.neutron [req-3b731ec0-bd03-41af-8c64-d97ac1faaa85 req-28fdd049-68bb-4dc3-8b3f-23896ecc9ead service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Updating instance_info_cache with network_info: [{"id": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "address": "fa:16:3e:12:35:93", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0ffcbd-76", "ovs_interfaceid": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:47:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3b731ec0-bd03-41af-8c64-d97ac1faaa85 req-28fdd049-68bb-4dc3-8b3f-23896ecc9ead service nova] Releasing lock "refresh_cache-f97d8a95-e281-496b-bb62-81747a5c2ffc" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:47:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "f97d8a95-e281-496b-bb62-81747a5c2ffc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG nova.objects.instance [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lazy-loading 'flavor' on Instance uuid f97d8a95-e281-496b-bb62-81747a5c2ffc {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "f97d8a95-e281-496b-bb62-81747a5c2ffc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:47:35 user nova-compute[72773]: INFO nova.compute.manager [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Attaching volume 3510e728-af0a-49bf-8a0d-c07fc7fea601 to /dev/vdb
Aug 16 22:47:35 user nova-compute[72773]: DEBUG os_brick.utils [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc908ffd-0843-475f-af5b-ee8a66cebbab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[64dc5a10-ba39-44c9-8194-197bdcfbe3cb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df26471-455b-469d-9485-ca772262bd2f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3789ceb-38c4-42f7-9919-11847be19272]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dced211a-8079-414a-a4c4-992c918e1a65 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Acquiring lock "205a7949-e2c1-40d8-8570-04d351a282d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dced211a-8079-414a-a4c4-992c918e1a65 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Lock "205a7949-e2c1-40d8-8570-04d351a282d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dced211a-8079-414a-a4c4-992c918e1a65 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Acquiring lock "205a7949-e2c1-40d8-8570-04d351a282d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dced211a-8079-414a-a4c4-992c918e1a65 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Lock "205a7949-e2c1-40d8-8570-04d351a282d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dced211a-8079-414a-a4c4-992c918e1a65 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Lock "205a7949-e2c1-40d8-8570-04d351a282d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:35 user nova-compute[72773]: INFO nova.compute.manager [None req-dced211a-8079-414a-a4c4-992c918e1a65 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Terminating instance
Aug 16 22:47:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:47:35 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:47:35 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee49697-0412-4e38-a732-3a04cede0b7c]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG nova.compute.manager [None req-dced211a-8079-414a-a4c4-992c918e1a65 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG os_brick.utils [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Updating existing volume attachment record: 38424192-fbf7-4992-8bce-db18e8372d45 {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:36 user nova-compute[72773]: DEBUG nova.compute.manager [req-9448665e-eb14-4542-9e2f-b2dde6a0ade4 req-27d70f30-e28e-4a48-8c5f-be0eb62ab60c service nova] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Received event network-vif-unplugged-dd167a5e-bfa9-4376-93e4-4710d619f441 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:47:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9448665e-eb14-4542-9e2f-b2dde6a0ade4 req-27d70f30-e28e-4a48-8c5f-be0eb62ab60c service nova] Acquiring lock "205a7949-e2c1-40d8-8570-04d351a282d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:47:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9448665e-eb14-4542-9e2f-b2dde6a0ade4 req-27d70f30-e28e-4a48-8c5f-be0eb62ab60c service nova] Lock "205a7949-e2c1-40d8-8570-04d351a282d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:47:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9448665e-eb14-4542-9e2f-b2dde6a0ade4 req-27d70f30-e28e-4a48-8c5f-be0eb62ab60c service nova] Lock "205a7949-e2c1-40d8-8570-04d351a282d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:47:36 user nova-compute[72773]: DEBUG nova.compute.manager [req-9448665e-eb14-4542-9e2f-b2dde6a0ade4 req-27d70f30-e28e-4a48-8c5f-be0eb62ab60c service nova] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] No waiting events found dispatching network-vif-unplugged-dd167a5e-bfa9-4376-93e4-4710d619f441 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:47:36 user nova-compute[72773]: DEBUG nova.compute.manager [req-9448665e-eb14-4542-9e2f-b2dde6a0ade4 req-27d70f30-e28e-4a48-8c5f-be0eb62ab60c service nova] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Received event network-vif-unplugged-dd167a5e-bfa9-4376-93e4-4710d619f441 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:47:36 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Instance destroyed successfully.
Aug 16 22:47:36 user nova-compute[72773]: DEBUG nova.objects.instance [None req-dced211a-8079-414a-a4c4-992c918e1a65 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Lazy-loading 'resources' on Instance uuid 205a7949-e2c1-40d8-8570-04d351a282d1 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:47:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-dced211a-8079-414a-a4c4-992c918e1a65 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:44:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-582533255',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-582533255',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-5825332',id=38,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIES1mqzY3Sql7tHXGImFIRVq3MCQb+FQxRSY0sJxqtIa11fP3aAPJV2U5a6jykLnXWxoW4xeNGRedZbrQK7VKjxnC8XQevwzomRJ1D2+jDqpn3TFGEiMSvHgwG1+ZFaCw==',key_name='tempest-keypair-1885943282',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:44:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51ab2d64953744b6921313f99fd21ae4',ramdisk_id='',reservation_id='r-fy7jb0u2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-148899249',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:44:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='324a8eec167548e7b35985a728cb9fd6',uuid=205a7949-e2c1-40d8-8570-04d351a282d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd167a5e-bfa9-4376-93e4-4710d619f441", "address": "fa:16:3e:29:8f:37", "network": {"id": "e203d8a3-baeb-4f14-933b-3f102832c52b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1621308549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ab2d64953744b6921313f99fd21ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd167a5e-bf", "ovs_interfaceid": "dd167a5e-bfa9-4376-93e4-4710d619f441", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:47:36 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-dced211a-8079-414a-a4c4-992c918e1a65 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Converting VIF {"id": "dd167a5e-bfa9-4376-93e4-4710d619f441", "address": "fa:16:3e:29:8f:37", "network": {"id": "e203d8a3-baeb-4f14-933b-3f102832c52b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1621308549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ab2d64953744b6921313f99fd21ae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd167a5e-bf", "ovs_interfaceid": "dd167a5e-bfa9-4376-93e4-4710d619f441", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:47:36 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-dced211a-8079-414a-a4c4-992c918e1a65 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:8f:37,bridge_name='br-int',has_traffic_filtering=True,id=dd167a5e-bfa9-4376-93e4-4710d619f441,network=Network(e203d8a3-baeb-4f14-933b-3f102832c52b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd167a5e-bf') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:47:36 user nova-compute[72773]: DEBUG os_vif [None req-dced211a-8079-414a-a4c4-992c918e1a65 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:8f:37,bridge_name='br-int',has_traffic_filtering=True,id=dd167a5e-bfa9-4376-93e4-4710d619f441,network=Network(e203d8a3-baeb-4f14-933b-3f102832c52b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd167a5e-bf') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:47:36 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:36 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd167a5e-bf, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:47:36 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:36 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:47:36 user nova-compute[72773]: INFO os_vif [None req-dced211a-8079-414a-a4c4-992c918e1a65 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:8f:37,bridge_name='br-int',has_traffic_filtering=True,id=dd167a5e-bfa9-4376-93e4-4710d619f441,network=Network(e203d8a3-baeb-4f14-933b-3f102832c52b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd167a5e-bf')
Aug 16 22:47:36 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-dced211a-8079-414a-a4c4-992c918e1a65 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Deleting instance files /opt/stack/data/nova/instances/205a7949-e2c1-40d8-8570-04d351a282d1_del
Aug 16 22:47:36 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-dced211a-8079-414a-a4c4-992c918e1a65 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Deletion of /opt/stack/data/nova/instances/205a7949-e2c1-40d8-8570-04d351a282d1_del complete
Aug 16 22:47:36 user nova-compute[72773]: INFO nova.compute.manager [None req-dced211a-8079-414a-a4c4-992c918e1a65 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 16 22:47:36 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-dced211a-8079-414a-a4c4-992c918e1a65 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:47:36 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:47:36 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:47:37 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:47:37 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Took 1.17 seconds to deallocate network for instance.
Aug 16 22:47:37 user nova-compute[72773]: DEBUG nova.compute.manager [req-b4fb90dc-19a4-4e07-a6db-615081ec46cf req-d8c7faba-132e-4e4e-bc14-dd97ea26983f service nova] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Received event network-vif-deleted-dd167a5e-bfa9-4376-93e4-4710d619f441 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:47:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dced211a-8079-414a-a4c4-992c918e1a65 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:47:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dced211a-8079-414a-a4c4-992c918e1a65 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:47:38 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-dced211a-8079-414a-a4c4-992c918e1a65 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:47:38 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-dced211a-8079-414a-a4c4-992c918e1a65 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:47:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dced211a-8079-414a-a4c4-992c918e1a65 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:47:38 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-dced211a-8079-414a-a4c4-992c918e1a65 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Deleted allocations for instance 205a7949-e2c1-40d8-8570-04d351a282d1
Aug 16 22:47:38 user nova-compute[72773]: DEBUG nova.compute.manager [req-bb69f142-f576-4515-98df-1999a07757c0 req-77b6219d-4a08-49c8-a685-b16a303cb19f service nova] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Received event network-vif-plugged-dd167a5e-bfa9-4376-93e4-4710d619f441 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:47:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-bb69f142-f576-4515-98df-1999a07757c0 req-77b6219d-4a08-49c8-a685-b16a303cb19f service nova] Acquiring lock "205a7949-e2c1-40d8-8570-04d351a282d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:47:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-bb69f142-f576-4515-98df-1999a07757c0 req-77b6219d-4a08-49c8-a685-b16a303cb19f service nova] Lock "205a7949-e2c1-40d8-8570-04d351a282d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:47:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-bb69f142-f576-4515-98df-1999a07757c0 req-77b6219d-4a08-49c8-a685-b16a303cb19f service nova] Lock "205a7949-e2c1-40d8-8570-04d351a282d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:47:38 user nova-compute[72773]: DEBUG nova.compute.manager [req-bb69f142-f576-4515-98df-1999a07757c0 req-77b6219d-4a08-49c8-a685-b16a303cb19f service nova] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] No waiting events found dispatching network-vif-plugged-dd167a5e-bfa9-4376-93e4-4710d619f441 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:47:38 user nova-compute[72773]: WARNING nova.compute.manager [req-bb69f142-f576-4515-98df-1999a07757c0 req-77b6219d-4a08-49c8-a685-b16a303cb19f service nova] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Received unexpected event network-vif-plugged-dd167a5e-bfa9-4376-93e4-4710d619f441 for instance with vm_state deleted and task_state None.
Aug 16 22:47:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-dced211a-8079-414a-a4c4-992c918e1a65 tempest-TestServerVolumeAttachScenarioOldVersion-148899249 tempest-TestServerVolumeAttachScenarioOldVersion-148899249-project-member] Lock "205a7949-e2c1-40d8-8570-04d351a282d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.570s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:47:39 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Acquiring lock "29c612f4-5ed1-46db-bdec-0eed58384746" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:47:39 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "29c612f4-5ed1-46db-bdec-0eed58384746" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:47:39 user nova-compute[72773]: DEBUG nova.compute.manager [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:47:39 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:47:39 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:47:39 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:47:39 user nova-compute[72773]: INFO nova.compute.claims [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Claim successful on node user
Aug 16 22:47:39 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:47:39 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:47:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.372s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:47:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:47:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:47:40 user nova-compute[72773]: DEBUG nova.network.neutron [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:47:40 user nova-compute[72773]: DEBUG nova.policy [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc5eadd5926b4e9d80f55e6b28376e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bd0a0d273048b68a1f3a800be7da5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:47:40 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:47:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:47:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:47:40 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:47:40 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Creating image(s)
Aug 16 22:47:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Acquiring lock "/opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:47:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "/opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:47:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "/opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:47:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.172s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:47:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:47:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.175s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk 1073741824" returned: 0 in 0.064s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:47:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.183s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:41 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Checking if we can resize image /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:47:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:41 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Cannot resize image /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:47:41 user nova-compute[72773]: DEBUG nova.objects.instance [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lazy-loading 'migration_context' on Instance uuid 29c612f4-5ed1-46db-bdec-0eed58384746 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:47:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:47:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Ensure instance console log exists: /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:47:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:47:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:47:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:47:41 user nova-compute[72773]: DEBUG nova.network.neutron [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Successfully created port: e184f66d-572d-452b-8675-006aeef3c372 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:47:41 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG nova.network.neutron [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Successfully updated port: e184f66d-572d-452b-8675-006aeef3c372 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Acquiring lock "refresh_cache-29c612f4-5ed1-46db-bdec-0eed58384746" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Acquired lock "refresh_cache-29c612f4-5ed1-46db-bdec-0eed58384746" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG nova.network.neutron [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG nova.compute.manager [req-dfa1b4f4-1959-4057-b0af-69fb8e7b9d7d req-fac23a82-c91e-4534-ae7d-68f3de7108d1 service nova] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Received event network-changed-e184f66d-572d-452b-8675-006aeef3c372 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG nova.compute.manager [req-dfa1b4f4-1959-4057-b0af-69fb8e7b9d7d req-fac23a82-c91e-4534-ae7d-68f3de7108d1 service nova] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Refreshing instance network info cache due to event network-changed-e184f66d-572d-452b-8675-006aeef3c372. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-dfa1b4f4-1959-4057-b0af-69fb8e7b9d7d req-fac23a82-c91e-4534-ae7d-68f3de7108d1 service nova] Acquiring lock "refresh_cache-29c612f4-5ed1-46db-bdec-0eed58384746" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG nova.network.neutron [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG nova.network.neutron [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Updating instance_info_cache with network_info: [{"id": "e184f66d-572d-452b-8675-006aeef3c372", "address": "fa:16:3e:1b:7d:b0", "network": {"id": "2e9dee37-d081-4059-a22c-e8aa5cacfc75", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2058131931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7bd0a0d273048b68a1f3a800be7da5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape184f66d-57", "ovs_interfaceid": "e184f66d-572d-452b-8675-006aeef3c372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Releasing lock "refresh_cache-29c612f4-5ed1-46db-bdec-0eed58384746" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG nova.compute.manager [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Instance network_info: |[{"id": "e184f66d-572d-452b-8675-006aeef3c372", "address": "fa:16:3e:1b:7d:b0", "network": {"id": "2e9dee37-d081-4059-a22c-e8aa5cacfc75", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2058131931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7bd0a0d273048b68a1f3a800be7da5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape184f66d-57", "ovs_interfaceid": "e184f66d-572d-452b-8675-006aeef3c372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-dfa1b4f4-1959-4057-b0af-69fb8e7b9d7d req-fac23a82-c91e-4534-ae7d-68f3de7108d1 service nova] Acquired lock "refresh_cache-29c612f4-5ed1-46db-bdec-0eed58384746" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG nova.network.neutron [req-dfa1b4f4-1959-4057-b0af-69fb8e7b9d7d req-fac23a82-c91e-4534-ae7d-68f3de7108d1 service nova] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Refreshing network info cache for port e184f66d-572d-452b-8675-006aeef3c372 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Start _get_guest_xml network_info=[{"id": "e184f66d-572d-452b-8675-006aeef3c372", "address": "fa:16:3e:1b:7d:b0", "network": {"id": "2e9dee37-d081-4059-a22c-e8aa5cacfc75", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2058131931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7bd0a0d273048b68a1f3a800be7da5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape184f66d-57", "ovs_interfaceid": "e184f66d-572d-452b-8675-006aeef3c372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:47:42 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:47:42 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:47:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:47:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1502735280',display_name='tempest-SnapshotDataIntegrityTests-server-1502735280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1502735280',id=42,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5iPz4RqtHj+wnpwx9tVR+hSztjc3SxPYoDOEsdm04V0TvYD07oWN1Ftosq6Ny11IvI81kxhLhyXI9YMBoFUa6mtudHON17yNHrcIw5BEODJyKwTBkGranvYsLBZik5SQ==',key_name='tempest-keypair-1492439283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7bd0a0d273048b68a1f3a800be7da5c',ramdisk_id='',reservation_id='r-rz0sgfeu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-760317901',owner_user_name='tempest-SnapshotDataIntegrityTests-760317901-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:47:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc5eadd5926b4e9d80f55e6b28376e5e',uuid=29c612f4-5ed1-46db-bdec-0eed58384746,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e184f66d-572d-452b-8675-006aeef3c372", "address": "fa:16:3e:1b:7d:b0", "network": {"id": "2e9dee37-d081-4059-a22c-e8aa5cacfc75", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2058131931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7bd0a0d273048b68a1f3a800be7da5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape184f66d-57", "ovs_interfaceid": "e184f66d-572d-452b-8675-006aeef3c372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Converting VIF {"id": "e184f66d-572d-452b-8675-006aeef3c372", "address": "fa:16:3e:1b:7d:b0", "network": {"id": "2e9dee37-d081-4059-a22c-e8aa5cacfc75", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2058131931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7bd0a0d273048b68a1f3a800be7da5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape184f66d-57", "ovs_interfaceid": "e184f66d-572d-452b-8675-006aeef3c372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:7d:b0,bridge_name='br-int',has_traffic_filtering=True,id=e184f66d-572d-452b-8675-006aeef3c372,network=Network(2e9dee37-d081-4059-a22c-e8aa5cacfc75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape184f66d-57') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG nova.objects.instance [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lazy-loading 'pci_devices' on Instance uuid 29c612f4-5ed1-46db-bdec-0eed58384746 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:47:42 user nova-compute[72773]:   <uuid>29c612f4-5ed1-46db-bdec-0eed58384746</uuid>
Aug 16 22:47:42 user nova-compute[72773]:   <name>instance-0000002a</name>
Aug 16 22:47:42 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:47:42 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:47:42 user nova-compute[72773]:   <metadata>
Aug 16 22:47:42 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:47:42 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:47:42 user nova-compute[72773]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1502735280</nova:name>
Aug 16 22:47:42 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:47:42</nova:creationTime>
Aug 16 22:47:42 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:47:42 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:47:42 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:47:42 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:47:42 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:47:42 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:47:42 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:47:42 user nova-compute[72773]:       <nova:owner>
Aug 16 22:47:42 user nova-compute[72773]:         <nova:user uuid="cc5eadd5926b4e9d80f55e6b28376e5e">tempest-SnapshotDataIntegrityTests-760317901-project-member</nova:user>
Aug 16 22:47:42 user nova-compute[72773]:         <nova:project uuid="f7bd0a0d273048b68a1f3a800be7da5c">tempest-SnapshotDataIntegrityTests-760317901</nova:project>
Aug 16 22:47:42 user nova-compute[72773]:       </nova:owner>
Aug 16 22:47:42 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:47:42 user nova-compute[72773]:       <nova:ports>
Aug 16 22:47:42 user nova-compute[72773]:         <nova:port uuid="e184f66d-572d-452b-8675-006aeef3c372">
Aug 16 22:47:42 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 22:47:42 user nova-compute[72773]:         </nova:port>
Aug 16 22:47:42 user nova-compute[72773]:       </nova:ports>
Aug 16 22:47:42 user nova-compute[72773]:     </nova:instance>
Aug 16 22:47:42 user nova-compute[72773]:   </metadata>
Aug 16 22:47:42 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:47:42 user nova-compute[72773]:     <system>
Aug 16 22:47:42 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:47:42 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:47:42 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:47:42 user nova-compute[72773]:       <entry name="serial">29c612f4-5ed1-46db-bdec-0eed58384746</entry>
Aug 16 22:47:42 user nova-compute[72773]:       <entry name="uuid">29c612f4-5ed1-46db-bdec-0eed58384746</entry>
Aug 16 22:47:42 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:47:42 user nova-compute[72773]:     </system>
Aug 16 22:47:42 user nova-compute[72773]:   </sysinfo>
Aug 16 22:47:42 user nova-compute[72773]:   <os>
Aug 16 22:47:42 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:47:42 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:47:42 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:47:42 user nova-compute[72773]:   </os>
Aug 16 22:47:42 user nova-compute[72773]:   <features>
Aug 16 22:47:42 user nova-compute[72773]:     <acpi/>
Aug 16 22:47:42 user nova-compute[72773]:     <apic/>
Aug 16 22:47:42 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:47:42 user nova-compute[72773]:   </features>
Aug 16 22:47:42 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:47:42 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:47:42 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:47:42 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:47:42 user nova-compute[72773]:   </clock>
Aug 16 22:47:42 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:47:42 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:47:42 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:47:42 user nova-compute[72773]:   </cpu>
Aug 16 22:47:42 user nova-compute[72773]:   <devices>
Aug 16 22:47:42 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:47:42 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:47:42 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk"/>
Aug 16 22:47:42 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:47:42 user nova-compute[72773]:     </disk>
Aug 16 22:47:42 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:47:42 user nova-compute[72773]:       <mac address="fa:16:3e:1b:7d:b0"/>
Aug 16 22:47:42 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:47:42 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:47:42 user nova-compute[72773]:       <target dev="tape184f66d-57"/>
Aug 16 22:47:42 user nova-compute[72773]:     </interface>
Aug 16 22:47:42 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:47:42 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/console.log" append="off"/>
Aug 16 22:47:42 user nova-compute[72773]:     </serial>
Aug 16 22:47:42 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:47:42 user nova-compute[72773]:     <video>
Aug 16 22:47:42 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:47:42 user nova-compute[72773]:     </video>
Aug 16 22:47:42 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:47:42 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:47:42 user nova-compute[72773]:     </rng>
Aug 16 22:47:42 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:47:42 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:47:42 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:47:42 user nova-compute[72773]:     </memballoon>
Aug 16 22:47:42 user nova-compute[72773]:   </devices>
Aug 16 22:47:42 user nova-compute[72773]: </domain>
Aug 16 22:47:42 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:47:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1502735280',display_name='tempest-SnapshotDataIntegrityTests-server-1502735280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1502735280',id=42,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5iPz4RqtHj+wnpwx9tVR+hSztjc3SxPYoDOEsdm04V0TvYD07oWN1Ftosq6Ny11IvI81kxhLhyXI9YMBoFUa6mtudHON17yNHrcIw5BEODJyKwTBkGranvYsLBZik5SQ==',key_name='tempest-keypair-1492439283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7bd0a0d273048b68a1f3a800be7da5c',ramdisk_id='',reservation_id='r-rz0sgfeu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-760317901',owner_user_name='tempest-SnapshotDataIntegrityTests-760317901-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:47:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc5eadd5926b4e9d80f55e6b28376e5e',uuid=29c612f4-5ed1-46db-bdec-0eed58384746,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e184f66d-572d-452b-8675-006aeef3c372", "address": "fa:16:3e:1b:7d:b0", "network": {"id": "2e9dee37-d081-4059-a22c-e8aa5cacfc75", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2058131931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7bd0a0d273048b68a1f3a800be7da5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape184f66d-57", "ovs_interfaceid": "e184f66d-572d-452b-8675-006aeef3c372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Converting VIF {"id": "e184f66d-572d-452b-8675-006aeef3c372", "address": "fa:16:3e:1b:7d:b0", "network": {"id": "2e9dee37-d081-4059-a22c-e8aa5cacfc75", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2058131931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7bd0a0d273048b68a1f3a800be7da5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape184f66d-57", "ovs_interfaceid": "e184f66d-572d-452b-8675-006aeef3c372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:7d:b0,bridge_name='br-int',has_traffic_filtering=True,id=e184f66d-572d-452b-8675-006aeef3c372,network=Network(2e9dee37-d081-4059-a22c-e8aa5cacfc75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape184f66d-57') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG os_vif [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:7d:b0,bridge_name='br-int',has_traffic_filtering=True,id=e184f66d-572d-452b-8675-006aeef3c372,network=Network(2e9dee37-d081-4059-a22c-e8aa5cacfc75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape184f66d-57') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape184f66d-57, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape184f66d-57, col_values=(('external_ids', {'iface-id': 'e184f66d-572d-452b-8675-006aeef3c372', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:7d:b0', 'vm-uuid': '29c612f4-5ed1-46db-bdec-0eed58384746'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:42 user nova-compute[72773]: INFO os_vif [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:7d:b0,bridge_name='br-int',has_traffic_filtering=True,id=e184f66d-572d-452b-8675-006aeef3c372,network=Network(2e9dee37-d081-4059-a22c-e8aa5cacfc75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape184f66d-57')
Aug 16 22:47:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:47:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] No VIF found with MAC fa:16:3e:1b:7d:b0, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:47:43 user nova-compute[72773]: DEBUG nova.network.neutron [req-dfa1b4f4-1959-4057-b0af-69fb8e7b9d7d req-fac23a82-c91e-4534-ae7d-68f3de7108d1 service nova] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Updated VIF entry in instance network info cache for port e184f66d-572d-452b-8675-006aeef3c372. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:47:43 user nova-compute[72773]: DEBUG nova.network.neutron [req-dfa1b4f4-1959-4057-b0af-69fb8e7b9d7d req-fac23a82-c91e-4534-ae7d-68f3de7108d1 service nova] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Updating instance_info_cache with network_info: [{"id": "e184f66d-572d-452b-8675-006aeef3c372", "address": "fa:16:3e:1b:7d:b0", "network": {"id": "2e9dee37-d081-4059-a22c-e8aa5cacfc75", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2058131931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7bd0a0d273048b68a1f3a800be7da5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape184f66d-57", "ovs_interfaceid": "e184f66d-572d-452b-8675-006aeef3c372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:47:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-dfa1b4f4-1959-4057-b0af-69fb8e7b9d7d req-fac23a82-c91e-4534-ae7d-68f3de7108d1 service nova] Releasing lock "refresh_cache-29c612f4-5ed1-46db-bdec-0eed58384746" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:47:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:44 user nova-compute[72773]: DEBUG nova.compute.manager [req-0c521aa4-5c88-444f-93e6-e590f2d59ab9 req-43d3d0c0-04e7-425b-bb19-f4071f7e1e3b service nova] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Received event network-vif-plugged-e184f66d-572d-452b-8675-006aeef3c372 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:47:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0c521aa4-5c88-444f-93e6-e590f2d59ab9 req-43d3d0c0-04e7-425b-bb19-f4071f7e1e3b service nova] Acquiring lock "29c612f4-5ed1-46db-bdec-0eed58384746-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:47:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0c521aa4-5c88-444f-93e6-e590f2d59ab9 req-43d3d0c0-04e7-425b-bb19-f4071f7e1e3b service nova] Lock "29c612f4-5ed1-46db-bdec-0eed58384746-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:47:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0c521aa4-5c88-444f-93e6-e590f2d59ab9 req-43d3d0c0-04e7-425b-bb19-f4071f7e1e3b service nova] Lock "29c612f4-5ed1-46db-bdec-0eed58384746-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:47:44 user nova-compute[72773]: DEBUG nova.compute.manager [req-0c521aa4-5c88-444f-93e6-e590f2d59ab9 req-43d3d0c0-04e7-425b-bb19-f4071f7e1e3b service nova] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] No waiting events found dispatching network-vif-plugged-e184f66d-572d-452b-8675-006aeef3c372 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:47:44 user nova-compute[72773]: WARNING nova.compute.manager [req-0c521aa4-5c88-444f-93e6-e590f2d59ab9 req-43d3d0c0-04e7-425b-bb19-f4071f7e1e3b service nova] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Received unexpected event network-vif-plugged-e184f66d-572d-452b-8675-006aeef3c372 for instance with vm_state building and task_state spawning.
Aug 16 22:47:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692226066.2266583, 29c612f4-5ed1-46db-bdec-0eed58384746 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:47:46 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] VM Resumed (Lifecycle Event)
Aug 16 22:47:46 user nova-compute[72773]: DEBUG nova.compute.manager [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:47:46 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Instance spawned successfully.
Aug 16 22:47:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:47:46 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:47:46 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692226066.2283862, 29c612f4-5ed1-46db-bdec-0eed58384746 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:47:46 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] VM Started (Lifecycle Event)
Aug 16 22:47:46 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:47:46 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:47:46 user nova-compute[72773]: INFO nova.compute.manager [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Took 5.95 seconds to spawn the instance on the hypervisor.
Aug 16 22:47:46 user nova-compute[72773]: DEBUG nova.compute.manager [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:47:46 user nova-compute[72773]: INFO nova.compute.manager [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Took 6.80 seconds to build instance.
Aug 16 22:47:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFyBYEOq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:47:46 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:47:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:47:46 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:47:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:47:46 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6465d9e6-07d7-4fd3-85e0-e35a4dc45c42 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "29c612f4-5ed1-46db-bdec-0eed58384746" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.897s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd1aef5-2aca-4d07-a887-17b3d74d912a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:47:46 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b12174d-bd3d-48ee-b414-220636832b14]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601] added
Aug 16 22:47:46 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[02da4ccc-1b35-4841-a8e3-91aec83648c6]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4452c803-c2bf-406e-92d9-6a22c388360a]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lFyBYEOq {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lFyBYEOq" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d55b62c-f9f3-465e-89f2-fce28180b19e]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lFyBYEOq'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bcb2bc-f17d-4932-b941-012b1d8ac3ca]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef69aa0-7eb2-4cc1-889f-1967fbbb4274]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:47:46 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:47:46 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG nova.compute.manager [req-09cd2f28-a8f2-4679-9a7d-e5cc0a7a1ea3 req-95a4c93d-1c9a-439a-b9ed-0ad85b99dc5a service nova] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Received event network-vif-plugged-e184f66d-572d-452b-8675-006aeef3c372 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-09cd2f28-a8f2-4679-9a7d-e5cc0a7a1ea3 req-95a4c93d-1c9a-439a-b9ed-0ad85b99dc5a service nova] Acquiring lock "29c612f4-5ed1-46db-bdec-0eed58384746-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-09cd2f28-a8f2-4679-9a7d-e5cc0a7a1ea3 req-95a4c93d-1c9a-439a-b9ed-0ad85b99dc5a service nova] Lock "29c612f4-5ed1-46db-bdec-0eed58384746-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-09cd2f28-a8f2-4679-9a7d-e5cc0a7a1ea3 req-95a4c93d-1c9a-439a-b9ed-0ad85b99dc5a service nova] Lock "29c612f4-5ed1-46db-bdec-0eed58384746-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG nova.compute.manager [req-09cd2f28-a8f2-4679-9a7d-e5cc0a7a1ea3 req-95a4c93d-1c9a-439a-b9ed-0ad85b99dc5a service nova] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] No waiting events found dispatching network-vif-plugged-e184f66d-572d-452b-8675-006aeef3c372 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:47:46 user nova-compute[72773]: WARNING nova.compute.manager [req-09cd2f28-a8f2-4679-9a7d-e5cc0a7a1ea3 req-95a4c93d-1c9a-439a-b9ed-0ad85b99dc5a service nova] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Received unexpected event network-vif-plugged-e184f66d-572d-452b-8675-006aeef3c372 for instance with vm_state active and task_state None.
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c917c2-2602-42f7-a131-0e084ebad9bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601, portal: 172.16.0.220,3260]
Aug 16 22:47:46 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601, portal: 172.16.0.220,3260] successful.
Aug 16 22:47:46 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e909c432-1c78-41c6-917e-94312a470deb]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2ed9dc-042f-48a7-8937-3b9acd91c082]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:47:46 user nova-compute[72773]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)
Aug 16 22:47:46 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:47:46 user nova-compute[72773]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)
Aug 16 22:47:46 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.066s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6908fd5f-0768-471d-bbaf-f6532c20b134]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:47:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFyBYEOq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:47:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:47:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23932663865333333', 'path': '/dev/sdc'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:47:47 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932663865333333', 'path': '/dev/sdc'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:47:47 user nova-compute[72773]: DEBUG nova.objects.instance [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lazy-loading 'flavor' on Instance uuid f97d8a95-e281-496b-bb62-81747a5c2ffc {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:47:47 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 22:47:47 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:47:47 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 22:47:47 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:47:47 user nova-compute[72773]:   <serial>3510e728-af0a-49bf-8a0d-c07fc7fea601</serial>
Aug 16 22:47:47 user nova-compute[72773]: </disk>
Aug 16 22:47:47 user nova-compute[72773]:  {{(pid=72773) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 22:47:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:47:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:47:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] No VIF found with MAC fa:16:3e:12:35:93, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:47:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1dd19322-b223-4308-9723-ec600025397a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.919s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:47:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4109248b-4a62-4402-beba-8afdc9501e53 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "f97d8a95-e281-496b-bb62-81747a5c2ffc" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:47:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4109248b-4a62-4402-beba-8afdc9501e53 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:47:49 user nova-compute[72773]: DEBUG nova.compute.manager [None req-4109248b-4a62-4402-beba-8afdc9501e53 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:47:49 user nova-compute[72773]: DEBUG nova.compute.manager [None req-4109248b-4a62-4402-beba-8afdc9501e53 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72773) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 16 22:47:49 user nova-compute[72773]: DEBUG nova.objects.instance [None req-4109248b-4a62-4402-beba-8afdc9501e53 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lazy-loading 'flavor' on Instance uuid f97d8a95-e281-496b-bb62-81747a5c2ffc {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:47:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-be890691-17d9-4710-a966-b9755581f684 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "60f877e9-8032-4781-8692-88853f420a3c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:47:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-be890691-17d9-4710-a966-b9755581f684 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "60f877e9-8032-4781-8692-88853f420a3c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:47:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-be890691-17d9-4710-a966-b9755581f684 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "60f877e9-8032-4781-8692-88853f420a3c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:47:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-be890691-17d9-4710-a966-b9755581f684 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "60f877e9-8032-4781-8692-88853f420a3c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.008s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:47:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-be890691-17d9-4710-a966-b9755581f684 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "60f877e9-8032-4781-8692-88853f420a3c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:47:49 user nova-compute[72773]: INFO nova.compute.manager [None req-be890691-17d9-4710-a966-b9755581f684 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Terminating instance
Aug 16 22:47:49 user nova-compute[72773]: DEBUG nova.compute.manager [None req-be890691-17d9-4710-a966-b9755581f684 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:47:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:50 user nova-compute[72773]: DEBUG nova.compute.manager [req-2bcf392c-0b51-4082-af90-438ad8f5b1c0 req-cf6dffd3-06f6-45e5-8c07-fc72ba9bd5d1 service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Received event network-vif-unplugged-3c0ffcbd-768e-4040-8765-663fa495a3ab {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:47:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2bcf392c-0b51-4082-af90-438ad8f5b1c0 req-cf6dffd3-06f6-45e5-8c07-fc72ba9bd5d1 service nova] Acquiring lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:47:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2bcf392c-0b51-4082-af90-438ad8f5b1c0 req-cf6dffd3-06f6-45e5-8c07-fc72ba9bd5d1 service nova] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:47:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2bcf392c-0b51-4082-af90-438ad8f5b1c0 req-cf6dffd3-06f6-45e5-8c07-fc72ba9bd5d1 service nova] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:47:50 user nova-compute[72773]: DEBUG nova.compute.manager [req-2bcf392c-0b51-4082-af90-438ad8f5b1c0 req-cf6dffd3-06f6-45e5-8c07-fc72ba9bd5d1 service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] No waiting events found dispatching network-vif-unplugged-3c0ffcbd-768e-4040-8765-663fa495a3ab {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:47:50 user nova-compute[72773]: WARNING nova.compute.manager [req-2bcf392c-0b51-4082-af90-438ad8f5b1c0 req-cf6dffd3-06f6-45e5-8c07-fc72ba9bd5d1 service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Received unexpected event network-vif-unplugged-3c0ffcbd-768e-4040-8765-663fa495a3ab for instance with vm_state active and task_state powering-off.
Aug 16 22:47:50 user nova-compute[72773]: DEBUG nova.compute.manager [req-c9108274-759a-4add-a65c-f9a872df722f req-00f7dac9-75ce-4f62-a903-bc6dba0b7a7f service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received event network-vif-unplugged-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:47:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c9108274-759a-4add-a65c-f9a872df722f req-00f7dac9-75ce-4f62-a903-bc6dba0b7a7f service nova] Acquiring lock "60f877e9-8032-4781-8692-88853f420a3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:47:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c9108274-759a-4add-a65c-f9a872df722f req-00f7dac9-75ce-4f62-a903-bc6dba0b7a7f service nova] Lock "60f877e9-8032-4781-8692-88853f420a3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:47:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c9108274-759a-4add-a65c-f9a872df722f req-00f7dac9-75ce-4f62-a903-bc6dba0b7a7f service nova] Lock "60f877e9-8032-4781-8692-88853f420a3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:47:50 user nova-compute[72773]: DEBUG nova.compute.manager [req-c9108274-759a-4add-a65c-f9a872df722f req-00f7dac9-75ce-4f62-a903-bc6dba0b7a7f service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] No waiting events found dispatching network-vif-unplugged-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:47:50 user nova-compute[72773]: DEBUG nova.compute.manager [req-c9108274-759a-4add-a65c-f9a872df722f req-00f7dac9-75ce-4f62-a903-bc6dba0b7a7f service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received event network-vif-unplugged-39797b08-9184-4673-a07c-c2123736fc54 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:47:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:50 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Instance destroyed successfully.
Aug 16 22:47:50 user nova-compute[72773]: DEBUG nova.compute.manager [None req-4109248b-4a62-4402-beba-8afdc9501e53 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:47:50 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Instance destroyed successfully.
Aug 16 22:47:50 user nova-compute[72773]: DEBUG nova.objects.instance [None req-be890691-17d9-4710-a966-b9755581f684 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lazy-loading 'resources' on Instance uuid 60f877e9-8032-4781-8692-88853f420a3c {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:47:50 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-be890691-17d9-4710-a966-b9755581f684 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:41:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-827284706',display_name='tempest-ServerRescueNegativeTestJSON-server-827284706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-827284706',id=35,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7gafhwwNaFwdrqYDxUnK7qviiu8w72xziXFtmugun3TJ+ehJ6SdUX+lpAqyz9MNn0gbwOiswYPEz294I0l7FWrizeZtd/b4guqnHdCcLGRy+g1PZ0sbuxpR4sXj4MbGg==',key_name='tempest-keypair-1429512481',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:43:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f8e068df8094356b16a6480cd231675',ramdisk_id='',reservation_id='r-wbw339d1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1754829282',owner_user_name='tempest-ServerRescueNegativeTestJSON-1754829282-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:45:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62e5b77a149140fd8613d566f41cc23d',uuid=60f877e9-8032-4781-8692-88853f420a3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39797b08-9184-4673-a07c-c2123736fc54", "address": "fa:16:3e:71:50:b7", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39797b08-91", "ovs_interfaceid": "39797b08-9184-4673-a07c-c2123736fc54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:47:50 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-be890691-17d9-4710-a966-b9755581f684 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Converting VIF {"id": "39797b08-9184-4673-a07c-c2123736fc54", "address": "fa:16:3e:71:50:b7", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39797b08-91", "ovs_interfaceid": "39797b08-9184-4673-a07c-c2123736fc54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:47:50 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-be890691-17d9-4710-a966-b9755581f684 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:50:b7,bridge_name='br-int',has_traffic_filtering=True,id=39797b08-9184-4673-a07c-c2123736fc54,network=Network(8a43bbad-aab2-44c9-a7e4-62696d908234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39797b08-91') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:47:50 user nova-compute[72773]: DEBUG os_vif [None req-be890691-17d9-4710-a966-b9755581f684 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:50:b7,bridge_name='br-int',has_traffic_filtering=True,id=39797b08-9184-4673-a07c-c2123736fc54,network=Network(8a43bbad-aab2-44c9-a7e4-62696d908234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39797b08-91') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:47:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39797b08-91, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:47:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:47:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4109248b-4a62-4402-beba-8afdc9501e53 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.279s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:47:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:50 user nova-compute[72773]: INFO os_vif [None req-be890691-17d9-4710-a966-b9755581f684 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:50:b7,bridge_name='br-int',has_traffic_filtering=True,id=39797b08-9184-4673-a07c-c2123736fc54,network=Network(8a43bbad-aab2-44c9-a7e4-62696d908234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39797b08-91')
Aug 16 22:47:50 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-be890691-17d9-4710-a966-b9755581f684 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Deleting instance files /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c_del
Aug 16 22:47:50 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-be890691-17d9-4710-a966-b9755581f684 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Deletion of /opt/stack/data/nova/instances/60f877e9-8032-4781-8692-88853f420a3c_del complete
Aug 16 22:47:50 user nova-compute[72773]: INFO nova.compute.manager [None req-be890691-17d9-4710-a966-b9755581f684 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Took 1.26 seconds to destroy the instance on the hypervisor.
Aug 16 22:47:50 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-be890691-17d9-4710-a966-b9755581f684 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:47:50 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:47:50 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 60f877e9-8032-4781-8692-88853f420a3c] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:47:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:51 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692226056.522533, 205a7949-e2c1-40d8-8570-04d351a282d1 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:47:51 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] VM Stopped (Lifecycle Event)
Aug 16 22:47:51 user nova-compute[72773]: DEBUG nova.compute.manager [None req-71c32ef8-807a-4900-b44a-c11bdb548266 None None] [instance: 205a7949-e2c1-40d8-8570-04d351a282d1] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:47:51 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:47:51 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Took 1.01 seconds to deallocate network for instance.
Aug 16 22:47:52 user nova-compute[72773]: DEBUG nova.compute.manager [req-8a2c7ab7-9bab-4eee-bff3-a31416870d92 req-cb3c9881-c99f-4922-8424-152efa0bed60 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received event network-vif-deleted-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:47:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-be890691-17d9-4710-a966-b9755581f684 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:47:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-be890691-17d9-4710-a966-b9755581f684 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:47:52 user nova-compute[72773]: DEBUG nova.compute.manager [req-94d5668b-3a05-49d0-9553-00e174b62bbc req-221645d7-0046-4c2a-b0f9-6157dbe2b08d service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Received event network-vif-plugged-3c0ffcbd-768e-4040-8765-663fa495a3ab {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:47:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-94d5668b-3a05-49d0-9553-00e174b62bbc req-221645d7-0046-4c2a-b0f9-6157dbe2b08d service nova] Acquiring lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:47:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-94d5668b-3a05-49d0-9553-00e174b62bbc req-221645d7-0046-4c2a-b0f9-6157dbe2b08d service nova] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:47:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-94d5668b-3a05-49d0-9553-00e174b62bbc req-221645d7-0046-4c2a-b0f9-6157dbe2b08d service nova] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:47:52 user nova-compute[72773]: DEBUG nova.compute.manager [req-94d5668b-3a05-49d0-9553-00e174b62bbc req-221645d7-0046-4c2a-b0f9-6157dbe2b08d service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] No waiting events found dispatching network-vif-plugged-3c0ffcbd-768e-4040-8765-663fa495a3ab {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:47:52 user nova-compute[72773]: WARNING nova.compute.manager [req-94d5668b-3a05-49d0-9553-00e174b62bbc req-221645d7-0046-4c2a-b0f9-6157dbe2b08d service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Received unexpected event network-vif-plugged-3c0ffcbd-768e-4040-8765-663fa495a3ab for instance with vm_state stopped and task_state None.
Aug 16 22:47:52 user nova-compute[72773]: DEBUG nova.compute.manager [req-4e883b19-b5be-4ec5-8cd8-9933eabfae71 req-0e4808af-1d9f-4672-a3f2-00733461cb85 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received event network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:47:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4e883b19-b5be-4ec5-8cd8-9933eabfae71 req-0e4808af-1d9f-4672-a3f2-00733461cb85 service nova] Acquiring lock "60f877e9-8032-4781-8692-88853f420a3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:47:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4e883b19-b5be-4ec5-8cd8-9933eabfae71 req-0e4808af-1d9f-4672-a3f2-00733461cb85 service nova] Lock "60f877e9-8032-4781-8692-88853f420a3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:47:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4e883b19-b5be-4ec5-8cd8-9933eabfae71 req-0e4808af-1d9f-4672-a3f2-00733461cb85 service nova] Lock "60f877e9-8032-4781-8692-88853f420a3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:47:52 user nova-compute[72773]: DEBUG nova.compute.manager [req-4e883b19-b5be-4ec5-8cd8-9933eabfae71 req-0e4808af-1d9f-4672-a3f2-00733461cb85 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] No waiting events found dispatching network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:47:52 user nova-compute[72773]: WARNING nova.compute.manager [req-4e883b19-b5be-4ec5-8cd8-9933eabfae71 req-0e4808af-1d9f-4672-a3f2-00733461cb85 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received unexpected event network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 for instance with vm_state deleted and task_state None.
Aug 16 22:47:52 user nova-compute[72773]: DEBUG nova.compute.manager [req-4e883b19-b5be-4ec5-8cd8-9933eabfae71 req-0e4808af-1d9f-4672-a3f2-00733461cb85 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received event network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:47:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4e883b19-b5be-4ec5-8cd8-9933eabfae71 req-0e4808af-1d9f-4672-a3f2-00733461cb85 service nova] Acquiring lock "60f877e9-8032-4781-8692-88853f420a3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:47:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4e883b19-b5be-4ec5-8cd8-9933eabfae71 req-0e4808af-1d9f-4672-a3f2-00733461cb85 service nova] Lock "60f877e9-8032-4781-8692-88853f420a3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:47:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4e883b19-b5be-4ec5-8cd8-9933eabfae71 req-0e4808af-1d9f-4672-a3f2-00733461cb85 service nova] Lock "60f877e9-8032-4781-8692-88853f420a3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:47:52 user nova-compute[72773]: DEBUG nova.compute.manager [req-4e883b19-b5be-4ec5-8cd8-9933eabfae71 req-0e4808af-1d9f-4672-a3f2-00733461cb85 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] No waiting events found dispatching network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:47:52 user nova-compute[72773]: WARNING nova.compute.manager [req-4e883b19-b5be-4ec5-8cd8-9933eabfae71 req-0e4808af-1d9f-4672-a3f2-00733461cb85 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received unexpected event network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 for instance with vm_state deleted and task_state None.
Aug 16 22:47:52 user nova-compute[72773]: DEBUG nova.compute.manager [req-4e883b19-b5be-4ec5-8cd8-9933eabfae71 req-0e4808af-1d9f-4672-a3f2-00733461cb85 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received event network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:47:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4e883b19-b5be-4ec5-8cd8-9933eabfae71 req-0e4808af-1d9f-4672-a3f2-00733461cb85 service nova] Acquiring lock "60f877e9-8032-4781-8692-88853f420a3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:47:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4e883b19-b5be-4ec5-8cd8-9933eabfae71 req-0e4808af-1d9f-4672-a3f2-00733461cb85 service nova] Lock "60f877e9-8032-4781-8692-88853f420a3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:47:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4e883b19-b5be-4ec5-8cd8-9933eabfae71 req-0e4808af-1d9f-4672-a3f2-00733461cb85 service nova] Lock "60f877e9-8032-4781-8692-88853f420a3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:47:52 user nova-compute[72773]: DEBUG nova.compute.manager [req-4e883b19-b5be-4ec5-8cd8-9933eabfae71 req-0e4808af-1d9f-4672-a3f2-00733461cb85 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] No waiting events found dispatching network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:47:52 user nova-compute[72773]: WARNING nova.compute.manager [req-4e883b19-b5be-4ec5-8cd8-9933eabfae71 req-0e4808af-1d9f-4672-a3f2-00733461cb85 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received unexpected event network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 for instance with vm_state deleted and task_state None.
Aug 16 22:47:52 user nova-compute[72773]: DEBUG nova.compute.manager [req-4e883b19-b5be-4ec5-8cd8-9933eabfae71 req-0e4808af-1d9f-4672-a3f2-00733461cb85 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received event network-vif-unplugged-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:47:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4e883b19-b5be-4ec5-8cd8-9933eabfae71 req-0e4808af-1d9f-4672-a3f2-00733461cb85 service nova] Acquiring lock "60f877e9-8032-4781-8692-88853f420a3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:47:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4e883b19-b5be-4ec5-8cd8-9933eabfae71 req-0e4808af-1d9f-4672-a3f2-00733461cb85 service nova] Lock "60f877e9-8032-4781-8692-88853f420a3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:47:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4e883b19-b5be-4ec5-8cd8-9933eabfae71 req-0e4808af-1d9f-4672-a3f2-00733461cb85 service nova] Lock "60f877e9-8032-4781-8692-88853f420a3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:47:52 user nova-compute[72773]: DEBUG nova.compute.manager [req-4e883b19-b5be-4ec5-8cd8-9933eabfae71 req-0e4808af-1d9f-4672-a3f2-00733461cb85 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] No waiting events found dispatching network-vif-unplugged-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:47:52 user nova-compute[72773]: WARNING nova.compute.manager [req-4e883b19-b5be-4ec5-8cd8-9933eabfae71 req-0e4808af-1d9f-4672-a3f2-00733461cb85 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received unexpected event network-vif-unplugged-39797b08-9184-4673-a07c-c2123736fc54 for instance with vm_state deleted and task_state None.
Aug 16 22:47:52 user nova-compute[72773]: DEBUG nova.compute.manager [req-4e883b19-b5be-4ec5-8cd8-9933eabfae71 req-0e4808af-1d9f-4672-a3f2-00733461cb85 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received event network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:47:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4e883b19-b5be-4ec5-8cd8-9933eabfae71 req-0e4808af-1d9f-4672-a3f2-00733461cb85 service nova] Acquiring lock "60f877e9-8032-4781-8692-88853f420a3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:47:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4e883b19-b5be-4ec5-8cd8-9933eabfae71 req-0e4808af-1d9f-4672-a3f2-00733461cb85 service nova] Lock "60f877e9-8032-4781-8692-88853f420a3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:47:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4e883b19-b5be-4ec5-8cd8-9933eabfae71 req-0e4808af-1d9f-4672-a3f2-00733461cb85 service nova] Lock "60f877e9-8032-4781-8692-88853f420a3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:47:52 user nova-compute[72773]: DEBUG nova.compute.manager [req-4e883b19-b5be-4ec5-8cd8-9933eabfae71 req-0e4808af-1d9f-4672-a3f2-00733461cb85 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] No waiting events found dispatching network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:47:52 user nova-compute[72773]: WARNING nova.compute.manager [req-4e883b19-b5be-4ec5-8cd8-9933eabfae71 req-0e4808af-1d9f-4672-a3f2-00733461cb85 service nova] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Received unexpected event network-vif-plugged-39797b08-9184-4673-a07c-c2123736fc54 for instance with vm_state deleted and task_state None.
Aug 16 22:47:52 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-be890691-17d9-4710-a966-b9755581f684 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:47:52 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-be890691-17d9-4710-a966-b9755581f684 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:47:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-be890691-17d9-4710-a966-b9755581f684 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.286s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:47:52 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-be890691-17d9-4710-a966-b9755581f684 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Deleted allocations for instance 60f877e9-8032-4781-8692-88853f420a3c
Aug 16 22:47:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-be890691-17d9-4710-a966-b9755581f684 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "60f877e9-8032-4781-8692-88853f420a3c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.736s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:47:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:47:59 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:48:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:04 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:48:04 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:48:04 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Didn't find any instances for network info cache update. {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 22:48:04 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:48:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:05 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692226070.8179982, f97d8a95-e281-496b-bb62-81747a5c2ffc => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:48:05 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] VM Stopped (Lifecycle Event)
Aug 16 22:48:05 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692226070.8275733, 60f877e9-8032-4781-8692-88853f420a3c => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:48:05 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 60f877e9-8032-4781-8692-88853f420a3c] VM Stopped (Lifecycle Event)
Aug 16 22:48:05 user nova-compute[72773]: DEBUG nova.compute.manager [None req-e69eba5e-c5fc-4adc-aec2-9e583c4f6ee3 None None] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:48:05 user nova-compute[72773]: DEBUG nova.compute.manager [None req-52129f8c-856a-496d-b4a2-5e873fa7f20f None None] [instance: 60f877e9-8032-4781-8692-88853f420a3c] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:48:05 user nova-compute[72773]: DEBUG nova.compute.manager [None req-e69eba5e-c5fc-4adc-aec2-9e583c4f6ee3 None None] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:48:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:06 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:48:06 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:48:06 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:48:06 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:48:07 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:48:09 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:48:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:48:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:48:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:48:09 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:48:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:10 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:48:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:10 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:48:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:12 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:48:12 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:48:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=7909MB free_disk=25.446640014648438GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:48:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:48:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:48:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 391a6006-4fe6-4398-a1e8-ae95b5edbf2b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:48:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance cf01c401-c424-4b3e-aa5b-439d62b1ae4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:48:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance f4210738-d01e-4408-a15c-aeccada6dd23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:48:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance f97d8a95-e281-496b-bb62-81747a5c2ffc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:48:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:48:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance bc6fff46-be38-4089-a6ba-de75e0d7baab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:48:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 29c612f4-5ed1-46db-bdec-0eed58384746 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:48:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:48:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:48:12 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:48:12 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:48:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:48:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.388s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:48:14 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:48:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:48:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:48:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 22:48:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:48:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:48:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:48:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:48:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:48:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 22:48:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:48:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:48:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:28 user nova-compute[72773]: DEBUG nova.compute.manager [req-f2aab443-6eeb-4fb8-b465-3eded3313e27 req-893fcfc4-a5ff-46de-a7b6-adddcee4949e service nova] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Received event network-changed-bb573e79-a106-40c5-8c53-ab73eb6ba240 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:48:28 user nova-compute[72773]: DEBUG nova.compute.manager [req-f2aab443-6eeb-4fb8-b465-3eded3313e27 req-893fcfc4-a5ff-46de-a7b6-adddcee4949e service nova] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Refreshing instance network info cache due to event network-changed-bb573e79-a106-40c5-8c53-ab73eb6ba240. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:48:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f2aab443-6eeb-4fb8-b465-3eded3313e27 req-893fcfc4-a5ff-46de-a7b6-adddcee4949e service nova] Acquiring lock "refresh_cache-f4210738-d01e-4408-a15c-aeccada6dd23" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:48:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f2aab443-6eeb-4fb8-b465-3eded3313e27 req-893fcfc4-a5ff-46de-a7b6-adddcee4949e service nova] Acquired lock "refresh_cache-f4210738-d01e-4408-a15c-aeccada6dd23" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:48:28 user nova-compute[72773]: DEBUG nova.network.neutron [req-f2aab443-6eeb-4fb8-b465-3eded3313e27 req-893fcfc4-a5ff-46de-a7b6-adddcee4949e service nova] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Refreshing network info cache for port bb573e79-a106-40c5-8c53-ab73eb6ba240 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:48:29 user nova-compute[72773]: DEBUG nova.network.neutron [req-f2aab443-6eeb-4fb8-b465-3eded3313e27 req-893fcfc4-a5ff-46de-a7b6-adddcee4949e service nova] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Updated VIF entry in instance network info cache for port bb573e79-a106-40c5-8c53-ab73eb6ba240. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:48:29 user nova-compute[72773]: DEBUG nova.network.neutron [req-f2aab443-6eeb-4fb8-b465-3eded3313e27 req-893fcfc4-a5ff-46de-a7b6-adddcee4949e service nova] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Updating instance_info_cache with network_info: [{"id": "bb573e79-a106-40c5-8c53-ab73eb6ba240", "address": "fa:16:3e:1e:80:9b", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb573e79-a1", "ovs_interfaceid": "bb573e79-a106-40c5-8c53-ab73eb6ba240", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:48:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f2aab443-6eeb-4fb8-b465-3eded3313e27 req-893fcfc4-a5ff-46de-a7b6-adddcee4949e service nova] Releasing lock "refresh_cache-f4210738-d01e-4408-a15c-aeccada6dd23" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:48:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:30 user nova-compute[72773]: DEBUG nova.compute.manager [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Stashing vm_state: active {{(pid=72773) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 16 22:48:30 user nova-compute[72773]: DEBUG nova.compute.manager [req-f8c3ed1e-81ed-4fa3-8108-d39ee9108862 req-bdacfeb8-2ec3-45b5-8702-d6b201cc5c13 service nova] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Received event network-changed-b6c7b3aa-98f1-48d5-95e2-d1080cfde93d {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:48:30 user nova-compute[72773]: DEBUG nova.compute.manager [req-f8c3ed1e-81ed-4fa3-8108-d39ee9108862 req-bdacfeb8-2ec3-45b5-8702-d6b201cc5c13 service nova] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Refreshing instance network info cache due to event network-changed-b6c7b3aa-98f1-48d5-95e2-d1080cfde93d. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:48:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f8c3ed1e-81ed-4fa3-8108-d39ee9108862 req-bdacfeb8-2ec3-45b5-8702-d6b201cc5c13 service nova] Acquiring lock "refresh_cache-43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:48:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f8c3ed1e-81ed-4fa3-8108-d39ee9108862 req-bdacfeb8-2ec3-45b5-8702-d6b201cc5c13 service nova] Acquired lock "refresh_cache-43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:48:30 user nova-compute[72773]: DEBUG nova.network.neutron [req-f8c3ed1e-81ed-4fa3-8108-d39ee9108862 req-bdacfeb8-2ec3-45b5-8702-d6b201cc5c13 service nova] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Refreshing network info cache for port b6c7b3aa-98f1-48d5-95e2-d1080cfde93d {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:48:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:48:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:48:30 user nova-compute[72773]: DEBUG nova.objects.instance [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lazy-loading 'pci_requests' on Instance uuid 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:48:30 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:48:30 user nova-compute[72773]: INFO nova.compute.claims [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Claim successful on node user
Aug 16 22:48:30 user nova-compute[72773]: DEBUG nova.objects.instance [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lazy-loading 'resources' on Instance uuid 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:48:30 user nova-compute[72773]: DEBUG nova.objects.instance [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lazy-loading 'pci_devices' on Instance uuid 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:48:30 user nova-compute[72773]: INFO nova.compute.resource_tracker [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Updating resource usage from migration 922a93d5-b2fb-4885-a0d0-256608a54a93
Aug 16 22:48:30 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:48:30 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:48:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.497s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:48:30 user nova-compute[72773]: INFO nova.compute.manager [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Migrating
Aug 16 22:48:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "refresh_cache-43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:48:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:30 user nova-compute[72773]: DEBUG nova.network.neutron [req-f8c3ed1e-81ed-4fa3-8108-d39ee9108862 req-bdacfeb8-2ec3-45b5-8702-d6b201cc5c13 service nova] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Updated VIF entry in instance network info cache for port b6c7b3aa-98f1-48d5-95e2-d1080cfde93d. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:48:30 user nova-compute[72773]: DEBUG nova.network.neutron [req-f8c3ed1e-81ed-4fa3-8108-d39ee9108862 req-bdacfeb8-2ec3-45b5-8702-d6b201cc5c13 service nova] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Updating instance_info_cache with network_info: [{"id": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "address": "fa:16:3e:e2:fd:fb", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c7b3aa-98", "ovs_interfaceid": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:48:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f8c3ed1e-81ed-4fa3-8108-d39ee9108862 req-bdacfeb8-2ec3-45b5-8702-d6b201cc5c13 service nova] Releasing lock "refresh_cache-43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:48:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquired lock "refresh_cache-43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:48:31 user nova-compute[72773]: DEBUG nova.network.neutron [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:48:31 user nova-compute[72773]: DEBUG nova.network.neutron [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Updating instance_info_cache with network_info: [{"id": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "address": "fa:16:3e:e2:fd:fb", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c7b3aa-98", "ovs_interfaceid": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:48:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Releasing lock "refresh_cache-43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:48:31 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Starting migrate_disk_and_power_off {{(pid=72773) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 16 22:48:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG nova.compute.manager [req-98586421-d780-4bb2-88bb-44616489e20b req-496525c0-73e3-4fb9-a787-f94e37dcce80 service nova] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Received event network-vif-unplugged-b6c7b3aa-98f1-48d5-95e2-d1080cfde93d {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-98586421-d780-4bb2-88bb-44616489e20b req-496525c0-73e3-4fb9-a787-f94e37dcce80 service nova] Acquiring lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-98586421-d780-4bb2-88bb-44616489e20b req-496525c0-73e3-4fb9-a787-f94e37dcce80 service nova] Lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-98586421-d780-4bb2-88bb-44616489e20b req-496525c0-73e3-4fb9-a787-f94e37dcce80 service nova] Lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG nova.compute.manager [req-98586421-d780-4bb2-88bb-44616489e20b req-496525c0-73e3-4fb9-a787-f94e37dcce80 service nova] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] No waiting events found dispatching network-vif-unplugged-b6c7b3aa-98f1-48d5-95e2-d1080cfde93d {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:48:32 user nova-compute[72773]: WARNING nova.compute.manager [req-98586421-d780-4bb2-88bb-44616489e20b req-496525c0-73e3-4fb9-a787-f94e37dcce80 service nova] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Received unexpected event network-vif-unplugged-b6c7b3aa-98f1-48d5-95e2-d1080cfde93d for instance with vm_state active and task_state resize_migrating.
Aug 16 22:48:32 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Instance destroyed successfully.
Aug 16 22:48:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:46:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1934884323',display_name='tempest-ServerActionsTestOtherA-server-1934884323',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1934884323',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8jX+pTxaeDXA5y4Lt3+HYLzwoWoj7w8Q+TaAP2Om+ZW/RXrMR/7moMcaLV8Y+iO6BXYhMxPummGFIv4FNE2LpZt+HlA5XAu1WYM2d9vz6WjOr3TWc3giU1qDh4/LEA9A==',key_name='tempest-keypair-283817410',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:46:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e3dc03400ff4448682ebba991a7e8af6',ramdisk_id='',reservation_id='r-p7bzcemu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1807466388',owner_user_name='tempest-ServerActionsTestOtherA-1807466388-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:48:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02982f15d1a640a5bc77069a906f3e9a',uuid=43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "address": "fa:16:3e:e2:fd:fb", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1882521174-network", "vif_mac": "fa:16:3e:e2:fd:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c7b3aa-98", "ovs_interfaceid": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Converting VIF {"id": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "address": "fa:16:3e:e2:fd:fb", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1882521174-network", "vif_mac": "fa:16:3e:e2:fd:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c7b3aa-98", "ovs_interfaceid": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:fd:fb,bridge_name='br-int',has_traffic_filtering=True,id=b6c7b3aa-98f1-48d5-95e2-d1080cfde93d,network=Network(1a1a40b0-631c-4f41-9ece-17cd713adfd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6c7b3aa-98') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG os_vif [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:fd:fb,bridge_name='br-int',has_traffic_filtering=True,id=b6c7b3aa-98f1-48d5-95e2-d1080cfde93d,network=Network(1a1a40b0-631c-4f41-9ece-17cd713adfd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6c7b3aa-98') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6c7b3aa-98, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:32 user nova-compute[72773]: INFO os_vif [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:fd:fb,bridge_name='br-int',has_traffic_filtering=True,id=b6c7b3aa-98f1-48d5-95e2-d1080cfde93d,network=Network(1a1a40b0-631c-4f41-9ece-17cd713adfd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6c7b3aa-98')
Aug 16 22:48:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eYTcvEMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:48:32 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:48:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eac1b2c-4dbe-4ce9-a622-90b5a67529b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1debf385-ac7b-42ae-9fee-c4b5c89188a1]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:48:32 user nova-compute[72773]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)
Aug 16 22:48:32 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:48:32 user nova-compute[72773]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)
Aug 16 22:48:32 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef5c442440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9'): ({'sdb'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Removing single pathed devices sdb {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4d14b3-1d4f-4094-b872-ec32b287fe0b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df24e46-779a-4dad-92e7-450cb5fca659]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Flushing IO for device /dev/sdb {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00c156b-c2aa-4eff-be2e-08264111d451]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b33363-be9f-485b-b5be-7331372b4b38]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] SCSI volumes sdb have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26230323834303136', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a1aa5af9', '/dev/disk/by-id/scsi-1SCST_BIOa1aa5af9-b02840166950eb26') {{(pid=83955) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1f9abd-9b1e-4a1a-a8e7-76f987bfa94b]: (4, None) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0151e1a7-2f43-44ca-bd96-a3002a05714b]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbba4c1c-dcf6-499b-9612-4f55f6e44920]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9, portal: 172.16.0.220,3260]
Aug 16 22:48:32 user nova-compute[72773]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9, portal: 172.16.0.220,3260] successful.
Aug 16 22:48:32 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[884aef5c-20df-4d2a-9b61-ac9548ce5069]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] <== disconnect_volume: return (302ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:48:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:48:33 user nova-compute[72773]: DEBUG nova.network.neutron [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Port b6c7b3aa-98f1-48d5-95e2-d1080cfde93d binding to destination host user is already ACTIVE {{(pid=72773) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 16 22:48:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:48:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:48:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:48:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "refresh_cache-43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:48:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquired lock "refresh_cache-43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:48:34 user nova-compute[72773]: DEBUG nova.network.neutron [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:48:34 user nova-compute[72773]: DEBUG nova.compute.manager [req-68cb989d-c51c-4189-b03c-fcd42ef9c306 req-345ee88d-adc8-462f-a7bc-8b33ae692064 service nova] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Received event network-vif-plugged-b6c7b3aa-98f1-48d5-95e2-d1080cfde93d {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:48:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-68cb989d-c51c-4189-b03c-fcd42ef9c306 req-345ee88d-adc8-462f-a7bc-8b33ae692064 service nova] Acquiring lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:48:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-68cb989d-c51c-4189-b03c-fcd42ef9c306 req-345ee88d-adc8-462f-a7bc-8b33ae692064 service nova] Lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:48:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-68cb989d-c51c-4189-b03c-fcd42ef9c306 req-345ee88d-adc8-462f-a7bc-8b33ae692064 service nova] Lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:48:34 user nova-compute[72773]: DEBUG nova.compute.manager [req-68cb989d-c51c-4189-b03c-fcd42ef9c306 req-345ee88d-adc8-462f-a7bc-8b33ae692064 service nova] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] No waiting events found dispatching network-vif-plugged-b6c7b3aa-98f1-48d5-95e2-d1080cfde93d {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:48:34 user nova-compute[72773]: WARNING nova.compute.manager [req-68cb989d-c51c-4189-b03c-fcd42ef9c306 req-345ee88d-adc8-462f-a7bc-8b33ae692064 service nova] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Received unexpected event network-vif-plugged-b6c7b3aa-98f1-48d5-95e2-d1080cfde93d for instance with vm_state active and task_state resize_migrated.
Aug 16 22:48:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:34 user nova-compute[72773]: DEBUG nova.network.neutron [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Updating instance_info_cache with network_info: [{"id": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "address": "fa:16:3e:e2:fd:fb", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c7b3aa-98", "ovs_interfaceid": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:48:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Releasing lock "refresh_cache-43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:48:34 user nova-compute[72773]: DEBUG os_brick.utils [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:48:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0996147-2869-4a38-abb1-a41f4bd4ba5a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:48:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5f38f8-a4c1-4cdf-9e89-08599bb2c070]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:48:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d42d7c-a050-415f-b57d-563a8a682380]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:48:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d3cc67-f087-4d25-a3f6-a366f2612142]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:48:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:48:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:48:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:48:34 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:48:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffcd774-8064-4bcb-9a57-5977b1653bd2]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:48:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:48:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:48:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:48:34 user nova-compute[72773]: DEBUG os_brick.utils [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:48:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:48:43 user nova-compute[72773]: DEBUG nova.compute.manager [req-0e28bf34-8616-4eac-8518-cb6baa939099 req-b8b8e8d9-1052-4f43-99e6-1550c92e6416 service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Received event network-changed-1b80812a-4fad-4669-83d7-fae725016671 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:48:43 user nova-compute[72773]: DEBUG nova.compute.manager [req-0e28bf34-8616-4eac-8518-cb6baa939099 req-b8b8e8d9-1052-4f43-99e6-1550c92e6416 service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Refreshing instance network info cache due to event network-changed-1b80812a-4fad-4669-83d7-fae725016671. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:48:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0e28bf34-8616-4eac-8518-cb6baa939099 req-b8b8e8d9-1052-4f43-99e6-1550c92e6416 service nova] Acquiring lock "refresh_cache-bc6fff46-be38-4089-a6ba-de75e0d7baab" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:48:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0e28bf34-8616-4eac-8518-cb6baa939099 req-b8b8e8d9-1052-4f43-99e6-1550c92e6416 service nova] Acquired lock "refresh_cache-bc6fff46-be38-4089-a6ba-de75e0d7baab" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:48:43 user nova-compute[72773]: DEBUG nova.network.neutron [req-0e28bf34-8616-4eac-8518-cb6baa939099 req-b8b8e8d9-1052-4f43-99e6-1550c92e6416 service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Refreshing network info cache for port 1b80812a-4fad-4669-83d7-fae725016671 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:48:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Acquiring lock "bc6fff46-be38-4089-a6ba-de75e0d7baab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:48:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "bc6fff46-be38-4089-a6ba-de75e0d7baab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:48:44 user nova-compute[72773]: DEBUG nova.objects.instance [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lazy-loading 'flavor' on Instance uuid bc6fff46-be38-4089-a6ba-de75e0d7baab {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:48:44 user nova-compute[72773]: DEBUG nova.network.neutron [req-0e28bf34-8616-4eac-8518-cb6baa939099 req-b8b8e8d9-1052-4f43-99e6-1550c92e6416 service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Updated VIF entry in instance network info cache for port 1b80812a-4fad-4669-83d7-fae725016671. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:48:44 user nova-compute[72773]: DEBUG nova.network.neutron [req-0e28bf34-8616-4eac-8518-cb6baa939099 req-b8b8e8d9-1052-4f43-99e6-1550c92e6416 service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Updating instance_info_cache with network_info: [{"id": "1b80812a-4fad-4669-83d7-fae725016671", "address": "fa:16:3e:87:bb:32", "network": {"id": "f9944803-97d3-451e-ade8-b8cc953c48e3", "bridge": "br-int", "label": "tempest-TestStampPattern-997567034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9da6df5003942baa7e7da93c0e3bc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b80812a-4f", "ovs_interfaceid": "1b80812a-4fad-4669-83d7-fae725016671", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:48:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "bc6fff46-be38-4089-a6ba-de75e0d7baab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:48:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0e28bf34-8616-4eac-8518-cb6baa939099 req-b8b8e8d9-1052-4f43-99e6-1550c92e6416 service nova] Releasing lock "refresh_cache-bc6fff46-be38-4089-a6ba-de75e0d7baab" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:48:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Acquiring lock "bc6fff46-be38-4089-a6ba-de75e0d7baab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:48:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "bc6fff46-be38-4089-a6ba-de75e0d7baab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:48:44 user nova-compute[72773]: INFO nova.compute.manager [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Attaching volume 9ef9c815-e411-47e2-a7c3-6dd2c377c5ea to /dev/vdb
Aug 16 22:48:44 user nova-compute[72773]: DEBUG os_brick.utils [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:48:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e2f964-7201-4d81-8d5f-44f6f565d168]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:48:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8fdd15-ef07-4a1f-84c2-bd3640c63d34]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:48:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b4a139-cdb5-401a-af0f-52989bcaf532]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:48:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1637ed8-4537-4fe9-a49c-bd077cda7626]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:48:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:48:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:48:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:48:44 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:48:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8d6980-29f1-42da-8f99-5a1734c0a716]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:48:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:48:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:48:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:48:44 user nova-compute[72773]: DEBUG os_brick.utils [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:48:44 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Updating existing volume attachment record: e1241352-3f39-4f40-8a06-a9c4f002f21f {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Starting finish_migration {{(pid=72773) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Instance directory exists: not creating {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 22:48:45 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Creating image(s)
Aug 16 22:48:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Did not create local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Ensure instance console log exists: /opt/stack/data/nova/instances/43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Start _get_guest_xml network_info=[{"id": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "address": "fa:16:3e:e2:fd:fb", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1882521174-network", "vif_mac": "fa:16:3e:e2:fd:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c7b3aa-98", "ovs_interfaceid": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b192cba7-f5a4-41ee-939a-9c17ef6afc64', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eYTcvEMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1', 'attached_at': '2023-08-16T22:48:45.000000', 'detached_at': '', 'volume_id': 'a86656d3-d9ce-4fe1-80ad-025c266d87d9', 'serial': 'a86656d3-d9ce-4fe1-80ad-025c266d87d9'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:48:45 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:48:45 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:48:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:21:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG nova.objects.instance [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lazy-loading 'vcpu_model' on Instance uuid 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eYTcvEMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:48:45 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:48:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:48:45 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:48:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:48:45 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4325b3-3c97-4dbb-8bd9-9964af756eb7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:48:45 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7aa45d-d635-4cea-97ae-62afc07c9d3d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9] added
Aug 16 22:48:45 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d176952-57a8-48be-b07e-77892b758f2b]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e538e2-a60e-4695-9e8f-2d9a4b80cf34]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eYTcvEMN {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eYTcvEMN" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9724b77b-7935-4269-b23a-d96707850ce1]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eYTcvEMN'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a133b39b-0579-4b42-bb10-22d7984938b8]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[af62d600-92e6-4414-8117-927d3c18e330]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)
Aug 16 22:48:45 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)
Aug 16 22:48:45 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aba4a1b-0e93-49ad-a47c-cf62a781e4f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9, portal: 172.16.0.220,3260]
Aug 16 22:48:45 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9, portal: 172.16.0.220,3260] successful.
Aug 16 22:48:45 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2479f32d-101e-48fc-8697-e07cc8c6d52e]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[67365bbe-ee61-42a0-b454-5686bd6298f9]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)
Aug 16 22:48:45 user nova-compute[72773]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:48:45 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)
Aug 16 22:48:45 user nova-compute[72773]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:48:45 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c68f54-3bfa-4b8e-b99e-8511e6fe2436]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:48:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eYTcvEMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:48:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:48:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26230323834303136', 'path': '/dev/sdb'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:48:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230323834303136', 'path': '/dev/sdb'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:48:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:46:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1934884323',display_name='tempest-ServerActionsTestOtherA-server-1934884323',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1934884323',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8jX+pTxaeDXA5y4Lt3+HYLzwoWoj7w8Q+TaAP2Om+ZW/RXrMR/7moMcaLV8Y+iO6BXYhMxPummGFIv4FNE2LpZt+HlA5XAu1WYM2d9vz6WjOr3TWc3giU1qDh4/LEA9A==',key_name='tempest-keypair-283817410',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:46:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e3dc03400ff4448682ebba991a7e8af6',ramdisk_id='',reservation_id='r-p7bzcemu',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1807466388',owner_user_name='tempest-ServerActionsTestOtherA-1807466388-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:48:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02982f15d1a640a5bc77069a906f3e9a',uuid=43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "address": "fa:16:3e:e2:fd:fb", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1882521174-network", "vif_mac": "fa:16:3e:e2:fd:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c7b3aa-98", "ovs_interfaceid": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:48:46 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Converting VIF {"id": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "address": "fa:16:3e:e2:fd:fb", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1882521174-network", "vif_mac": "fa:16:3e:e2:fd:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c7b3aa-98", "ovs_interfaceid": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:48:46 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:fd:fb,bridge_name='br-int',has_traffic_filtering=True,id=b6c7b3aa-98f1-48d5-95e2-d1080cfde93d,network=Network(1a1a40b0-631c-4f41-9ece-17cd713adfd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6c7b3aa-98') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:48:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:48:46 user nova-compute[72773]:   <uuid>43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1</uuid>
Aug 16 22:48:46 user nova-compute[72773]:   <name>instance-00000028</name>
Aug 16 22:48:46 user nova-compute[72773]:   <memory>2097152</memory>
Aug 16 22:48:46 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:48:46 user nova-compute[72773]:   <metadata>
Aug 16 22:48:46 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:48:46 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:48:46 user nova-compute[72773]:       <nova:name>tempest-ServerActionsTestOtherA-server-1934884323</nova:name>
Aug 16 22:48:46 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:48:45</nova:creationTime>
Aug 16 22:48:46 user nova-compute[72773]:       <nova:flavor name="m1.small">
Aug 16 22:48:46 user nova-compute[72773]:         <nova:memory>2048</nova:memory>
Aug 16 22:48:46 user nova-compute[72773]:         <nova:disk>20</nova:disk>
Aug 16 22:48:46 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:48:46 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:48:46 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:48:46 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:48:46 user nova-compute[72773]:       <nova:owner>
Aug 16 22:48:46 user nova-compute[72773]:         <nova:user uuid="02982f15d1a640a5bc77069a906f3e9a">tempest-ServerActionsTestOtherA-1807466388-project-member</nova:user>
Aug 16 22:48:46 user nova-compute[72773]:         <nova:project uuid="e3dc03400ff4448682ebba991a7e8af6">tempest-ServerActionsTestOtherA-1807466388</nova:project>
Aug 16 22:48:46 user nova-compute[72773]:       </nova:owner>
Aug 16 22:48:46 user nova-compute[72773]:       <nova:ports>
Aug 16 22:48:46 user nova-compute[72773]:         <nova:port uuid="b6c7b3aa-98f1-48d5-95e2-d1080cfde93d">
Aug 16 22:48:46 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 22:48:46 user nova-compute[72773]:         </nova:port>
Aug 16 22:48:46 user nova-compute[72773]:       </nova:ports>
Aug 16 22:48:46 user nova-compute[72773]:     </nova:instance>
Aug 16 22:48:46 user nova-compute[72773]:   </metadata>
Aug 16 22:48:46 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:48:46 user nova-compute[72773]:     <system>
Aug 16 22:48:46 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:48:46 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:48:46 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:48:46 user nova-compute[72773]:       <entry name="serial">43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1</entry>
Aug 16 22:48:46 user nova-compute[72773]:       <entry name="uuid">43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1</entry>
Aug 16 22:48:46 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:48:46 user nova-compute[72773]:     </system>
Aug 16 22:48:46 user nova-compute[72773]:   </sysinfo>
Aug 16 22:48:46 user nova-compute[72773]:   <os>
Aug 16 22:48:46 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:48:46 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:48:46 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:48:46 user nova-compute[72773]:   </os>
Aug 16 22:48:46 user nova-compute[72773]:   <features>
Aug 16 22:48:46 user nova-compute[72773]:     <acpi/>
Aug 16 22:48:46 user nova-compute[72773]:     <apic/>
Aug 16 22:48:46 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:48:46 user nova-compute[72773]:   </features>
Aug 16 22:48:46 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:48:46 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:48:46 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:48:46 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:48:46 user nova-compute[72773]:   </clock>
Aug 16 22:48:46 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:48:46 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:48:46 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:48:46 user nova-compute[72773]:   </cpu>
Aug 16 22:48:46 user nova-compute[72773]:   <devices>
Aug 16 22:48:46 user nova-compute[72773]:     <disk type="block" device="disk">
Aug 16 22:48:46 user nova-compute[72773]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:48:46 user nova-compute[72773]:       <source dev="/dev/sdb"/>
Aug 16 22:48:46 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:48:46 user nova-compute[72773]:       <serial>a86656d3-d9ce-4fe1-80ad-025c266d87d9</serial>
Aug 16 22:48:46 user nova-compute[72773]:     </disk>
Aug 16 22:48:46 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:48:46 user nova-compute[72773]:       <mac address="fa:16:3e:e2:fd:fb"/>
Aug 16 22:48:46 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:48:46 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:48:46 user nova-compute[72773]:       <target dev="tapb6c7b3aa-98"/>
Aug 16 22:48:46 user nova-compute[72773]:     </interface>
Aug 16 22:48:46 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:48:46 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1/console.log" append="off"/>
Aug 16 22:48:46 user nova-compute[72773]:     </serial>
Aug 16 22:48:46 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:48:46 user nova-compute[72773]:     <video>
Aug 16 22:48:46 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:48:46 user nova-compute[72773]:     </video>
Aug 16 22:48:46 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:48:46 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:48:46 user nova-compute[72773]:     </rng>
Aug 16 22:48:46 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:48:46 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:48:46 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:48:46 user nova-compute[72773]:     </memballoon>
Aug 16 22:48:46 user nova-compute[72773]:   </devices>
Aug 16 22:48:46 user nova-compute[72773]: </domain>
Aug 16 22:48:46 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:48:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:46:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1934884323',display_name='tempest-ServerActionsTestOtherA-server-1934884323',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1934884323',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8jX+pTxaeDXA5y4Lt3+HYLzwoWoj7w8Q+TaAP2Om+ZW/RXrMR/7moMcaLV8Y+iO6BXYhMxPummGFIv4FNE2LpZt+HlA5XAu1WYM2d9vz6WjOr3TWc3giU1qDh4/LEA9A==',key_name='tempest-keypair-283817410',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:46:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e3dc03400ff4448682ebba991a7e8af6',ramdisk_id='',reservation_id='r-p7bzcemu',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1807466388',owner_user_name='tempest-ServerActionsTestOtherA-1807466388-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:48:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02982f15d1a640a5bc77069a906f3e9a',uuid=43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "address": "fa:16:3e:e2:fd:fb", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1882521174-network", "vif_mac": "fa:16:3e:e2:fd:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c7b3aa-98", "ovs_interfaceid": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:48:46 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Converting VIF {"id": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "address": "fa:16:3e:e2:fd:fb", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1882521174-network", "vif_mac": "fa:16:3e:e2:fd:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c7b3aa-98", "ovs_interfaceid": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:48:46 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:fd:fb,bridge_name='br-int',has_traffic_filtering=True,id=b6c7b3aa-98f1-48d5-95e2-d1080cfde93d,network=Network(1a1a40b0-631c-4f41-9ece-17cd713adfd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6c7b3aa-98') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:48:46 user nova-compute[72773]: DEBUG os_vif [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:fd:fb,bridge_name='br-int',has_traffic_filtering=True,id=b6c7b3aa-98f1-48d5-95e2-d1080cfde93d,network=Network(1a1a40b0-631c-4f41-9ece-17cd713adfd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6c7b3aa-98') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:48:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:48:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:48:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6c7b3aa-98, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:48:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb6c7b3aa-98, col_values=(('external_ids', {'iface-id': 'b6c7b3aa-98f1-48d5-95e2-d1080cfde93d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:fd:fb', 'vm-uuid': '43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:48:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:48:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:47 user nova-compute[72773]: INFO os_vif [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:fd:fb,bridge_name='br-int',has_traffic_filtering=True,id=b6c7b3aa-98f1-48d5-95e2-d1080cfde93d,network=Network(1a1a40b0-631c-4f41-9ece-17cd713adfd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6c7b3aa-98')
Aug 16 22:48:47 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:48:47 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] No VIF found with MAC fa:16:3e:e2:fd:fb, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:48:47 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692226112.3589983, 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:48:47 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] VM Stopped (Lifecycle Event)
Aug 16 22:48:47 user nova-compute[72773]: DEBUG nova.compute.manager [None req-3d63c2e7-57c2-4126-aa32-1cecb2a278b2 None None] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:48:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:48 user nova-compute[72773]: DEBUG nova.compute.manager [req-dc240c15-0beb-4c2b-b28b-7a8c404986cd req-8f2a81f3-5117-4fed-9ba4-a8354a9cb744 service nova] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Received event network-vif-plugged-b6c7b3aa-98f1-48d5-95e2-d1080cfde93d {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:48:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-dc240c15-0beb-4c2b-b28b-7a8c404986cd req-8f2a81f3-5117-4fed-9ba4-a8354a9cb744 service nova] Acquiring lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:48:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-dc240c15-0beb-4c2b-b28b-7a8c404986cd req-8f2a81f3-5117-4fed-9ba4-a8354a9cb744 service nova] Lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:48:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-dc240c15-0beb-4c2b-b28b-7a8c404986cd req-8f2a81f3-5117-4fed-9ba4-a8354a9cb744 service nova] Lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:48:48 user nova-compute[72773]: DEBUG nova.compute.manager [req-dc240c15-0beb-4c2b-b28b-7a8c404986cd req-8f2a81f3-5117-4fed-9ba4-a8354a9cb744 service nova] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] No waiting events found dispatching network-vif-plugged-b6c7b3aa-98f1-48d5-95e2-d1080cfde93d {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:48:48 user nova-compute[72773]: WARNING nova.compute.manager [req-dc240c15-0beb-4c2b-b28b-7a8c404986cd req-8f2a81f3-5117-4fed-9ba4-a8354a9cb744 service nova] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Received unexpected event network-vif-plugged-b6c7b3aa-98f1-48d5-95e2-d1080cfde93d for instance with vm_state active and task_state resize_finish.
Aug 16 22:48:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:50 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692226130.6017754, 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:48:50 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] VM Resumed (Lifecycle Event)
Aug 16 22:48:50 user nova-compute[72773]: DEBUG nova.compute.manager [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:48:50 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Instance running successfully.
Aug 16 22:48:50 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Failed to set time: agent not configured {{(pid=72773) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 16 22:48:50 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-8d81c1a0-4fc6-4048-b84d-662a14ed4ab8 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] finish_migration finished successfully. {{(pid=72773) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 16 22:48:50 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:48:50 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:48:50 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 22:48:50 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692226130.6038723, 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:48:50 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] VM Started (Lifecycle Event)
Aug 16 22:48:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:50 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:48:50 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:48:50 user nova-compute[72773]: DEBUG nova.compute.manager [req-ac68163e-6e01-47b2-a0bd-b76ef9a01728 req-b3bde449-d463-49c3-abfb-df3e081f4e23 service nova] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Received event network-vif-plugged-b6c7b3aa-98f1-48d5-95e2-d1080cfde93d {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:48:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ac68163e-6e01-47b2-a0bd-b76ef9a01728 req-b3bde449-d463-49c3-abfb-df3e081f4e23 service nova] Acquiring lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:48:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ac68163e-6e01-47b2-a0bd-b76ef9a01728 req-b3bde449-d463-49c3-abfb-df3e081f4e23 service nova] Lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:48:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ac68163e-6e01-47b2-a0bd-b76ef9a01728 req-b3bde449-d463-49c3-abfb-df3e081f4e23 service nova] Lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:48:50 user nova-compute[72773]: DEBUG nova.compute.manager [req-ac68163e-6e01-47b2-a0bd-b76ef9a01728 req-b3bde449-d463-49c3-abfb-df3e081f4e23 service nova] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] No waiting events found dispatching network-vif-plugged-b6c7b3aa-98f1-48d5-95e2-d1080cfde93d {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:48:50 user nova-compute[72773]: WARNING nova.compute.manager [req-ac68163e-6e01-47b2-a0bd-b76ef9a01728 req-b3bde449-d463-49c3-abfb-df3e081f4e23 service nova] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Received unexpected event network-vif-plugged-b6c7b3aa-98f1-48d5-95e2-d1080cfde93d for instance with vm_state active and task_state resize_finish.
Aug 16 22:48:50 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 22:48:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e4fbb1a4-d6a7-4081-80b1-86be2f5e8462 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:48:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e4fbb1a4-d6a7-4081-80b1-86be2f5e8462 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:48:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e4fbb1a4-d6a7-4081-80b1-86be2f5e8462 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:48:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e4fbb1a4-d6a7-4081-80b1-86be2f5e8462 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:48:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e4fbb1a4-d6a7-4081-80b1-86be2f5e8462 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:48:56 user nova-compute[72773]: INFO nova.compute.manager [None req-e4fbb1a4-d6a7-4081-80b1-86be2f5e8462 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Terminating instance
Aug 16 22:48:56 user nova-compute[72773]: DEBUG nova.compute.manager [None req-e4fbb1a4-d6a7-4081-80b1-86be2f5e8462 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:48:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:56 user nova-compute[72773]: DEBUG nova.compute.manager [req-2b0ed78b-3225-490c-8d49-d2aa1cf353a8 req-6bbf0b88-42e6-4fa0-8ae9-f9f6670ea022 service nova] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Received event network-vif-unplugged-96243341-8834-4a23-9bf3-964374e14014 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:48:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2b0ed78b-3225-490c-8d49-d2aa1cf353a8 req-6bbf0b88-42e6-4fa0-8ae9-f9f6670ea022 service nova] Acquiring lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:48:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2b0ed78b-3225-490c-8d49-d2aa1cf353a8 req-6bbf0b88-42e6-4fa0-8ae9-f9f6670ea022 service nova] Lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:48:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2b0ed78b-3225-490c-8d49-d2aa1cf353a8 req-6bbf0b88-42e6-4fa0-8ae9-f9f6670ea022 service nova] Lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:48:56 user nova-compute[72773]: DEBUG nova.compute.manager [req-2b0ed78b-3225-490c-8d49-d2aa1cf353a8 req-6bbf0b88-42e6-4fa0-8ae9-f9f6670ea022 service nova] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] No waiting events found dispatching network-vif-unplugged-96243341-8834-4a23-9bf3-964374e14014 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:48:56 user nova-compute[72773]: DEBUG nova.compute.manager [req-2b0ed78b-3225-490c-8d49-d2aa1cf353a8 req-6bbf0b88-42e6-4fa0-8ae9-f9f6670ea022 service nova] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Received event network-vif-unplugged-96243341-8834-4a23-9bf3-964374e14014 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:48:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:57 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Instance destroyed successfully.
Aug 16 22:48:57 user nova-compute[72773]: DEBUG nova.objects.instance [None req-e4fbb1a4-d6a7-4081-80b1-86be2f5e8462 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lazy-loading 'resources' on Instance uuid cf01c401-c424-4b3e-aa5b-439d62b1ae4c {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:48:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-e4fbb1a4-d6a7-4081-80b1-86be2f5e8462 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:32:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1457796534',display_name='tempest-ServerRescueNegativeTestJSON-server-1457796534',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1457796534',id=22,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:34:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f8e068df8094356b16a6480cd231675',ramdisk_id='',reservation_id='r-erb87mkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1754829282',owner_user_name='tempest-ServerRescueNegativeTestJSON-1754829282-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:34:00Z,user_data=None,user_id='62e5b77a149140fd8613d566f41cc23d',uuid=cf01c401-c424-4b3e-aa5b-439d62b1ae4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "96243341-8834-4a23-9bf3-964374e14014", "address": "fa:16:3e:c6:b4:53", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96243341-88", "ovs_interfaceid": "96243341-8834-4a23-9bf3-964374e14014", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:48:57 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-e4fbb1a4-d6a7-4081-80b1-86be2f5e8462 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Converting VIF {"id": "96243341-8834-4a23-9bf3-964374e14014", "address": "fa:16:3e:c6:b4:53", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96243341-88", "ovs_interfaceid": "96243341-8834-4a23-9bf3-964374e14014", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:48:57 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-e4fbb1a4-d6a7-4081-80b1-86be2f5e8462 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:b4:53,bridge_name='br-int',has_traffic_filtering=True,id=96243341-8834-4a23-9bf3-964374e14014,network=Network(8a43bbad-aab2-44c9-a7e4-62696d908234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96243341-88') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:48:57 user nova-compute[72773]: DEBUG os_vif [None req-e4fbb1a4-d6a7-4081-80b1-86be2f5e8462 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:b4:53,bridge_name='br-int',has_traffic_filtering=True,id=96243341-8834-4a23-9bf3-964374e14014,network=Network(8a43bbad-aab2-44c9-a7e4-62696d908234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96243341-88') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:48:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96243341-88, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:48:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:48:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:48:57 user nova-compute[72773]: INFO os_vif [None req-e4fbb1a4-d6a7-4081-80b1-86be2f5e8462 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:b4:53,bridge_name='br-int',has_traffic_filtering=True,id=96243341-8834-4a23-9bf3-964374e14014,network=Network(8a43bbad-aab2-44c9-a7e4-62696d908234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96243341-88')
Aug 16 22:48:57 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-e4fbb1a4-d6a7-4081-80b1-86be2f5e8462 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Deleting instance files /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c_del
Aug 16 22:48:57 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-e4fbb1a4-d6a7-4081-80b1-86be2f5e8462 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Deletion of /opt/stack/data/nova/instances/cf01c401-c424-4b3e-aa5b-439d62b1ae4c_del complete
Aug 16 22:48:57 user nova-compute[72773]: INFO nova.compute.manager [None req-e4fbb1a4-d6a7-4081-80b1-86be2f5e8462 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 16 22:48:57 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-e4fbb1a4-d6a7-4081-80b1-86be2f5e8462 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:48:57 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:48:57 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:48:57 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:48:58 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Took 0.55 seconds to deallocate network for instance.
Aug 16 22:48:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-b734baa8-5160-4f55-8dd2-461f94676795 req-f9ee91d7-99ff-40a1-972b-2fd58bd7f3b7 service nova] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Received event network-vif-deleted-96243341-8834-4a23-9bf3-964374e14014 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:48:58 user nova-compute[72773]: INFO nova.compute.manager [req-b734baa8-5160-4f55-8dd2-461f94676795 req-f9ee91d7-99ff-40a1-972b-2fd58bd7f3b7 service nova] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Neutron deleted interface 96243341-8834-4a23-9bf3-964374e14014; detaching it from the instance and deleting it from the info cache
Aug 16 22:48:58 user nova-compute[72773]: DEBUG nova.network.neutron [req-b734baa8-5160-4f55-8dd2-461f94676795 req-f9ee91d7-99ff-40a1-972b-2fd58bd7f3b7 service nova] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:48:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-b734baa8-5160-4f55-8dd2-461f94676795 req-f9ee91d7-99ff-40a1-972b-2fd58bd7f3b7 service nova] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Detach interface failed, port_id=96243341-8834-4a23-9bf3-964374e14014, reason: Instance cf01c401-c424-4b3e-aa5b-439d62b1ae4c could not be found. {{(pid=72773) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 22:48:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e4fbb1a4-d6a7-4081-80b1-86be2f5e8462 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:48:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e4fbb1a4-d6a7-4081-80b1-86be2f5e8462 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:48:58 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-e4fbb1a4-d6a7-4081-80b1-86be2f5e8462 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:48:58 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-e4fbb1a4-d6a7-4081-80b1-86be2f5e8462 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:48:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e4fbb1a4-d6a7-4081-80b1-86be2f5e8462 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:48:58 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-e4fbb1a4-d6a7-4081-80b1-86be2f5e8462 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Deleted allocations for instance cf01c401-c424-4b3e-aa5b-439d62b1ae4c
Aug 16 22:48:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e4fbb1a4-d6a7-4081-80b1-86be2f5e8462 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.986s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:48:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-8c59cc32-410c-4cc1-98d5-4f7c11f0f6c1 req-7675f5b2-2674-4b7b-884d-43c5b204aa42 service nova] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Received event network-vif-plugged-96243341-8834-4a23-9bf3-964374e14014 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:48:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-8c59cc32-410c-4cc1-98d5-4f7c11f0f6c1 req-7675f5b2-2674-4b7b-884d-43c5b204aa42 service nova] Acquiring lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:48:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-8c59cc32-410c-4cc1-98d5-4f7c11f0f6c1 req-7675f5b2-2674-4b7b-884d-43c5b204aa42 service nova] Lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:48:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-8c59cc32-410c-4cc1-98d5-4f7c11f0f6c1 req-7675f5b2-2674-4b7b-884d-43c5b204aa42 service nova] Lock "cf01c401-c424-4b3e-aa5b-439d62b1ae4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:48:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-8c59cc32-410c-4cc1-98d5-4f7c11f0f6c1 req-7675f5b2-2674-4b7b-884d-43c5b204aa42 service nova] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] No waiting events found dispatching network-vif-plugged-96243341-8834-4a23-9bf3-964374e14014 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:48:58 user nova-compute[72773]: WARNING nova.compute.manager [req-8c59cc32-410c-4cc1-98d5-4f7c11f0f6c1 req-7675f5b2-2674-4b7b-884d-43c5b204aa42 service nova] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Received unexpected event network-vif-plugged-96243341-8834-4a23-9bf3-964374e14014 for instance with vm_state deleted and task_state None.
Aug 16 22:48:59 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:49:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:49:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hlkFSICB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:49:03 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:49:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:49:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:49:03 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:49:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:49:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:49:03 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:49:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:03 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fd7a68-3939-4df1-a66b-c34d3bf66f7b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:49:03 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:49:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b01f32-eab8-45de-8ceb-0f33408122d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea] added
Aug 16 22:49:04 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa1a177-eb69-4e69-afc7-10f51f037ed6]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ee1af1-f81e-41cd-a7e8-2cf6ee802382]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hlkFSICB {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hlkFSICB" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6865488-8580-490a-b81f-350e05dd5f71]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hlkFSICB'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[67596834-b78e-4aad-850e-94bb2e30d0c0]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[251e68a1-f73c-4ec8-8bd5-0b56e9eb2cf1]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)
Aug 16 22:49:04 user nova-compute[72773]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:49:04 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)
Aug 16 22:49:04 user nova-compute[72773]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:49:04 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e88214f-a1ed-4876-8208-fe26cd972573]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea, portal: 172.16.0.220,3260]
Aug 16 22:49:04 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea, portal: 172.16.0.220,3260] successful.
Aug 16 22:49:04 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c17ab4-b682-48d6-be0f-dc33dbdfa73b]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[330e6dde-1f19-4478-b1be-a1871698680f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)
Aug 16 22:49:04 user nova-compute[72773]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:49:04 user nova-compute[72773]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea (non-flash)
Aug 16 22:49:04 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)
Aug 16 22:49:04 user nova-compute[72773]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:49:04 user nova-compute[72773]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea (non-flash)
Aug 16 22:49:04 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d763826-a42f-405e-9ffc-b064814c1aef]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:04 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: None {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:49:05 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:49:05 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hlkFSICB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:49:05 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:49:05 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26634333163356463', 'path': '/dev/sdd'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:49:05 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634333163356463', 'path': '/dev/sdd'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:49:05 user nova-compute[72773]: DEBUG nova.objects.instance [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lazy-loading 'flavor' on Instance uuid bc6fff46-be38-4089-a6ba-de75e0d7baab {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:49:05 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 22:49:05 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:49:05 user nova-compute[72773]:   <source dev="/dev/sdd"/>
Aug 16 22:49:05 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:49:05 user nova-compute[72773]:   <serial>9ef9c815-e411-47e2-a7c3-6dd2c377c5ea</serial>
Aug 16 22:49:05 user nova-compute[72773]: </disk>
Aug 16 22:49:05 user nova-compute[72773]:  {{(pid=72773) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 22:49:05 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:49:05 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:49:05 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Rebuilding the list of instances to heal {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 22:49:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-391a6006-4fe6-4398-a1e8-ae95b5edbf2b" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:49:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-391a6006-4fe6-4398-a1e8-ae95b5edbf2b" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:49:05 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 22:49:05 user nova-compute[72773]: DEBUG nova.objects.instance [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lazy-loading 'info_cache' on Instance uuid 391a6006-4fe6-4398-a1e8-ae95b5edbf2b {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:49:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:05 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:49:05 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:49:05 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] No VIF found with MAC fa:16:3e:87:bb:32, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:49:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-04ce877f-60ca-47d8-a705-851753c70b58 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "bc6fff46-be38-4089-a6ba-de75e0d7baab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.341s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:49:05 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Updating instance_info_cache with network_info: [{"id": "6961298d-d62e-4f7b-b97e-4198a325816c", "address": "fa:16:3e:2d:58:d4", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6961298d-d6", "ovs_interfaceid": "6961298d-d62e-4f7b-b97e-4198a325816c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:49:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-391a6006-4fe6-4398-a1e8-ae95b5edbf2b" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:49:06 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 22:49:06 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:49:06 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:49:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:07 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:49:07 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:49:07 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:49:07 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:49:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-38557d9f-5017-4bb2-8518-5eecc5e5b6d1 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Acquiring lock "bc6fff46-be38-4089-a6ba-de75e0d7baab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:49:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-38557d9f-5017-4bb2-8518-5eecc5e5b6d1 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "bc6fff46-be38-4089-a6ba-de75e0d7baab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:49:08 user nova-compute[72773]: INFO nova.compute.manager [None req-38557d9f-5017-4bb2-8518-5eecc5e5b6d1 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Detaching volume 9ef9c815-e411-47e2-a7c3-6dd2c377c5ea
Aug 16 22:49:08 user nova-compute[72773]: INFO nova.virt.block_device [None req-38557d9f-5017-4bb2-8518-5eecc5e5b6d1 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Attempting to driver detach volume 9ef9c815-e411-47e2-a7c3-6dd2c377c5ea from mountpoint /dev/vdb
Aug 16 22:49:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-38557d9f-5017-4bb2-8518-5eecc5e5b6d1 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Attempting to detach device vdb from instance bc6fff46-be38-4089-a6ba-de75e0d7baab from the persistent domain config. {{(pid=72773) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 22:49:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-38557d9f-5017-4bb2-8518-5eecc5e5b6d1 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:49:08 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:49:08 user nova-compute[72773]:   <source dev="/dev/sdd"/>
Aug 16 22:49:08 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:49:08 user nova-compute[72773]:   <serial>9ef9c815-e411-47e2-a7c3-6dd2c377c5ea</serial>
Aug 16 22:49:08 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:49:08 user nova-compute[72773]: </disk>
Aug 16 22:49:08 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:49:08 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-38557d9f-5017-4bb2-8518-5eecc5e5b6d1 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Successfully detached device vdb from instance bc6fff46-be38-4089-a6ba-de75e0d7baab from the persistent domain config.
Aug 16 22:49:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-38557d9f-5017-4bb2-8518-5eecc5e5b6d1 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bc6fff46-be38-4089-a6ba-de75e0d7baab from the live domain config. {{(pid=72773) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 22:49:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-38557d9f-5017-4bb2-8518-5eecc5e5b6d1 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:49:08 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:49:08 user nova-compute[72773]:   <source dev="/dev/sdd"/>
Aug 16 22:49:08 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:49:08 user nova-compute[72773]:   <serial>9ef9c815-e411-47e2-a7c3-6dd2c377c5ea</serial>
Aug 16 22:49:08 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:49:08 user nova-compute[72773]: </disk>
Aug 16 22:49:08 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Received event <DeviceRemovedEvent: 1692226149.1386757, bc6fff46-be38-4089-a6ba-de75e0d7baab => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72773) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-38557d9f-5017-4bb2-8518-5eecc5e5b6d1 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bc6fff46-be38-4089-a6ba-de75e0d7baab {{(pid=72773) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 22:49:09 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-38557d9f-5017-4bb2-8518-5eecc5e5b6d1 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Successfully detached device vdb from instance bc6fff46-be38-4089-a6ba-de75e0d7baab from the live domain config.
Aug 16 22:49:09 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38557d9f-5017-4bb2-8518-5eecc5e5b6d1 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-38557d9f-5017-4bb2-8518-5eecc5e5b6d1 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hlkFSICB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:49:09 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-38557d9f-5017-4bb2-8518-5eecc5e5b6d1 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:49:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-38557d9f-5017-4bb2-8518-5eecc5e5b6d1 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-38557d9f-5017-4bb2-8518-5eecc5e5b6d1 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-38557d9f-5017-4bb2-8518-5eecc5e5b6d1 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb46455f-e1fd-48f0-967e-9217c30a7103]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[86249f5e-5a62-43d0-a4a6-7655d01fa79f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-38557d9f-5017-4bb2-8518-5eecc5e5b6d1 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)
Aug 16 22:49:09 user nova-compute[72773]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:49:09 user nova-compute[72773]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea (non-flash)
Aug 16 22:49:09 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-38557d9f-5017-4bb2-8518-5eecc5e5b6d1 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)
Aug 16 22:49:09 user nova-compute[72773]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:49:09 user nova-compute[72773]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea (non-flash)
Aug 16 22:49:09 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-38557d9f-5017-4bb2-8518-5eecc5e5b6d1 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef802bb2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea'): ({'sdd'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-38557d9f-5017-4bb2-8518-5eecc5e5b6d1 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Removing single pathed devices sdd {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27c2aa1-ab82-4365-91f4-fbfe42fccb20]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a5d847-4dbd-41ea-a99d-1ae27f047776]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-38557d9f-5017-4bb2-8518-5eecc5e5b6d1 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Flushing IO for device /dev/sdd {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ea9ea7-c948-4c9e-b89e-bddcb26bdec3]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-38557d9f-5017-4bb2-8518-5eecc5e5b6d1 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9adca1c4-015e-42d7-a5cb-170b8cae378c]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-38557d9f-5017-4bb2-8518-5eecc5e5b6d1 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-38557d9f-5017-4bb2-8518-5eecc5e5b6d1 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] SCSI volumes sdd have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-38557d9f-5017-4bb2-8518-5eecc5e5b6d1 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a51c48-dd0b-45cc-a21b-c9d0f39e3506]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-38557d9f-5017-4bb2-8518-5eecc5e5b6d1 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd5d506-9edc-4f34-8021-d1027ea7a6e0]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-38557d9f-5017-4bb2-8518-5eecc5e5b6d1 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea, portal: 172.16.0.220,3260]
Aug 16 22:49:09 user nova-compute[72773]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea, portal: 172.16.0.220,3260] successful.
Aug 16 22:49:09 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ef9c815-e411-47e2-a7c3-6dd2c377c5ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b2ee01-a70a-43e4-8c9a-114c51fcc1d0]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-38557d9f-5017-4bb2-8518-5eecc5e5b6d1 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-38557d9f-5017-4bb2-8518-5eecc5e5b6d1 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-38557d9f-5017-4bb2-8518-5eecc5e5b6d1 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] <== disconnect_volume: return (272ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:49:09 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38557d9f-5017-4bb2-8518-5eecc5e5b6d1 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:49:10 user nova-compute[72773]: DEBUG nova.objects.instance [None req-38557d9f-5017-4bb2-8518-5eecc5e5b6d1 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lazy-loading 'flavor' on Instance uuid bc6fff46-be38-4089-a6ba-de75e0d7baab {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:49:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-38557d9f-5017-4bb2-8518-5eecc5e5b6d1 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "bc6fff46-be38-4089-a6ba-de75e0d7baab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.689s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:49:10 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:49:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:49:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:49:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:49:10 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:49:10 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:49:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:10 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:49:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:12 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692226137.3270614, cf01c401-c424-4b3e-aa5b-439d62b1ae4c => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:49:12 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] VM Stopped (Lifecycle Event)
Aug 16 22:49:12 user nova-compute[72773]: DEBUG nova.compute.manager [None req-c4b69041-553a-4b0c-bb7b-c8ba4e4c3863 None None] [instance: cf01c401-c424-4b3e-aa5b-439d62b1ae4c] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:49:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:12 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:49:12 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:49:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=8135MB free_disk=25.455867767333984GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:49:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:49:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:49:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Applying migration context for instance 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1 as it has an incoming, in-progress migration 922a93d5-b2fb-4885-a0d0-256608a54a93. Migration status is finished {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 22:49:12 user nova-compute[72773]: INFO nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Updating resource usage from migration 922a93d5-b2fb-4885-a0d0-256608a54a93
Aug 16 22:49:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 391a6006-4fe6-4398-a1e8-ae95b5edbf2b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:49:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance f4210738-d01e-4408-a15c-aeccada6dd23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:49:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance f97d8a95-e281-496b-bb62-81747a5c2ffc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:49:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance bc6fff46-be38-4089-a6ba-de75e0d7baab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:49:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 29c612f4-5ed1-46db-bdec-0eed58384746 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:49:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Migration 922a93d5-b2fb-4885-a0d0-256608a54a93 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 22:49:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:49:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:49:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:49:13 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:49:13 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:49:13 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:49:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.363s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:49:15 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:49:15 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:49:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:49:31 user nova-compute[72773]: DEBUG nova.compute.manager [req-c75db2ea-a513-4503-99cd-5a6f7a66641b req-546a14d1-a789-45dd-b45a-b7574ad6c982 service nova] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Received event network-changed-e184f66d-572d-452b-8675-006aeef3c372 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:49:31 user nova-compute[72773]: DEBUG nova.compute.manager [req-c75db2ea-a513-4503-99cd-5a6f7a66641b req-546a14d1-a789-45dd-b45a-b7574ad6c982 service nova] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Refreshing instance network info cache due to event network-changed-e184f66d-572d-452b-8675-006aeef3c372. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:49:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c75db2ea-a513-4503-99cd-5a6f7a66641b req-546a14d1-a789-45dd-b45a-b7574ad6c982 service nova] Acquiring lock "refresh_cache-29c612f4-5ed1-46db-bdec-0eed58384746" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:49:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c75db2ea-a513-4503-99cd-5a6f7a66641b req-546a14d1-a789-45dd-b45a-b7574ad6c982 service nova] Acquired lock "refresh_cache-29c612f4-5ed1-46db-bdec-0eed58384746" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:49:31 user nova-compute[72773]: DEBUG nova.network.neutron [req-c75db2ea-a513-4503-99cd-5a6f7a66641b req-546a14d1-a789-45dd-b45a-b7574ad6c982 service nova] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Refreshing network info cache for port e184f66d-572d-452b-8675-006aeef3c372 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:49:31 user nova-compute[72773]: DEBUG nova.network.neutron [req-c75db2ea-a513-4503-99cd-5a6f7a66641b req-546a14d1-a789-45dd-b45a-b7574ad6c982 service nova] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Updated VIF entry in instance network info cache for port e184f66d-572d-452b-8675-006aeef3c372. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:49:31 user nova-compute[72773]: DEBUG nova.network.neutron [req-c75db2ea-a513-4503-99cd-5a6f7a66641b req-546a14d1-a789-45dd-b45a-b7574ad6c982 service nova] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Updating instance_info_cache with network_info: [{"id": "e184f66d-572d-452b-8675-006aeef3c372", "address": "fa:16:3e:1b:7d:b0", "network": {"id": "2e9dee37-d081-4059-a22c-e8aa5cacfc75", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2058131931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7bd0a0d273048b68a1f3a800be7da5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape184f66d-57", "ovs_interfaceid": "e184f66d-572d-452b-8675-006aeef3c372", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:49:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c75db2ea-a513-4503-99cd-5a6f7a66641b req-546a14d1-a789-45dd-b45a-b7574ad6c982 service nova] Releasing lock "refresh_cache-29c612f4-5ed1-46db-bdec-0eed58384746" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:49:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Acquiring lock "29c612f4-5ed1-46db-bdec-0eed58384746" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:49:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "29c612f4-5ed1-46db-bdec-0eed58384746" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:49:35 user nova-compute[72773]: DEBUG nova.objects.instance [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lazy-loading 'flavor' on Instance uuid 29c612f4-5ed1-46db-bdec-0eed58384746 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:49:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "29c612f4-5ed1-46db-bdec-0eed58384746" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:49:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Acquiring lock "29c612f4-5ed1-46db-bdec-0eed58384746" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:49:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "29c612f4-5ed1-46db-bdec-0eed58384746" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:49:35 user nova-compute[72773]: INFO nova.compute.manager [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Attaching volume 66e6fafa-e312-4341-a1a4-1c22895cd014 to /dev/vdb
Aug 16 22:49:35 user nova-compute[72773]: DEBUG os_brick.utils [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:49:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:35 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7a85d1-fc67-4af8-b2d0-7947f9bc3a48]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:35 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[804d1abc-002c-4469-b89d-be0f3f638276]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:35 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1843a980-474c-4346-bace-9b93433770d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:35 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60f7a8b-0587-4baa-8e03-cc08598a9358]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:49:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:49:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:35 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:49:35 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:49:35 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[490d38f8-9382-4029-bd9c-cc3471200fe1]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:49:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:49:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:49:35 user nova-compute[72773]: DEBUG os_brick.utils [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:49:35 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Updating existing volume attachment record: c401a4f8-8117-46a5-b1fd-04e29312f845 {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:49:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:40 user nova-compute[72773]: DEBUG nova.objects.instance [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lazy-loading 'flavor' on Instance uuid f97d8a95-e281-496b-bb62-81747a5c2ffc {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:49:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "refresh_cache-f97d8a95-e281-496b-bb62-81747a5c2ffc" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:49:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquired lock "refresh_cache-f97d8a95-e281-496b-bb62-81747a5c2ffc" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:49:40 user nova-compute[72773]: DEBUG nova.network.neutron [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:49:40 user nova-compute[72773]: DEBUG nova.objects.instance [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lazy-loading 'info_cache' on Instance uuid f97d8a95-e281-496b-bb62-81747a5c2ffc {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:49:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG nova.network.neutron [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Updating instance_info_cache with network_info: [{"id": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "address": "fa:16:3e:12:35:93", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0ffcbd-76", "ovs_interfaceid": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Releasing lock "refresh_cache-f97d8a95-e281-496b-bb62-81747a5c2ffc" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:49:41 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Instance destroyed successfully.
Aug 16 22:49:41 user nova-compute[72773]: DEBUG nova.objects.instance [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lazy-loading 'resources' on Instance uuid f97d8a95-e281-496b-bb62-81747a5c2ffc {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-901024509',display_name='tempest-AttachVolumeTestJSON-server-901024509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-901024509',id=39,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMwC80zAC+DDm1/aQS1yIwW3iohkON4IwgRB4Qo30pRKnd56Cla0ZmEd6mFqvSws8dEJWHuZr06ofoAXldMYoVLEZx3MfxCSPNlh2DAJMCkFmy36ylUG4yyQmmfHxBPSw==',key_name='tempest-keypair-1482365818',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:45:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a6da6170d60c4d41b14c342700a5dd83',ramdisk_id='',reservation_id='r-20vqu8m3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-317922803',owner_user_name='tempest-AttachVolumeTestJSON-317922803-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:47:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7b76435f64e47169f3ca08aebb8e766',uuid=f97d8a95-e281-496b-bb62-81747a5c2ffc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "address": "fa:16:3e:12:35:93", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0ffcbd-76", "ovs_interfaceid": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Converting VIF {"id": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "address": "fa:16:3e:12:35:93", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0ffcbd-76", "ovs_interfaceid": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:35:93,bridge_name='br-int',has_traffic_filtering=True,id=3c0ffcbd-768e-4040-8765-663fa495a3ab,network=Network(3348a6ff-bdcc-49e3-bb0a-4839999ec213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c0ffcbd-76') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_vif [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:35:93,bridge_name='br-int',has_traffic_filtering=True,id=3c0ffcbd-768e-4040-8765-663fa495a3ab,network=Network(3348a6ff-bdcc-49e3-bb0a-4839999ec213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c0ffcbd-76') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c0ffcbd-76, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:49:41 user nova-compute[72773]: INFO os_vif [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:35:93,bridge_name='br-int',has_traffic_filtering=True,id=3c0ffcbd-768e-4040-8765-663fa495a3ab,network=Network(3348a6ff-bdcc-49e3-bb0a-4839999ec213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c0ffcbd-76')
Aug 16 22:49:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFyBYEOq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:49:41 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6304c3f-be72-4b2f-9840-236ada7143f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf9bd27-8607-4ae6-9aba-357906c3bcc9]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)
Aug 16 22:49:41 user nova-compute[72773]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:49:41 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)
Aug 16 22:49:41 user nova-compute[72773]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:49:41 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef5c5856c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601'): ({'sdc'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Removing single pathed devices sdc {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc6fe62-4ab0-4041-bd2c-319badd2ad13]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbfcfa4-914f-49ee-b843-8ab2acbd263d]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Flushing IO for device /dev/sdc {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[47032eb5-3d9e-4253-96ee-3ed1d46fd37e]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[977e4357-0b17-4613-87f5-5e485262d248]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0617cce-7bf3-4e27-8132-29763805ebee]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdee5a15-5da0-428f-bbb4-061e4186a822]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601, portal: 172.16.0.220,3260]
Aug 16 22:49:41 user nova-compute[72773]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601, portal: 172.16.0.220,3260] successful.
Aug 16 22:49:41 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8021f5-33cd-493f-b9cb-2b1eb5ef1cae]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] <== disconnect_volume: return (277ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Start _get_guest_xml network_info=[{"id": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "address": "fa:16:3e:12:35:93", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0ffcbd-76", "ovs_interfaceid": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '38424192-fbf7-4992-8bce-db18e8372d45', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFyBYEOq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'f97d8a95-e281-496b-bb62-81747a5c2ffc', 'attached_at': '', 'detached_at': '', 'volume_id': '3510e728-af0a-49bf-8a0d-c07fc7fea601', 'serial': '3510e728-af0a-49bf-8a0d-c07fc7fea601'}, 'mount_device': '/dev/vdb', 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG nova.objects.instance [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lazy-loading 'numa_topology' on Instance uuid f97d8a95-e281-496b-bb62-81747a5c2ffc {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:49:41 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:49:41 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:49:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG nova.objects.instance [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lazy-loading 'vcpu_model' on Instance uuid f97d8a95-e281-496b-bb62-81747a5c2ffc {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFyBYEOq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:49:41 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:49:41 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:49:41 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93f99f7-495c-4383-8eca-19a5e1684980]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:49:41 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f352e4-6293-4f72-a2e8-a4fb749e24f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601] added
Aug 16 22:49:41 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[de907f80-7b3d-4875-b973-7ab348d41e5f]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[90928caa-6d5a-4db4-96d2-0e6e1d8b6e4e]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lFyBYEOq {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lFyBYEOq" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[89263941-cb18-4fee-8f82-2ddfd708a1cc]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lFyBYEOq'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[015a7ca2-d7b7-4ac7-9fff-6d24e5d877e4]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4282ee50-c4a4-4567-b31b-21d19254877c]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:49:41 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:49:41 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fd8cdc-e4e0-43a6-8836-745bdeeef501]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601, portal: 172.16.0.220,3260]
Aug 16 22:49:41 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601, portal: 172.16.0.220,3260] successful.
Aug 16 22:49:41 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df54143-e9fe-4c2b-bb7f-cb5c0dec2a18]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b58daa8-7e62-4f87-8474-7173b9fab236]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:49:41 user nova-compute[72773]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)
Aug 16 22:49:41 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:49:41 user nova-compute[72773]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)
Aug 16 22:49:41 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:49:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:42 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[43902562-d9c7-4def-b694-0cc603848cca]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:42 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:49:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFyBYEOq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:49:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:49:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23932663865333333', 'path': '/dev/sdc'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:49:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932663865333333', 'path': '/dev/sdc'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:49:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-901024509',display_name='tempest-AttachVolumeTestJSON-server-901024509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-901024509',id=39,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMwC80zAC+DDm1/aQS1yIwW3iohkON4IwgRB4Qo30pRKnd56Cla0ZmEd6mFqvSws8dEJWHuZr06ofoAXldMYoVLEZx3MfxCSPNlh2DAJMCkFmy36ylUG4yyQmmfHxBPSw==',key_name='tempest-keypair-1482365818',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:45:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a6da6170d60c4d41b14c342700a5dd83',ramdisk_id='',reservation_id='r-20vqu8m3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-317922803',owner_user_name='tempest-AttachVolumeTestJSON-317922803-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:47:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7b76435f64e47169f3ca08aebb8e766',uuid=f97d8a95-e281-496b-bb62-81747a5c2ffc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "address": "fa:16:3e:12:35:93", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0ffcbd-76", "ovs_interfaceid": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:49:43 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Converting VIF {"id": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "address": "fa:16:3e:12:35:93", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0ffcbd-76", "ovs_interfaceid": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:49:43 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:35:93,bridge_name='br-int',has_traffic_filtering=True,id=3c0ffcbd-768e-4040-8765-663fa495a3ab,network=Network(3348a6ff-bdcc-49e3-bb0a-4839999ec213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c0ffcbd-76') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:49:43 user nova-compute[72773]: DEBUG nova.objects.instance [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lazy-loading 'pci_devices' on Instance uuid f97d8a95-e281-496b-bb62-81747a5c2ffc {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:49:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:49:43 user nova-compute[72773]:   <uuid>f97d8a95-e281-496b-bb62-81747a5c2ffc</uuid>
Aug 16 22:49:43 user nova-compute[72773]:   <name>instance-00000027</name>
Aug 16 22:49:43 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:49:43 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:49:43 user nova-compute[72773]:   <metadata>
Aug 16 22:49:43 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:49:43 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:49:43 user nova-compute[72773]:       <nova:name>tempest-AttachVolumeTestJSON-server-901024509</nova:name>
Aug 16 22:49:43 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:49:41</nova:creationTime>
Aug 16 22:49:43 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:49:43 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:49:43 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:49:43 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:49:43 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:49:43 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:49:43 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:49:43 user nova-compute[72773]:       <nova:owner>
Aug 16 22:49:43 user nova-compute[72773]:         <nova:user uuid="e7b76435f64e47169f3ca08aebb8e766">tempest-AttachVolumeTestJSON-317922803-project-member</nova:user>
Aug 16 22:49:43 user nova-compute[72773]:         <nova:project uuid="a6da6170d60c4d41b14c342700a5dd83">tempest-AttachVolumeTestJSON-317922803</nova:project>
Aug 16 22:49:43 user nova-compute[72773]:       </nova:owner>
Aug 16 22:49:43 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:49:43 user nova-compute[72773]:       <nova:ports>
Aug 16 22:49:43 user nova-compute[72773]:         <nova:port uuid="3c0ffcbd-768e-4040-8765-663fa495a3ab">
Aug 16 22:49:43 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 22:49:43 user nova-compute[72773]:         </nova:port>
Aug 16 22:49:43 user nova-compute[72773]:       </nova:ports>
Aug 16 22:49:43 user nova-compute[72773]:     </nova:instance>
Aug 16 22:49:43 user nova-compute[72773]:   </metadata>
Aug 16 22:49:43 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:49:43 user nova-compute[72773]:     <system>
Aug 16 22:49:43 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:49:43 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:49:43 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:49:43 user nova-compute[72773]:       <entry name="serial">f97d8a95-e281-496b-bb62-81747a5c2ffc</entry>
Aug 16 22:49:43 user nova-compute[72773]:       <entry name="uuid">f97d8a95-e281-496b-bb62-81747a5c2ffc</entry>
Aug 16 22:49:43 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:49:43 user nova-compute[72773]:     </system>
Aug 16 22:49:43 user nova-compute[72773]:   </sysinfo>
Aug 16 22:49:43 user nova-compute[72773]:   <os>
Aug 16 22:49:43 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:49:43 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:49:43 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:49:43 user nova-compute[72773]:   </os>
Aug 16 22:49:43 user nova-compute[72773]:   <features>
Aug 16 22:49:43 user nova-compute[72773]:     <acpi/>
Aug 16 22:49:43 user nova-compute[72773]:     <apic/>
Aug 16 22:49:43 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:49:43 user nova-compute[72773]:   </features>
Aug 16 22:49:43 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:49:43 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:49:43 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:49:43 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:49:43 user nova-compute[72773]:   </clock>
Aug 16 22:49:43 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:49:43 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:49:43 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:49:43 user nova-compute[72773]:   </cpu>
Aug 16 22:49:43 user nova-compute[72773]:   <devices>
Aug 16 22:49:43 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:49:43 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:49:43 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk"/>
Aug 16 22:49:43 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:49:43 user nova-compute[72773]:     </disk>
Aug 16 22:49:43 user nova-compute[72773]:     <disk type="block" device="disk">
Aug 16 22:49:43 user nova-compute[72773]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:49:43 user nova-compute[72773]:       <source dev="/dev/sdc"/>
Aug 16 22:49:43 user nova-compute[72773]:       <target dev="vdb" bus="virtio"/>
Aug 16 22:49:43 user nova-compute[72773]:       <serial>3510e728-af0a-49bf-8a0d-c07fc7fea601</serial>
Aug 16 22:49:43 user nova-compute[72773]:     </disk>
Aug 16 22:49:43 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:49:43 user nova-compute[72773]:       <mac address="fa:16:3e:12:35:93"/>
Aug 16 22:49:43 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:49:43 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:49:43 user nova-compute[72773]:       <target dev="tap3c0ffcbd-76"/>
Aug 16 22:49:43 user nova-compute[72773]:     </interface>
Aug 16 22:49:43 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:49:43 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/console.log" append="off"/>
Aug 16 22:49:43 user nova-compute[72773]:     </serial>
Aug 16 22:49:43 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:49:43 user nova-compute[72773]:     <video>
Aug 16 22:49:43 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:49:43 user nova-compute[72773]:     </video>
Aug 16 22:49:43 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:49:43 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:49:43 user nova-compute[72773]:     </rng>
Aug 16 22:49:43 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:49:43 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:49:43 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:49:43 user nova-compute[72773]:     </memballoon>
Aug 16 22:49:43 user nova-compute[72773]:   </devices>
Aug 16 22:49:43 user nova-compute[72773]: </domain>
Aug 16 22:49:43 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:49:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:49:43 user nova-compute[72773]: DEBUG nova.objects.instance [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lazy-loading 'trusted_certs' on Instance uuid f97d8a95-e281-496b-bb62-81747a5c2ffc {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:49:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.177s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:43 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:49:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:43 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Cannot resize image /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:49:43 user nova-compute[72773]: DEBUG nova.objects.instance [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lazy-loading 'migration_context' on Instance uuid f97d8a95-e281-496b-bb62-81747a5c2ffc {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:49:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-901024509',display_name='tempest-AttachVolumeTestJSON-server-901024509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-901024509',id=39,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMwC80zAC+DDm1/aQS1yIwW3iohkON4IwgRB4Qo30pRKnd56Cla0ZmEd6mFqvSws8dEJWHuZr06ofoAXldMYoVLEZx3MfxCSPNlh2DAJMCkFmy36ylUG4yyQmmfHxBPSw==',key_name='tempest-keypair-1482365818',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:45:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='a6da6170d60c4d41b14c342700a5dd83',ramdisk_id='',reservation_id='r-20vqu8m3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-317922803',owner_user_name='tempest-AttachVolumeTestJSON-317922803-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:47:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7b76435f64e47169f3ca08aebb8e766',uuid=f97d8a95-e281-496b-bb62-81747a5c2ffc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "address": "fa:16:3e:12:35:93", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0ffcbd-76", "ovs_interfaceid": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:49:43 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Converting VIF {"id": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "address": "fa:16:3e:12:35:93", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0ffcbd-76", "ovs_interfaceid": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:49:43 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:35:93,bridge_name='br-int',has_traffic_filtering=True,id=3c0ffcbd-768e-4040-8765-663fa495a3ab,network=Network(3348a6ff-bdcc-49e3-bb0a-4839999ec213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c0ffcbd-76') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:49:43 user nova-compute[72773]: DEBUG os_vif [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:35:93,bridge_name='br-int',has_traffic_filtering=True,id=3c0ffcbd-768e-4040-8765-663fa495a3ab,network=Network(3348a6ff-bdcc-49e3-bb0a-4839999ec213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c0ffcbd-76') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:49:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:49:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:49:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c0ffcbd-76, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:49:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3c0ffcbd-76, col_values=(('external_ids', {'iface-id': '3c0ffcbd-768e-4040-8765-663fa495a3ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:35:93', 'vm-uuid': 'f97d8a95-e281-496b-bb62-81747a5c2ffc'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:49:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:49:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:43 user nova-compute[72773]: INFO os_vif [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:35:93,bridge_name='br-int',has_traffic_filtering=True,id=3c0ffcbd-768e-4040-8765-663fa495a3ab,network=Network(3348a6ff-bdcc-49e3-bb0a-4839999ec213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c0ffcbd-76')
Aug 16 22:49:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:45 user nova-compute[72773]: DEBUG nova.compute.manager [req-1918dad1-126c-4347-82d4-1b745946a791 req-a7573f3e-e93e-4fae-9115-b69556d56765 service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Received event network-vif-plugged-3c0ffcbd-768e-4040-8765-663fa495a3ab {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:49:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-1918dad1-126c-4347-82d4-1b745946a791 req-a7573f3e-e93e-4fae-9115-b69556d56765 service nova] Acquiring lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:49:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-1918dad1-126c-4347-82d4-1b745946a791 req-a7573f3e-e93e-4fae-9115-b69556d56765 service nova] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:49:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-1918dad1-126c-4347-82d4-1b745946a791 req-a7573f3e-e93e-4fae-9115-b69556d56765 service nova] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:49:45 user nova-compute[72773]: DEBUG nova.compute.manager [req-1918dad1-126c-4347-82d4-1b745946a791 req-a7573f3e-e93e-4fae-9115-b69556d56765 service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] No waiting events found dispatching network-vif-plugged-3c0ffcbd-768e-4040-8765-663fa495a3ab {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:49:45 user nova-compute[72773]: WARNING nova.compute.manager [req-1918dad1-126c-4347-82d4-1b745946a791 req-a7573f3e-e93e-4fae-9115-b69556d56765 service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Received unexpected event network-vif-plugged-3c0ffcbd-768e-4040-8765-663fa495a3ab for instance with vm_state stopped and task_state powering-on.
Aug 16 22:49:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QkMLNlKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:49:46 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:49:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:49:46 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:49:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:49:46 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:49:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5422708-23e9-4e45-88c6-252e57f15707]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:49:46 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f063bb8-7684-49ba-a81d-40bdaffffde1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014] added
Aug 16 22:49:46 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d468218-1edb-4d7a-a7b9-bb766e4703ea]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ac3ca2-eb04-4de7-9565-92309c0ce1cd]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QkMLNlKb {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QkMLNlKb" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee70cc7d-c5b3-4281-95ec-10c9335e37e8]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QkMLNlKb'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebb8110-f533-40cb-9714-7a8764a926ce]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[554226f6-b7ce-4647-8df1-b6082ca2e74b]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:49:46 user nova-compute[72773]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)
Aug 16 22:49:46 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:49:46 user nova-compute[72773]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)
Aug 16 22:49:46 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1f3e86-5330-4ad2-9099-69f60fb50f24]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014, portal: 172.16.0.220,3260]
Aug 16 22:49:46 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014, portal: 172.16.0.220,3260] successful.
Aug 16 22:49:46 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3430273b-3c67-4b13-a3f9-e054c247f467]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[efaeeafd-8cac-4f38-8fda-d8998f990a3b]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:49:46 user nova-compute[72773]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)
Aug 16 22:49:46 user nova-compute[72773]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014 (non-flash)
Aug 16 22:49:46 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:49:46 user nova-compute[72773]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)
Aug 16 22:49:46 user nova-compute[72773]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014 (non-flash)
Aug 16 22:49:46 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f594a74-45a8-4914-88c7-97a772a4255f]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:49:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QkMLNlKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:49:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-811b5faf-1e05-404c-bae0-b8fa19ab9664 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:49:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-811b5faf-1e05-404c-bae0-b8fa19ab9664 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:49:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-811b5faf-1e05-404c-bae0-b8fa19ab9664 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:49:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-811b5faf-1e05-404c-bae0-b8fa19ab9664 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:49:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-811b5faf-1e05-404c-bae0-b8fa19ab9664 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:49:47 user nova-compute[72773]: INFO nova.compute.manager [None req-811b5faf-1e05-404c-bae0-b8fa19ab9664 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Terminating instance
Aug 16 22:49:47 user nova-compute[72773]: DEBUG nova.compute.manager [None req-811b5faf-1e05-404c-bae0-b8fa19ab9664 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:49:47 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692226187.2709067, f97d8a95-e281-496b-bb62-81747a5c2ffc => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:49:47 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] VM Resumed (Lifecycle Event)
Aug 16 22:49:47 user nova-compute[72773]: DEBUG nova.compute.manager [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:49:47 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Instance rebooted successfully.
Aug 16 22:49:47 user nova-compute[72773]: DEBUG nova.compute.manager [None req-5b16d73c-e132-4908-ab3e-ef4a9090fc54 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:49:47 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:49:47 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:49:47 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 16 22:49:47 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692226187.2726393, f97d8a95-e281-496b-bb62-81747a5c2ffc => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:49:47 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] VM Started (Lifecycle Event)
Aug 16 22:49:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:47 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:49:47 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:49:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:47 user nova-compute[72773]: DEBUG nova.compute.manager [req-14fd846d-b5f8-4290-862c-cabc58e4e614 req-098819f4-f8b9-4049-b035-450a84554f4e service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Received event network-vif-plugged-3c0ffcbd-768e-4040-8765-663fa495a3ab {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:49:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-14fd846d-b5f8-4290-862c-cabc58e4e614 req-098819f4-f8b9-4049-b035-450a84554f4e service nova] Acquiring lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:49:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-14fd846d-b5f8-4290-862c-cabc58e4e614 req-098819f4-f8b9-4049-b035-450a84554f4e service nova] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:49:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-14fd846d-b5f8-4290-862c-cabc58e4e614 req-098819f4-f8b9-4049-b035-450a84554f4e service nova] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:49:47 user nova-compute[72773]: DEBUG nova.compute.manager [req-14fd846d-b5f8-4290-862c-cabc58e4e614 req-098819f4-f8b9-4049-b035-450a84554f4e service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] No waiting events found dispatching network-vif-plugged-3c0ffcbd-768e-4040-8765-663fa495a3ab {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:49:47 user nova-compute[72773]: WARNING nova.compute.manager [req-14fd846d-b5f8-4290-862c-cabc58e4e614 req-098819f4-f8b9-4049-b035-450a84554f4e service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Received unexpected event network-vif-plugged-3c0ffcbd-768e-4040-8765-663fa495a3ab for instance with vm_state active and task_state None.
Aug 16 22:49:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:49:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23866313936313165', 'path': '/dev/sdd'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:49:47 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866313936313165', 'path': '/dev/sdd'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:49:47 user nova-compute[72773]: DEBUG nova.objects.instance [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lazy-loading 'flavor' on Instance uuid 29c612f4-5ed1-46db-bdec-0eed58384746 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:49:47 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 22:49:47 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:49:47 user nova-compute[72773]:   <source dev="/dev/sdd"/>
Aug 16 22:49:47 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:49:47 user nova-compute[72773]:   <serial>66e6fafa-e312-4341-a1a4-1c22895cd014</serial>
Aug 16 22:49:47 user nova-compute[72773]: </disk>
Aug 16 22:49:47 user nova-compute[72773]:  {{(pid=72773) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 22:49:48 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Instance destroyed successfully.
Aug 16 22:49:48 user nova-compute[72773]: DEBUG nova.objects.instance [None req-811b5faf-1e05-404c-bae0-b8fa19ab9664 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lazy-loading 'resources' on Instance uuid 391a6006-4fe6-4398-a1e8-ae95b5edbf2b {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:49:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-811b5faf-1e05-404c-bae0-b8fa19ab9664 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:32:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1414401215',display_name='tempest-ServerRescueNegativeTestJSON-server-1414401215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1414401215',id=21,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:36:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f8e068df8094356b16a6480cd231675',ramdisk_id='',reservation_id='r-biq7d4v4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1754829282',owner_user_name='tempest-ServerRescueNegativeTestJSON-1754829282-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:38:49Z,user_data=None,user_id='62e5b77a149140fd8613d566f41cc23d',uuid=391a6006-4fe6-4398-a1e8-ae95b5edbf2b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6961298d-d62e-4f7b-b97e-4198a325816c", "address": "fa:16:3e:2d:58:d4", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6961298d-d6", "ovs_interfaceid": "6961298d-d62e-4f7b-b97e-4198a325816c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:49:48 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-811b5faf-1e05-404c-bae0-b8fa19ab9664 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Converting VIF {"id": "6961298d-d62e-4f7b-b97e-4198a325816c", "address": "fa:16:3e:2d:58:d4", "network": {"id": "8a43bbad-aab2-44c9-a7e4-62696d908234", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1130794220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8e068df8094356b16a6480cd231675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6961298d-d6", "ovs_interfaceid": "6961298d-d62e-4f7b-b97e-4198a325816c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:49:48 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-811b5faf-1e05-404c-bae0-b8fa19ab9664 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:58:d4,bridge_name='br-int',has_traffic_filtering=True,id=6961298d-d62e-4f7b-b97e-4198a325816c,network=Network(8a43bbad-aab2-44c9-a7e4-62696d908234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6961298d-d6') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:49:48 user nova-compute[72773]: DEBUG os_vif [None req-811b5faf-1e05-404c-bae0-b8fa19ab9664 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:58:d4,bridge_name='br-int',has_traffic_filtering=True,id=6961298d-d62e-4f7b-b97e-4198a325816c,network=Network(8a43bbad-aab2-44c9-a7e4-62696d908234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6961298d-d6') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:49:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6961298d-d6, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:49:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:49:48 user nova-compute[72773]: INFO os_vif [None req-811b5faf-1e05-404c-bae0-b8fa19ab9664 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:58:d4,bridge_name='br-int',has_traffic_filtering=True,id=6961298d-d62e-4f7b-b97e-4198a325816c,network=Network(8a43bbad-aab2-44c9-a7e4-62696d908234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6961298d-d6')
Aug 16 22:49:48 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-811b5faf-1e05-404c-bae0-b8fa19ab9664 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Deleting instance files /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b_del
Aug 16 22:49:48 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-811b5faf-1e05-404c-bae0-b8fa19ab9664 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Deletion of /opt/stack/data/nova/instances/391a6006-4fe6-4398-a1e8-ae95b5edbf2b_del complete
Aug 16 22:49:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:49:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:49:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] No VIF found with MAC fa:16:3e:1b:7d:b0, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:49:48 user nova-compute[72773]: INFO nova.compute.manager [None req-811b5faf-1e05-404c-bae0-b8fa19ab9664 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 16 22:49:48 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-811b5faf-1e05-404c-bae0-b8fa19ab9664 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:49:48 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:49:48 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:49:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-209aeb78-fb10-472d-8fe6-3268467262fa tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "29c612f4-5ed1-46db-bdec-0eed58384746" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.562s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:49:48 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:49:48 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Took 0.57 seconds to deallocate network for instance.
Aug 16 22:49:48 user nova-compute[72773]: DEBUG nova.compute.manager [req-1a863f37-1d6f-426d-ba0a-f75c75c1aae6 req-57ef113b-e616-47c6-b863-5f83153251f7 service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Received event network-vif-deleted-6961298d-d62e-4f7b-b97e-4198a325816c {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:49:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-811b5faf-1e05-404c-bae0-b8fa19ab9664 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:49:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-811b5faf-1e05-404c-bae0-b8fa19ab9664 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:49:49 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-811b5faf-1e05-404c-bae0-b8fa19ab9664 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:49:49 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-811b5faf-1e05-404c-bae0-b8fa19ab9664 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:49:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-811b5faf-1e05-404c-bae0-b8fa19ab9664 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.255s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:49:49 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-811b5faf-1e05-404c-bae0-b8fa19ab9664 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Deleted allocations for instance 391a6006-4fe6-4398-a1e8-ae95b5edbf2b
Aug 16 22:49:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-811b5faf-1e05-404c-bae0-b8fa19ab9664 tempest-ServerRescueNegativeTestJSON-1754829282 tempest-ServerRescueNegativeTestJSON-1754829282-project-member] Lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.012s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:49:49 user nova-compute[72773]: DEBUG nova.compute.manager [req-ecaaba2a-bef4-453a-a4b8-925bf2bd2fae req-b2dbce90-ff09-4660-8205-42e7fe763824 service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Received event network-vif-unplugged-6961298d-d62e-4f7b-b97e-4198a325816c {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:49:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ecaaba2a-bef4-453a-a4b8-925bf2bd2fae req-b2dbce90-ff09-4660-8205-42e7fe763824 service nova] Acquiring lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:49:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ecaaba2a-bef4-453a-a4b8-925bf2bd2fae req-b2dbce90-ff09-4660-8205-42e7fe763824 service nova] Lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:49:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ecaaba2a-bef4-453a-a4b8-925bf2bd2fae req-b2dbce90-ff09-4660-8205-42e7fe763824 service nova] Lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:49:49 user nova-compute[72773]: DEBUG nova.compute.manager [req-ecaaba2a-bef4-453a-a4b8-925bf2bd2fae req-b2dbce90-ff09-4660-8205-42e7fe763824 service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] No waiting events found dispatching network-vif-unplugged-6961298d-d62e-4f7b-b97e-4198a325816c {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:49:49 user nova-compute[72773]: WARNING nova.compute.manager [req-ecaaba2a-bef4-453a-a4b8-925bf2bd2fae req-b2dbce90-ff09-4660-8205-42e7fe763824 service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Received unexpected event network-vif-unplugged-6961298d-d62e-4f7b-b97e-4198a325816c for instance with vm_state deleted and task_state None.
Aug 16 22:49:49 user nova-compute[72773]: DEBUG nova.compute.manager [req-ecaaba2a-bef4-453a-a4b8-925bf2bd2fae req-b2dbce90-ff09-4660-8205-42e7fe763824 service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Received event network-vif-plugged-6961298d-d62e-4f7b-b97e-4198a325816c {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:49:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ecaaba2a-bef4-453a-a4b8-925bf2bd2fae req-b2dbce90-ff09-4660-8205-42e7fe763824 service nova] Acquiring lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:49:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ecaaba2a-bef4-453a-a4b8-925bf2bd2fae req-b2dbce90-ff09-4660-8205-42e7fe763824 service nova] Lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:49:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ecaaba2a-bef4-453a-a4b8-925bf2bd2fae req-b2dbce90-ff09-4660-8205-42e7fe763824 service nova] Lock "391a6006-4fe6-4398-a1e8-ae95b5edbf2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:49:49 user nova-compute[72773]: DEBUG nova.compute.manager [req-ecaaba2a-bef4-453a-a4b8-925bf2bd2fae req-b2dbce90-ff09-4660-8205-42e7fe763824 service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] No waiting events found dispatching network-vif-plugged-6961298d-d62e-4f7b-b97e-4198a325816c {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:49:49 user nova-compute[72773]: WARNING nova.compute.manager [req-ecaaba2a-bef4-453a-a4b8-925bf2bd2fae req-b2dbce90-ff09-4660-8205-42e7fe763824 service nova] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Received unexpected event network-vif-plugged-6961298d-d62e-4f7b-b97e-4198a325816c for instance with vm_state deleted and task_state None.
Aug 16 22:49:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:49:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:49:59 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:50:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:50:03 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692226188.09838, 391a6006-4fe6-4398-a1e8-ae95b5edbf2b => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:50:03 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] VM Stopped (Lifecycle Event)
Aug 16 22:50:03 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7d3d4957-7925-4345-aca2-a911b9e64d19 None None] [instance: 391a6006-4fe6-4398-a1e8-ae95b5edbf2b] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:50:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:50:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:50:06 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:50:06 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:50:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-f4210738-d01e-4408-a15c-aeccada6dd23" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:50:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-f4210738-d01e-4408-a15c-aeccada6dd23" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:50:06 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 22:50:07 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Updating instance_info_cache with network_info: [{"id": "bb573e79-a106-40c5-8c53-ab73eb6ba240", "address": "fa:16:3e:1e:80:9b", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb573e79-a1", "ovs_interfaceid": "bb573e79-a106-40c5-8c53-ab73eb6ba240", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:50:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-f4210738-d01e-4408-a15c-aeccada6dd23" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:50:07 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 22:50:07 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:50:07 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:50:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:50:08 user nova-compute[72773]: DEBUG nova.compute.manager [None req-840fd415-81dc-4dc3-823b-2353a41d9b01 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:50:08 user nova-compute[72773]: INFO nova.compute.manager [None req-840fd415-81dc-4dc3-823b-2353a41d9b01 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] instance snapshotting
Aug 16 22:50:08 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-840fd415-81dc-4dc3-823b-2353a41d9b01 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Beginning live snapshot process
Aug 16 22:50:08 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:50:08 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:50:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-840fd415-81dc-4dc3-823b-2353a41d9b01 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json -f qcow2 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:50:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-840fd415-81dc-4dc3-823b-2353a41d9b01 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:50:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-840fd415-81dc-4dc3-823b-2353a41d9b01 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json -f qcow2 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:50:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-840fd415-81dc-4dc3-823b-2353a41d9b01 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:50:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-840fd415-81dc-4dc3-823b-2353a41d9b01 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:50:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-840fd415-81dc-4dc3-823b-2353a41d9b01 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.178s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:50:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-840fd415-81dc-4dc3-823b-2353a41d9b01 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpec9h6ezp/e6c643e5d10e49c49f75ef36547e6860.delta 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:50:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-840fd415-81dc-4dc3-823b-2353a41d9b01 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpec9h6ezp/e6c643e5d10e49c49f75ef36547e6860.delta 1073741824" returned: 0 in 0.055s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:50:09 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-840fd415-81dc-4dc3-823b-2353a41d9b01 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 22:50:09 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:50:09 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:50:09 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-840fd415-81dc-4dc3-823b-2353a41d9b01 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72773) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 22:50:10 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-840fd415-81dc-4dc3-823b-2353a41d9b01 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72773) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 22:50:10 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-840fd415-81dc-4dc3-823b-2353a41d9b01 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 22:50:10 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:50:10 user nova-compute[72773]: DEBUG nova.privsep.utils [None req-840fd415-81dc-4dc3-823b-2353a41d9b01 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72773) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 22:50:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-840fd415-81dc-4dc3-823b-2353a41d9b01 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpec9h6ezp/e6c643e5d10e49c49f75ef36547e6860.delta /opt/stack/data/nova/instances/snapshots/tmpec9h6ezp/e6c643e5d10e49c49f75ef36547e6860 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:50:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:50:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:50:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:50:10 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:50:10 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:50:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:50:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:50:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:50:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:50:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:50:10 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:50:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-840fd415-81dc-4dc3-823b-2353a41d9b01 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpec9h6ezp/e6c643e5d10e49c49f75ef36547e6860.delta /opt/stack/data/nova/instances/snapshots/tmpec9h6ezp/e6c643e5d10e49c49f75ef36547e6860" returned: 0 in 0.561s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:50:10 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-840fd415-81dc-4dc3-823b-2353a41d9b01 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Snapshot extracted, beginning image upload
Aug 16 22:50:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:50:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:50:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:50:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:50:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:50:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:50:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:50:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:50:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:50:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:50:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:50:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:50:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:50:12 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:50:12 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:50:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=8111MB free_disk=25.4454345703125GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:50:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:50:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:50:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Applying migration context for instance 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1 as it has an incoming, in-progress migration 922a93d5-b2fb-4885-a0d0-256608a54a93. Migration status is finished {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 22:50:12 user nova-compute[72773]: INFO nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Updating resource usage from migration 922a93d5-b2fb-4885-a0d0-256608a54a93
Aug 16 22:50:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance f4210738-d01e-4408-a15c-aeccada6dd23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:50:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance f97d8a95-e281-496b-bb62-81747a5c2ffc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:50:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance bc6fff46-be38-4089-a6ba-de75e0d7baab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:50:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 29c612f4-5ed1-46db-bdec-0eed58384746 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:50:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Migration 922a93d5-b2fb-4885-a0d0-256608a54a93 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 22:50:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:50:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:50:12 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:50:12 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:50:12 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:50:13 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:50:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.395s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:50:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:50:13 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-840fd415-81dc-4dc3-823b-2353a41d9b01 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Snapshot image upload complete
Aug 16 22:50:13 user nova-compute[72773]: INFO nova.compute.manager [None req-840fd415-81dc-4dc3-823b-2353a41d9b01 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Took 5.27 seconds to snapshot the instance on the hypervisor.
Aug 16 22:50:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:50:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Acquiring lock "0f864e66-41ac-44a5-ae3c-6edec17271cd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:50:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "0f864e66-41ac-44a5-ae3c-6edec17271cd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:50:16 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:50:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:50:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:50:16 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:50:16 user nova-compute[72773]: INFO nova.compute.claims [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Claim successful on node user
Aug 16 22:50:16 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:50:16 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:50:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:50:16 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:50:16 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:50:16 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:50:16 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:50:16 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:50:17 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:50:17 user nova-compute[72773]: DEBUG nova.policy [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7a9bfc4519a64911b5613b3a96a461eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9da6df5003942baa7e7da93c0e3bc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:50:17 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:50:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:50:17 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Creating image(s)
Aug 16 22:50:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Acquiring lock "/opt/stack/data/nova/instances/0f864e66-41ac-44a5-ae3c-6edec17271cd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:50:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "/opt/stack/data/nova/instances/0f864e66-41ac-44a5-ae3c-6edec17271cd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:50:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "/opt/stack/data/nova/instances/0f864e66-41ac-44a5-ae3c-6edec17271cd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:50:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Acquiring lock "06a1866ee7918873e677d6d728d1385e21ba0f18" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:50:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "06a1866ee7918873e677d6d728d1385e21ba0f18" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:50:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06a1866ee7918873e677d6d728d1385e21ba0f18.part --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:50:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:50:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06a1866ee7918873e677d6d728d1385e21ba0f18.part --force-share --output=json" returned: 0 in 0.267s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:50:18 user nova-compute[72773]: DEBUG nova.virt.images [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] 04f7f99b-8234-41d3-85d4-4720c41c67b4 was qcow2, converting to raw {{(pid=72773) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 22:50:18 user nova-compute[72773]: DEBUG nova.privsep.utils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72773) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 22:50:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/06a1866ee7918873e677d6d728d1385e21ba0f18.part /opt/stack/data/nova/instances/_base/06a1866ee7918873e677d6d728d1385e21ba0f18.converted {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:50:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-60cab458-1e45-4d8b-879e-536befa14fd8 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Acquiring lock "29c612f4-5ed1-46db-bdec-0eed58384746" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:50:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-60cab458-1e45-4d8b-879e-536befa14fd8 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "29c612f4-5ed1-46db-bdec-0eed58384746" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:50:18 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Successfully created port: 7a4a74c8-6af2-4a9e-9703-a681c4042c59 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:50:18 user nova-compute[72773]: INFO nova.compute.manager [None req-60cab458-1e45-4d8b-879e-536befa14fd8 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Detaching volume 66e6fafa-e312-4341-a1a4-1c22895cd014
Aug 16 22:50:18 user nova-compute[72773]: INFO nova.virt.block_device [None req-60cab458-1e45-4d8b-879e-536befa14fd8 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Attempting to driver detach volume 66e6fafa-e312-4341-a1a4-1c22895cd014 from mountpoint /dev/vdb
Aug 16 22:50:18 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-60cab458-1e45-4d8b-879e-536befa14fd8 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Attempting to detach device vdb from instance 29c612f4-5ed1-46db-bdec-0eed58384746 from the persistent domain config. {{(pid=72773) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 22:50:18 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-60cab458-1e45-4d8b-879e-536befa14fd8 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:50:18 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:50:18 user nova-compute[72773]:   <source dev="/dev/sdd"/>
Aug 16 22:50:18 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:50:18 user nova-compute[72773]:   <serial>66e6fafa-e312-4341-a1a4-1c22895cd014</serial>
Aug 16 22:50:18 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:50:18 user nova-compute[72773]: </disk>
Aug 16 22:50:18 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:50:18 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-60cab458-1e45-4d8b-879e-536befa14fd8 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Successfully detached device vdb from instance 29c612f4-5ed1-46db-bdec-0eed58384746 from the persistent domain config.
Aug 16 22:50:18 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-60cab458-1e45-4d8b-879e-536befa14fd8 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 29c612f4-5ed1-46db-bdec-0eed58384746 from the live domain config. {{(pid=72773) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 22:50:18 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-60cab458-1e45-4d8b-879e-536befa14fd8 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:50:18 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:50:18 user nova-compute[72773]:   <source dev="/dev/sdd"/>
Aug 16 22:50:18 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:50:18 user nova-compute[72773]:   <serial>66e6fafa-e312-4341-a1a4-1c22895cd014</serial>
Aug 16 22:50:18 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:50:18 user nova-compute[72773]: </disk>
Aug 16 22:50:18 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/06a1866ee7918873e677d6d728d1385e21ba0f18.part /opt/stack/data/nova/instances/_base/06a1866ee7918873e677d6d728d1385e21ba0f18.converted" returned: 0 in 0.644s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06a1866ee7918873e677d6d728d1385e21ba0f18.converted --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Received event <DeviceRemovedEvent: 1692226219.2362072, 29c612f4-5ed1-46db-bdec-0eed58384746 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72773) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-60cab458-1e45-4d8b-879e-536befa14fd8 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 29c612f4-5ed1-46db-bdec-0eed58384746 {{(pid=72773) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 22:50:19 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-60cab458-1e45-4d8b-879e-536befa14fd8 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Successfully detached device vdb from instance 29c612f4-5ed1-46db-bdec-0eed58384746 from the live domain config.
Aug 16 22:50:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60cab458-1e45-4d8b-879e-536befa14fd8 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cab458-1e45-4d8b-879e-536befa14fd8 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QkMLNlKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:50:19 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-60cab458-1e45-4d8b-879e-536befa14fd8 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:50:19 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-60cab458-1e45-4d8b-879e-536befa14fd8 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-60cab458-1e45-4d8b-879e-536befa14fd8 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cab458-1e45-4d8b-879e-536befa14fd8 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76efd5f-9a48-42bc-86c7-ad3de8022030]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a53ea2-dec9-4068-b0f0-5b025a1bfbc0]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cab458-1e45-4d8b-879e-536befa14fd8 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:50:19 user nova-compute[72773]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)
Aug 16 22:50:19 user nova-compute[72773]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014 (non-flash)
Aug 16 22:50:19 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cab458-1e45-4d8b-879e-536befa14fd8 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:50:19 user nova-compute[72773]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)
Aug 16 22:50:19 user nova-compute[72773]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014 (non-flash)
Aug 16 22:50:19 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cab458-1e45-4d8b-879e-536befa14fd8 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef949d9f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014'): ({'sdd'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-60cab458-1e45-4d8b-879e-536befa14fd8 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Removing single pathed devices sdd {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc79460-150c-4957-b90f-10a4302d02aa]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06a1866ee7918873e677d6d728d1385e21ba0f18.converted --force-share --output=json" returned: 0 in 0.203s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "06a1866ee7918873e677d6d728d1385e21ba0f18" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.278s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06a1866ee7918873e677d6d728d1385e21ba0f18 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5951c6-78aa-4a8a-8750-3f3fe342944c]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-60cab458-1e45-4d8b-879e-536befa14fd8 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Flushing IO for device /dev/sdd {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Successfully updated port: 7a4a74c8-6af2-4a9e-9703-a681c4042c59 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e832aba5-44e7-4d72-929a-c74df33a6501]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-60cab458-1e45-4d8b-879e-536befa14fd8 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-645416e5-6910-49fc-a4f5-70645b4f19eb tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-645416e5-6910-49fc-a4f5-70645b4f19eb tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG nova.compute.manager [None req-645416e5-6910-49fc-a4f5-70645b4f19eb tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Going to confirm migration 2 {{(pid=72773) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Acquiring lock "refresh_cache-0f864e66-41ac-44a5-ae3c-6edec17271cd" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Acquired lock "refresh_cache-0f864e66-41ac-44a5-ae3c-6edec17271cd" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG nova.compute.manager [req-4dfa8e49-e435-4d39-b065-0a5f1806d564 req-85e2e090-8c96-4a10-a999-3735d1bb4129 service nova] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Received event network-changed-7a4a74c8-6af2-4a9e-9703-a681c4042c59 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG nova.compute.manager [req-4dfa8e49-e435-4d39-b065-0a5f1806d564 req-85e2e090-8c96-4a10-a999-3735d1bb4129 service nova] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Refreshing instance network info cache due to event network-changed-7a4a74c8-6af2-4a9e-9703-a681c4042c59. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4dfa8e49-e435-4d39-b065-0a5f1806d564 req-85e2e090-8c96-4a10-a999-3735d1bb4129 service nova] Acquiring lock "refresh_cache-0f864e66-41ac-44a5-ae3c-6edec17271cd" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b873a5-eddb-4422-b556-417563a6408e]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-60cab458-1e45-4d8b-879e-536befa14fd8 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-60cab458-1e45-4d8b-879e-536befa14fd8 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] SCSI volumes sdd have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cab458-1e45-4d8b-879e-536befa14fd8 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[73978e5f-e3eb-486d-a23c-8a7ed86683d9]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cab458-1e45-4d8b-879e-536befa14fd8 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06a1866ee7918873e677d6d728d1385e21ba0f18 --force-share --output=json" returned: 0 in 0.203s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Acquiring lock "06a1866ee7918873e677d6d728d1385e21ba0f18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "06a1866ee7918873e677d6d728d1385e21ba0f18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06a1866ee7918873e677d6d728d1385e21ba0f18 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[de94bbd1-72ab-4263-95e8-a9bd5ba5dd2b]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cab458-1e45-4d8b-879e-536befa14fd8 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014, portal: 172.16.0.220,3260]
Aug 16 22:50:19 user nova-compute[72773]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014, portal: 172.16.0.220,3260] successful.
Aug 16 22:50:19 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66e6fafa-e312-4341-a1a4-1c22895cd014 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6249b9e7-b08f-4096-9883-e6079194f820]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cab458-1e45-4d8b-879e-536befa14fd8 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-60cab458-1e45-4d8b-879e-536befa14fd8 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cab458-1e45-4d8b-879e-536befa14fd8 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] <== disconnect_volume: return (380ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60cab458-1e45-4d8b-879e-536befa14fd8 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-645416e5-6910-49fc-a4f5-70645b4f19eb tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "refresh_cache-43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-645416e5-6910-49fc-a4f5-70645b4f19eb tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquired lock "refresh_cache-43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG nova.network.neutron [None req-645416e5-6910-49fc-a4f5-70645b4f19eb tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG nova.objects.instance [None req-645416e5-6910-49fc-a4f5-70645b4f19eb tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lazy-loading 'info_cache' on Instance uuid 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06a1866ee7918873e677d6d728d1385e21ba0f18 --force-share --output=json" returned: 0 in 0.203s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06a1866ee7918873e677d6d728d1385e21ba0f18,backing_fmt=raw /opt/stack/data/nova/instances/0f864e66-41ac-44a5-ae3c-6edec17271cd/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06a1866ee7918873e677d6d728d1385e21ba0f18,backing_fmt=raw /opt/stack/data/nova/instances/0f864e66-41ac-44a5-ae3c-6edec17271cd/disk 1073741824" returned: 0 in 0.050s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "06a1866ee7918873e677d6d728d1385e21ba0f18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06a1866ee7918873e677d6d728d1385e21ba0f18 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Updating instance_info_cache with network_info: [{"id": "7a4a74c8-6af2-4a9e-9703-a681c4042c59", "address": "fa:16:3e:be:cd:6d", "network": {"id": "f9944803-97d3-451e-ade8-b8cc953c48e3", "bridge": "br-int", "label": "tempest-TestStampPattern-997567034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9da6df5003942baa7e7da93c0e3bc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a4a74c8-6a", "ovs_interfaceid": "7a4a74c8-6af2-4a9e-9703-a681c4042c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Releasing lock "refresh_cache-0f864e66-41ac-44a5-ae3c-6edec17271cd" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Instance network_info: |[{"id": "7a4a74c8-6af2-4a9e-9703-a681c4042c59", "address": "fa:16:3e:be:cd:6d", "network": {"id": "f9944803-97d3-451e-ade8-b8cc953c48e3", "bridge": "br-int", "label": "tempest-TestStampPattern-997567034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9da6df5003942baa7e7da93c0e3bc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a4a74c8-6a", "ovs_interfaceid": "7a4a74c8-6af2-4a9e-9703-a681c4042c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4dfa8e49-e435-4d39-b065-0a5f1806d564 req-85e2e090-8c96-4a10-a999-3735d1bb4129 service nova] Acquired lock "refresh_cache-0f864e66-41ac-44a5-ae3c-6edec17271cd" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG nova.network.neutron [req-4dfa8e49-e435-4d39-b065-0a5f1806d564 req-85e2e090-8c96-4a10-a999-3735d1bb4129 service nova] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Refreshing network info cache for port 7a4a74c8-6af2-4a9e-9703-a681c4042c59 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06a1866ee7918873e677d6d728d1385e21ba0f18 --force-share --output=json" returned: 0 in 0.187s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:50:19 user nova-compute[72773]: DEBUG nova.objects.instance [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lazy-loading 'migration_context' on Instance uuid 0f864e66-41ac-44a5-ae3c-6edec17271cd {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Ensure instance console log exists: /opt/stack/data/nova/instances/0f864e66-41ac-44a5-ae3c-6edec17271cd/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Start _get_guest_xml network_info=[{"id": "7a4a74c8-6af2-4a9e-9703-a681c4042c59", "address": "fa:16:3e:be:cd:6d", "network": {"id": "f9944803-97d3-451e-ade8-b8cc953c48e3", "bridge": "br-int", "label": "tempest-TestStampPattern-997567034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9da6df5003942baa7e7da93c0e3bc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a4a74c8-6a", "ovs_interfaceid": "7a4a74c8-6af2-4a9e-9703-a681c4042c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='ac3565dec34ba20b15c31669ed3363ff',container_format='bare',created_at=2023-08-16T22:50:08Z,direct_url=<?>,disk_format='qcow2',id=04f7f99b-8234-41d3-85d4-4720c41c67b4,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-920946542',owner='b9da6df5003942baa7e7da93c0e3bc79',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T22:50:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '04f7f99b-8234-41d3-85d4-4720c41c67b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:50:20 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:50:20 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ac3565dec34ba20b15c31669ed3363ff',container_format='bare',created_at=2023-08-16T22:50:08Z,direct_url=<?>,disk_format='qcow2',id=04f7f99b-8234-41d3-85d4-4720c41c67b4,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-920946542',owner='b9da6df5003942baa7e7da93c0e3bc79',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T22:50:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:50:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-455631438',display_name='tempest-TestStampPattern-server-455631438',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-455631438',id=43,image_ref='04f7f99b-8234-41d3-85d4-4720c41c67b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzC0aSRz7xXngfuyAWDxc33KMp1GyfHt4lts9ifm5UwE3d17y1lNQi+MHuQTetPPkxrDXwXT5pk8rTxZLOsiBLgU5JxY5FTEUoncDvpwTM+Osg9cwYLjr/DyE/wbeHeRQ==',key_name='tempest-TestStampPattern-749194713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9da6df5003942baa7e7da93c0e3bc79',ramdisk_id='',reservation_id='r-18kmb5ff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='bc6fff46-be38-4089-a6ba-de75e0d7baab',image_min_disk='1',image_min_ram='0',image_owner_id='b9da6df5003942baa7e7da93c0e3bc79',image_owner_project_name='tempest-TestStampPattern-552569719',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-552569719-project-member',image_user_id='7a9bfc4519a64911b5613b3a96a461eb',network_allocated='True',owner_project_name='tempest-TestStampPattern-552569719',owner_user_name='tempest-TestStampPattern-552569719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:50:17Z,user_data=None,user_id='7a9bfc4519a64911b5613b3a96a461eb',uuid=0f864e66-41ac-44a5-ae3c-6edec17271cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a4a74c8-6af2-4a9e-9703-a681c4042c59", "address": "fa:16:3e:be:cd:6d", "network": {"id": "f9944803-97d3-451e-ade8-b8cc953c48e3", "bridge": "br-int", "label": "tempest-TestStampPattern-997567034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9da6df5003942baa7e7da93c0e3bc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a4a74c8-6a", "ovs_interfaceid": "7a4a74c8-6af2-4a9e-9703-a681c4042c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Converting VIF {"id": "7a4a74c8-6af2-4a9e-9703-a681c4042c59", "address": "fa:16:3e:be:cd:6d", "network": {"id": "f9944803-97d3-451e-ade8-b8cc953c48e3", "bridge": "br-int", "label": "tempest-TestStampPattern-997567034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9da6df5003942baa7e7da93c0e3bc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a4a74c8-6a", "ovs_interfaceid": "7a4a74c8-6af2-4a9e-9703-a681c4042c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:cd:6d,bridge_name='br-int',has_traffic_filtering=True,id=7a4a74c8-6af2-4a9e-9703-a681c4042c59,network=Network(f9944803-97d3-451e-ade8-b8cc953c48e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a4a74c8-6a') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.objects.instance [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f864e66-41ac-44a5-ae3c-6edec17271cd {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:50:20 user nova-compute[72773]:   <uuid>0f864e66-41ac-44a5-ae3c-6edec17271cd</uuid>
Aug 16 22:50:20 user nova-compute[72773]:   <name>instance-0000002b</name>
Aug 16 22:50:20 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:50:20 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:50:20 user nova-compute[72773]:   <metadata>
Aug 16 22:50:20 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:50:20 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:50:20 user nova-compute[72773]:       <nova:name>tempest-TestStampPattern-server-455631438</nova:name>
Aug 16 22:50:20 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:50:20</nova:creationTime>
Aug 16 22:50:20 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:50:20 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:50:20 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:50:20 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:50:20 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:50:20 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:50:20 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:50:20 user nova-compute[72773]:       <nova:owner>
Aug 16 22:50:20 user nova-compute[72773]:         <nova:user uuid="7a9bfc4519a64911b5613b3a96a461eb">tempest-TestStampPattern-552569719-project-member</nova:user>
Aug 16 22:50:20 user nova-compute[72773]:         <nova:project uuid="b9da6df5003942baa7e7da93c0e3bc79">tempest-TestStampPattern-552569719</nova:project>
Aug 16 22:50:20 user nova-compute[72773]:       </nova:owner>
Aug 16 22:50:20 user nova-compute[72773]:       <nova:root type="image" uuid="04f7f99b-8234-41d3-85d4-4720c41c67b4"/>
Aug 16 22:50:20 user nova-compute[72773]:       <nova:ports>
Aug 16 22:50:20 user nova-compute[72773]:         <nova:port uuid="7a4a74c8-6af2-4a9e-9703-a681c4042c59">
Aug 16 22:50:20 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 22:50:20 user nova-compute[72773]:         </nova:port>
Aug 16 22:50:20 user nova-compute[72773]:       </nova:ports>
Aug 16 22:50:20 user nova-compute[72773]:     </nova:instance>
Aug 16 22:50:20 user nova-compute[72773]:   </metadata>
Aug 16 22:50:20 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:50:20 user nova-compute[72773]:     <system>
Aug 16 22:50:20 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:50:20 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:50:20 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:50:20 user nova-compute[72773]:       <entry name="serial">0f864e66-41ac-44a5-ae3c-6edec17271cd</entry>
Aug 16 22:50:20 user nova-compute[72773]:       <entry name="uuid">0f864e66-41ac-44a5-ae3c-6edec17271cd</entry>
Aug 16 22:50:20 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:50:20 user nova-compute[72773]:     </system>
Aug 16 22:50:20 user nova-compute[72773]:   </sysinfo>
Aug 16 22:50:20 user nova-compute[72773]:   <os>
Aug 16 22:50:20 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:50:20 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:50:20 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:50:20 user nova-compute[72773]:   </os>
Aug 16 22:50:20 user nova-compute[72773]:   <features>
Aug 16 22:50:20 user nova-compute[72773]:     <acpi/>
Aug 16 22:50:20 user nova-compute[72773]:     <apic/>
Aug 16 22:50:20 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:50:20 user nova-compute[72773]:   </features>
Aug 16 22:50:20 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:50:20 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:50:20 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:50:20 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:50:20 user nova-compute[72773]:   </clock>
Aug 16 22:50:20 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:50:20 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:50:20 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:50:20 user nova-compute[72773]:   </cpu>
Aug 16 22:50:20 user nova-compute[72773]:   <devices>
Aug 16 22:50:20 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:50:20 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:50:20 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/0f864e66-41ac-44a5-ae3c-6edec17271cd/disk"/>
Aug 16 22:50:20 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:50:20 user nova-compute[72773]:     </disk>
Aug 16 22:50:20 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:50:20 user nova-compute[72773]:       <mac address="fa:16:3e:be:cd:6d"/>
Aug 16 22:50:20 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:50:20 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:50:20 user nova-compute[72773]:       <target dev="tap7a4a74c8-6a"/>
Aug 16 22:50:20 user nova-compute[72773]:     </interface>
Aug 16 22:50:20 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:50:20 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/0f864e66-41ac-44a5-ae3c-6edec17271cd/console.log" append="off"/>
Aug 16 22:50:20 user nova-compute[72773]:     </serial>
Aug 16 22:50:20 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:50:20 user nova-compute[72773]:     <video>
Aug 16 22:50:20 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:50:20 user nova-compute[72773]:     </video>
Aug 16 22:50:20 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:50:20 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:50:20 user nova-compute[72773]:     </rng>
Aug 16 22:50:20 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:50:20 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:50:20 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:50:20 user nova-compute[72773]:     </memballoon>
Aug 16 22:50:20 user nova-compute[72773]:   </devices>
Aug 16 22:50:20 user nova-compute[72773]: </domain>
Aug 16 22:50:20 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:50:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-455631438',display_name='tempest-TestStampPattern-server-455631438',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-455631438',id=43,image_ref='04f7f99b-8234-41d3-85d4-4720c41c67b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzC0aSRz7xXngfuyAWDxc33KMp1GyfHt4lts9ifm5UwE3d17y1lNQi+MHuQTetPPkxrDXwXT5pk8rTxZLOsiBLgU5JxY5FTEUoncDvpwTM+Osg9cwYLjr/DyE/wbeHeRQ==',key_name='tempest-TestStampPattern-749194713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9da6df5003942baa7e7da93c0e3bc79',ramdisk_id='',reservation_id='r-18kmb5ff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='bc6fff46-be38-4089-a6ba-de75e0d7baab',image_min_disk='1',image_min_ram='0',image_owner_id='b9da6df5003942baa7e7da93c0e3bc79',image_owner_project_name='tempest-TestStampPattern-552569719',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-552569719-project-member',image_user_id='7a9bfc4519a64911b5613b3a96a461eb',network_allocated='True',owner_project_name='tempest-TestStampPattern-552569719',owner_user_name='tempest-TestStampPattern-552569719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:50:17Z,user_data=None,user_id='7a9bfc4519a64911b5613b3a96a461eb',uuid=0f864e66-41ac-44a5-ae3c-6edec17271cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a4a74c8-6af2-4a9e-9703-a681c4042c59", "address": "fa:16:3e:be:cd:6d", "network": {"id": "f9944803-97d3-451e-ade8-b8cc953c48e3", "bridge": "br-int", "label": "tempest-TestStampPattern-997567034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9da6df5003942baa7e7da93c0e3bc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a4a74c8-6a", "ovs_interfaceid": "7a4a74c8-6af2-4a9e-9703-a681c4042c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Converting VIF {"id": "7a4a74c8-6af2-4a9e-9703-a681c4042c59", "address": "fa:16:3e:be:cd:6d", "network": {"id": "f9944803-97d3-451e-ade8-b8cc953c48e3", "bridge": "br-int", "label": "tempest-TestStampPattern-997567034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9da6df5003942baa7e7da93c0e3bc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a4a74c8-6a", "ovs_interfaceid": "7a4a74c8-6af2-4a9e-9703-a681c4042c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:cd:6d,bridge_name='br-int',has_traffic_filtering=True,id=7a4a74c8-6af2-4a9e-9703-a681c4042c59,network=Network(f9944803-97d3-451e-ade8-b8cc953c48e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a4a74c8-6a') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG os_vif [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:cd:6d,bridge_name='br-int',has_traffic_filtering=True,id=7a4a74c8-6af2-4a9e-9703-a681c4042c59,network=Network(f9944803-97d3-451e-ade8-b8cc953c48e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a4a74c8-6a') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a4a74c8-6a, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7a4a74c8-6a, col_values=(('external_ids', {'iface-id': '7a4a74c8-6af2-4a9e-9703-a681c4042c59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:cd:6d', 'vm-uuid': '0f864e66-41ac-44a5-ae3c-6edec17271cd'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:50:20 user nova-compute[72773]: INFO os_vif [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:cd:6d,bridge_name='br-int',has_traffic_filtering=True,id=7a4a74c8-6af2-4a9e-9703-a681c4042c59,network=Network(f9944803-97d3-451e-ade8-b8cc953c48e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a4a74c8-6a')
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] No VIF found with MAC fa:16:3e:be:cd:6d, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.network.neutron [None req-645416e5-6910-49fc-a4f5-70645b4f19eb tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Updating instance_info_cache with network_info: [{"id": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "address": "fa:16:3e:e2:fd:fb", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c7b3aa-98", "ovs_interfaceid": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-645416e5-6910-49fc-a4f5-70645b4f19eb tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Releasing lock "refresh_cache-43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.objects.instance [None req-645416e5-6910-49fc-a4f5-70645b4f19eb tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lazy-loading 'migration_context' on Instance uuid 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-645416e5-6910-49fc-a4f5-70645b4f19eb tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-645416e5-6910-49fc-a4f5-70645b4f19eb tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.objects.instance [None req-60cab458-1e45-4d8b-879e-536befa14fd8 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lazy-loading 'flavor' on Instance uuid 29c612f4-5ed1-46db-bdec-0eed58384746 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-60cab458-1e45-4d8b-879e-536befa14fd8 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "29c612f4-5ed1-46db-bdec-0eed58384746" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.946s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-645416e5-6910-49fc-a4f5-70645b4f19eb tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-645416e5-6910-49fc-a4f5-70645b4f19eb tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-645416e5-6910-49fc-a4f5-70645b4f19eb tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.299s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:50:20 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-645416e5-6910-49fc-a4f5-70645b4f19eb tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Deleted allocation for migration 922a93d5-b2fb-4885-a0d0-256608a54a93
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.network.neutron [req-4dfa8e49-e435-4d39-b065-0a5f1806d564 req-85e2e090-8c96-4a10-a999-3735d1bb4129 service nova] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Updated VIF entry in instance network info cache for port 7a4a74c8-6af2-4a9e-9703-a681c4042c59. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG nova.network.neutron [req-4dfa8e49-e435-4d39-b065-0a5f1806d564 req-85e2e090-8c96-4a10-a999-3735d1bb4129 service nova] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Updating instance_info_cache with network_info: [{"id": "7a4a74c8-6af2-4a9e-9703-a681c4042c59", "address": "fa:16:3e:be:cd:6d", "network": {"id": "f9944803-97d3-451e-ade8-b8cc953c48e3", "bridge": "br-int", "label": "tempest-TestStampPattern-997567034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9da6df5003942baa7e7da93c0e3bc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a4a74c8-6a", "ovs_interfaceid": "7a4a74c8-6af2-4a9e-9703-a681c4042c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4dfa8e49-e435-4d39-b065-0a5f1806d564 req-85e2e090-8c96-4a10-a999-3735d1bb4129 service nova] Releasing lock "refresh_cache-0f864e66-41ac-44a5-ae3c-6edec17271cd" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:50:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-645416e5-6910-49fc-a4f5-70645b4f19eb tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.376s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:50:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:50:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:50:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:50:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:50:21 user nova-compute[72773]: DEBUG nova.compute.manager [req-3c4de2ee-7e89-4707-ba60-fb25cf0ef3ac req-d5aa82a7-b48f-443a-8f7e-2a954d2c9d02 service nova] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Received event network-vif-plugged-7a4a74c8-6af2-4a9e-9703-a681c4042c59 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:50:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3c4de2ee-7e89-4707-ba60-fb25cf0ef3ac req-d5aa82a7-b48f-443a-8f7e-2a954d2c9d02 service nova] Acquiring lock "0f864e66-41ac-44a5-ae3c-6edec17271cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:50:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3c4de2ee-7e89-4707-ba60-fb25cf0ef3ac req-d5aa82a7-b48f-443a-8f7e-2a954d2c9d02 service nova] Lock "0f864e66-41ac-44a5-ae3c-6edec17271cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:50:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3c4de2ee-7e89-4707-ba60-fb25cf0ef3ac req-d5aa82a7-b48f-443a-8f7e-2a954d2c9d02 service nova] Lock "0f864e66-41ac-44a5-ae3c-6edec17271cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:50:21 user nova-compute[72773]: DEBUG nova.compute.manager [req-3c4de2ee-7e89-4707-ba60-fb25cf0ef3ac req-d5aa82a7-b48f-443a-8f7e-2a954d2c9d02 service nova] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] No waiting events found dispatching network-vif-plugged-7a4a74c8-6af2-4a9e-9703-a681c4042c59 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:50:21 user nova-compute[72773]: WARNING nova.compute.manager [req-3c4de2ee-7e89-4707-ba60-fb25cf0ef3ac req-d5aa82a7-b48f-443a-8f7e-2a954d2c9d02 service nova] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Received unexpected event network-vif-plugged-7a4a74c8-6af2-4a9e-9703-a681c4042c59 for instance with vm_state building and task_state spawning.
Aug 16 22:50:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:50:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:50:23 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692226223.5179179, 0f864e66-41ac-44a5-ae3c-6edec17271cd => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:50:23 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] VM Resumed (Lifecycle Event)
Aug 16 22:50:23 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:50:23 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:50:23 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Instance spawned successfully.
Aug 16 22:50:23 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:50:23 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:50:23 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:50:23 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:50:23 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:50:23 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:50:23 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692226223.5193958, 0f864e66-41ac-44a5-ae3c-6edec17271cd => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:50:23 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] VM Started (Lifecycle Event)
Aug 16 22:50:23 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:50:23 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:50:23 user nova-compute[72773]: DEBUG nova.compute.manager [req-fc90de75-3a89-4502-8d7a-e376574dbc09 req-408b796c-0c31-435e-a198-2778c3055da1 service nova] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Received event network-vif-plugged-7a4a74c8-6af2-4a9e-9703-a681c4042c59 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:50:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fc90de75-3a89-4502-8d7a-e376574dbc09 req-408b796c-0c31-435e-a198-2778c3055da1 service nova] Acquiring lock "0f864e66-41ac-44a5-ae3c-6edec17271cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:50:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fc90de75-3a89-4502-8d7a-e376574dbc09 req-408b796c-0c31-435e-a198-2778c3055da1 service nova] Lock "0f864e66-41ac-44a5-ae3c-6edec17271cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:50:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fc90de75-3a89-4502-8d7a-e376574dbc09 req-408b796c-0c31-435e-a198-2778c3055da1 service nova] Lock "0f864e66-41ac-44a5-ae3c-6edec17271cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:50:23 user nova-compute[72773]: DEBUG nova.compute.manager [req-fc90de75-3a89-4502-8d7a-e376574dbc09 req-408b796c-0c31-435e-a198-2778c3055da1 service nova] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] No waiting events found dispatching network-vif-plugged-7a4a74c8-6af2-4a9e-9703-a681c4042c59 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:50:23 user nova-compute[72773]: WARNING nova.compute.manager [req-fc90de75-3a89-4502-8d7a-e376574dbc09 req-408b796c-0c31-435e-a198-2778c3055da1 service nova] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Received unexpected event network-vif-plugged-7a4a74c8-6af2-4a9e-9703-a681c4042c59 for instance with vm_state building and task_state spawning.
Aug 16 22:50:23 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:50:23 user nova-compute[72773]: INFO nova.compute.manager [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Took 6.68 seconds to spawn the instance on the hypervisor.
Aug 16 22:50:23 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:50:23 user nova-compute[72773]: INFO nova.compute.manager [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Took 7.47 seconds to build instance.
Aug 16 22:50:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7eecf895-cd71-4246-b473-e3cf690d1278 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "0f864e66-41ac-44a5-ae3c-6edec17271cd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.586s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:50:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:50:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:50:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:50:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:50:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:50:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:50:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:50:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:50:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:50:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:50:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:50:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:50:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:50:59 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:51:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:51:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:51:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 22:51:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:51:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:51:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:51:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:51:06 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:51:07 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:51:07 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:51:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-f97d8a95-e281-496b-bb62-81747a5c2ffc" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:51:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-f97d8a95-e281-496b-bb62-81747a5c2ffc" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:51:07 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 22:51:08 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Updating instance_info_cache with network_info: [{"id": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "address": "fa:16:3e:12:35:93", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0ffcbd-76", "ovs_interfaceid": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:51:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-f97d8a95-e281-496b-bb62-81747a5c2ffc" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:51:08 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 22:51:08 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:51:08 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:51:08 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:51:09 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:51:09 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:51:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Acquiring lock "29c612f4-5ed1-46db-bdec-0eed58384746" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "29c612f4-5ed1-46db-bdec-0eed58384746" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG nova.objects.instance [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lazy-loading 'flavor' on Instance uuid 29c612f4-5ed1-46db-bdec-0eed58384746 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "29c612f4-5ed1-46db-bdec-0eed58384746" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Acquiring lock "29c612f4-5ed1-46db-bdec-0eed58384746" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "29c612f4-5ed1-46db-bdec-0eed58384746" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:51:11 user nova-compute[72773]: INFO nova.compute.manager [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Attaching volume f923512c-42c2-4f10-ada2-ed13a43d759b to /dev/vdb
Aug 16 22:51:11 user nova-compute[72773]: DEBUG os_brick.utils [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cfdcde-d398-4237-95be-233304edcd4d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f9cce2-00f7-409a-901c-5161b2907100]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[29194107-aa92-4c06-9a4a-3cbd7c048d16]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[319129b6-0fe4-4dd9-b8c0-78234a1f4609]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:51:11 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:51:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[84abe87c-fa32-4549-be02-ab9b4fcfe7f5]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG os_brick.utils [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Updating existing volume attachment record: c7a0cd97-dd4a-4823-b2f6-0d20a85ba7cb {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:51:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f864e66-41ac-44a5-ae3c-6edec17271cd/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f864e66-41ac-44a5-ae3c-6edec17271cd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f864e66-41ac-44a5-ae3c-6edec17271cd/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f864e66-41ac-44a5-ae3c-6edec17271cd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:13 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:51:13 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:51:13 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=8062MB free_disk=25.32561492919922GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:51:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:51:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:51:14 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance f4210738-d01e-4408-a15c-aeccada6dd23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:51:14 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance f97d8a95-e281-496b-bb62-81747a5c2ffc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:51:14 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance bc6fff46-be38-4089-a6ba-de75e0d7baab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:51:14 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 29c612f4-5ed1-46db-bdec-0eed58384746 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:51:14 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:51:14 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 0f864e66-41ac-44a5-ae3c-6edec17271cd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:51:14 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:51:14 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:51:14 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Refreshing inventories for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 22:51:14 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Updating ProviderTree inventory for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 22:51:14 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Updating inventory in ProviderTree for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 22:51:14 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Refreshing aggregate associations for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e, aggregates: None {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 22:51:14 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Refreshing trait associations for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 22:51:14 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:51:14 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:51:14 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:51:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.757s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:51:14 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:51:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Cleaning up deleted instances {{(pid=72773) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 22:51:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] There are 0 instances to clean {{(pid=72773) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 22:51:14 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:51:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Cleaning up deleted instances with incomplete migration  {{(pid=72773) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 22:51:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:51:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:51:17 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:51:17 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:51:18 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:51:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:51:21 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JFlMNZUI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:51:25 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:51:25 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:51:25 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:51:25 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:51:25 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:51:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6637471e-5813-47fe-a6fe-c59a018586fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:51:25 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a80feb-1e72-4979-8ea8-9463519c1a96]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b] added
Aug 16 22:51:25 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57d7e7b-b66e-49d0-8026-c45b73935d3f]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f641b0-2a1c-47ca-a1e2-98cefe1f76a3]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JFlMNZUI {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JFlMNZUI" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9c8a85-49b2-4252-80b9-f26aa20d5fd3]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JFlMNZUI'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cf0ee5-bdec-4455-a01d-4cfef23388bd]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0499ebf-4ed0-49f3-a550-b8a0f461afa2]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:51:25 user nova-compute[72773]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)
Aug 16 22:51:25 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:51:25 user nova-compute[72773]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)
Aug 16 22:51:25 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:51:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:26 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[af040ae0-9c67-426b-9318-94378cf5d99f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:51:26 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b, portal: 172.16.0.220,3260]
Aug 16 22:51:26 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b, portal: 172.16.0.220,3260] successful.
Aug 16 22:51:26 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:51:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:26 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[25897a48-e9a8-4a22-8062-b56d18cb2fb0]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:51:26 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:51:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:26 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d34784-c0df-46ed-ac44-52fbff8866e5]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:51:26 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:51:26 user nova-compute[72773]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)
Aug 16 22:51:26 user nova-compute[72773]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b (non-flash)
Aug 16 22:51:26 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:51:26 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:51:26 user nova-compute[72773]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)
Aug 16 22:51:26 user nova-compute[72773]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b (non-flash)
Aug 16 22:51:26 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:51:26 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:51:26 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:51:26 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:51:26 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:51:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:26 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[53583d98-e3a2-4272-b17a-3fdbc0354145]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:51:26 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: None {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:51:27 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:51:27 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JFlMNZUI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:51:27 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:51:27 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23562633864386238', 'path': '/dev/sdd'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:51:27 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562633864386238', 'path': '/dev/sdd'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:51:27 user nova-compute[72773]: DEBUG nova.objects.instance [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lazy-loading 'flavor' on Instance uuid 29c612f4-5ed1-46db-bdec-0eed58384746 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:51:27 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 22:51:27 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:51:27 user nova-compute[72773]:   <source dev="/dev/sdd"/>
Aug 16 22:51:27 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:51:27 user nova-compute[72773]:   <serial>f923512c-42c2-4f10-ada2-ed13a43d759b</serial>
Aug 16 22:51:27 user nova-compute[72773]: </disk>
Aug 16 22:51:27 user nova-compute[72773]:  {{(pid=72773) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 22:51:27 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:51:27 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:51:27 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] No VIF found with MAC fa:16:3e:1b:7d:b0, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:51:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f9e6ee7f-2a38-445a-9075-55e04179bbe6 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "29c612f4-5ed1-46db-bdec-0eed58384746" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.991s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:51:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b6bfb4db-ff70-4551-a106-862d34c1d5c3 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Acquiring lock "29c612f4-5ed1-46db-bdec-0eed58384746" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:51:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b6bfb4db-ff70-4551-a106-862d34c1d5c3 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "29c612f4-5ed1-46db-bdec-0eed58384746" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:51:29 user nova-compute[72773]: INFO nova.compute.manager [None req-b6bfb4db-ff70-4551-a106-862d34c1d5c3 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Detaching volume f923512c-42c2-4f10-ada2-ed13a43d759b
Aug 16 22:51:29 user nova-compute[72773]: INFO nova.virt.block_device [None req-b6bfb4db-ff70-4551-a106-862d34c1d5c3 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Attempting to driver detach volume f923512c-42c2-4f10-ada2-ed13a43d759b from mountpoint /dev/vdb
Aug 16 22:51:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b6bfb4db-ff70-4551-a106-862d34c1d5c3 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Attempting to detach device vdb from instance 29c612f4-5ed1-46db-bdec-0eed58384746 from the persistent domain config. {{(pid=72773) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 22:51:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-b6bfb4db-ff70-4551-a106-862d34c1d5c3 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:51:29 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:51:29 user nova-compute[72773]:   <source dev="/dev/sdd"/>
Aug 16 22:51:29 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:51:29 user nova-compute[72773]:   <serial>f923512c-42c2-4f10-ada2-ed13a43d759b</serial>
Aug 16 22:51:29 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:51:29 user nova-compute[72773]: </disk>
Aug 16 22:51:29 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:51:29 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-b6bfb4db-ff70-4551-a106-862d34c1d5c3 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Successfully detached device vdb from instance 29c612f4-5ed1-46db-bdec-0eed58384746 from the persistent domain config.
Aug 16 22:51:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b6bfb4db-ff70-4551-a106-862d34c1d5c3 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 29c612f4-5ed1-46db-bdec-0eed58384746 from the live domain config. {{(pid=72773) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 22:51:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-b6bfb4db-ff70-4551-a106-862d34c1d5c3 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:51:29 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:51:29 user nova-compute[72773]:   <source dev="/dev/sdd"/>
Aug 16 22:51:29 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:51:29 user nova-compute[72773]:   <serial>f923512c-42c2-4f10-ada2-ed13a43d759b</serial>
Aug 16 22:51:29 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:51:29 user nova-compute[72773]: </disk>
Aug 16 22:51:29 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Received event <DeviceRemovedEvent: 1692226290.0121324, 29c612f4-5ed1-46db-bdec-0eed58384746 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72773) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b6bfb4db-ff70-4551-a106-862d34c1d5c3 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 29c612f4-5ed1-46db-bdec-0eed58384746 {{(pid=72773) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 22:51:30 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-b6bfb4db-ff70-4551-a106-862d34c1d5c3 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Successfully detached device vdb from instance 29c612f4-5ed1-46db-bdec-0eed58384746 from the live domain config.
Aug 16 22:51:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6bfb4db-ff70-4551-a106-862d34c1d5c3 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bfb4db-ff70-4551-a106-862d34c1d5c3 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JFlMNZUI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:51:30 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-b6bfb4db-ff70-4551-a106-862d34c1d5c3 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:51:30 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-b6bfb4db-ff70-4551-a106-862d34c1d5c3 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-b6bfb4db-ff70-4551-a106-862d34c1d5c3 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bfb4db-ff70-4551-a106-862d34c1d5c3 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00c222f-0feb-4866-8a4a-3e011145ce2e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[57586e08-1f56-4b8a-a783-2bc4974b2780]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bfb4db-ff70-4551-a106-862d34c1d5c3 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:51:30 user nova-compute[72773]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)
Aug 16 22:51:30 user nova-compute[72773]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b (non-flash)
Aug 16 22:51:30 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bfb4db-ff70-4551-a106-862d34c1d5c3 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:51:30 user nova-compute[72773]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)
Aug 16 22:51:30 user nova-compute[72773]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b (non-flash)
Aug 16 22:51:30 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bfb4db-ff70-4551-a106-862d34c1d5c3 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef800fd240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b'): ({'sdd'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-b6bfb4db-ff70-4551-a106-862d34c1d5c3 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Removing single pathed devices sdd {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[578e5c8c-ee6a-43cc-82c2-134b5c155d17]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c91eb9-d666-4070-b400-90815c57073c]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-b6bfb4db-ff70-4551-a106-862d34c1d5c3 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Flushing IO for device /dev/sdd {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[040d43e5-d38d-4da1-b121-8ed4de6015a1]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-b6bfb4db-ff70-4551-a106-862d34c1d5c3 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceedfa70-96e0-449f-afde-19949b85ece7]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-b6bfb4db-ff70-4551-a106-862d34c1d5c3 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-b6bfb4db-ff70-4551-a106-862d34c1d5c3 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] SCSI volumes sdd have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bfb4db-ff70-4551-a106-862d34c1d5c3 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcef71b-7ec1-414c-9015-f5c390fcb650]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bfb4db-ff70-4551-a106-862d34c1d5c3 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd83eba6-970f-41b0-8684-bc2d02100d3c]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bfb4db-ff70-4551-a106-862d34c1d5c3 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b, portal: 172.16.0.220,3260]
Aug 16 22:51:30 user nova-compute[72773]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b, portal: 172.16.0.220,3260] successful.
Aug 16 22:51:30 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f923512c-42c2-4f10-ada2-ed13a43d759b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a4e76e-8ecf-44b3-b29f-d0cc987c1c53]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bfb4db-ff70-4551-a106-862d34c1d5c3 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-b6bfb4db-ff70-4551-a106-862d34c1d5c3 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bfb4db-ff70-4551-a106-862d34c1d5c3 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] <== disconnect_volume: return (265ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6bfb4db-ff70-4551-a106-862d34c1d5c3 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:51:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:51:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b3874ade-5d88-46fe-b51f-f04d6874f41e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "f97d8a95-e281-496b-bb62-81747a5c2ffc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:51:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b3874ade-5d88-46fe-b51f-f04d6874f41e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:51:31 user nova-compute[72773]: INFO nova.compute.manager [None req-b3874ade-5d88-46fe-b51f-f04d6874f41e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Detaching volume 3510e728-af0a-49bf-8a0d-c07fc7fea601
Aug 16 22:51:31 user nova-compute[72773]: INFO nova.virt.block_device [None req-b3874ade-5d88-46fe-b51f-f04d6874f41e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Attempting to driver detach volume 3510e728-af0a-49bf-8a0d-c07fc7fea601 from mountpoint /dev/vdb
Aug 16 22:51:31 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b3874ade-5d88-46fe-b51f-f04d6874f41e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Attempting to detach device vdb from instance f97d8a95-e281-496b-bb62-81747a5c2ffc from the persistent domain config. {{(pid=72773) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 22:51:31 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-b3874ade-5d88-46fe-b51f-f04d6874f41e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:51:31 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:51:31 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 22:51:31 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:51:31 user nova-compute[72773]:   <serial>3510e728-af0a-49bf-8a0d-c07fc7fea601</serial>
Aug 16 22:51:31 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 22:51:31 user nova-compute[72773]: </disk>
Aug 16 22:51:31 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:51:31 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-b3874ade-5d88-46fe-b51f-f04d6874f41e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Successfully detached device vdb from instance f97d8a95-e281-496b-bb62-81747a5c2ffc from the persistent domain config.
Aug 16 22:51:31 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b3874ade-5d88-46fe-b51f-f04d6874f41e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f97d8a95-e281-496b-bb62-81747a5c2ffc from the live domain config. {{(pid=72773) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 22:51:31 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-b3874ade-5d88-46fe-b51f-f04d6874f41e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:51:31 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:51:31 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 22:51:31 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:51:31 user nova-compute[72773]:   <serial>3510e728-af0a-49bf-8a0d-c07fc7fea601</serial>
Aug 16 22:51:31 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 22:51:31 user nova-compute[72773]: </disk>
Aug 16 22:51:31 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Received event <DeviceRemovedEvent: 1692226292.1554017, f97d8a95-e281-496b-bb62-81747a5c2ffc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72773) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b3874ade-5d88-46fe-b51f-f04d6874f41e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f97d8a95-e281-496b-bb62-81747a5c2ffc {{(pid=72773) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 22:51:32 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-b3874ade-5d88-46fe-b51f-f04d6874f41e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Successfully detached device vdb from instance f97d8a95-e281-496b-bb62-81747a5c2ffc from the live domain config.
Aug 16 22:51:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3874ade-5d88-46fe-b51f-f04d6874f41e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3874ade-5d88-46fe-b51f-f04d6874f41e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFyBYEOq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:51:32 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-b3874ade-5d88-46fe-b51f-f04d6874f41e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:51:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-b3874ade-5d88-46fe-b51f-f04d6874f41e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-b3874ade-5d88-46fe-b51f-f04d6874f41e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3874ade-5d88-46fe-b51f-f04d6874f41e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ed27b3-bb1d-479a-bd00-58b1246bd030]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eabfa9f-7568-4679-aec8-5b97b8858492]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3874ade-5d88-46fe-b51f-f04d6874f41e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:51:32 user nova-compute[72773]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)
Aug 16 22:51:32 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3874ade-5d88-46fe-b51f-f04d6874f41e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:51:32 user nova-compute[72773]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 (non-flash)
Aug 16 22:51:32 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3874ade-5d88-46fe-b51f-f04d6874f41e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef802b8e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601'): ({'sdc'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-b3874ade-5d88-46fe-b51f-f04d6874f41e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Removing single pathed devices sdc {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6a0dda-d874-4dca-b3ce-cd91e9562be1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[860100e0-7594-4d8a-b8b1-9a7ff69b7ef8]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-b3874ade-5d88-46fe-b51f-f04d6874f41e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Flushing IO for device /dev/sdc {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd55ab4-d65b-48b2-857d-5317f825c086]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-b3874ade-5d88-46fe-b51f-f04d6874f41e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfff545d-030c-4d6b-951d-2027b4c5b872]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-b3874ade-5d88-46fe-b51f-f04d6874f41e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-b3874ade-5d88-46fe-b51f-f04d6874f41e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3874ade-5d88-46fe-b51f-f04d6874f41e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[952bf854-f54c-4ec1-8989-1d8ace71cf7d]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3874ade-5d88-46fe-b51f-f04d6874f41e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1a5c74-3ea7-4450-b54d-7c3bb787a68c]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3874ade-5d88-46fe-b51f-f04d6874f41e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601, portal: 172.16.0.220,3260]
Aug 16 22:51:32 user nova-compute[72773]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601, portal: 172.16.0.220,3260] successful.
Aug 16 22:51:32 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3510e728-af0a-49bf-8a0d-c07fc7fea601 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[213d9035-7745-4bc6-a71a-8d76998b1093]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3874ade-5d88-46fe-b51f-f04d6874f41e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-b3874ade-5d88-46fe-b51f-f04d6874f41e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3874ade-5d88-46fe-b51f-f04d6874f41e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] <== disconnect_volume: return (268ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:51:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3874ade-5d88-46fe-b51f-f04d6874f41e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:51:33 user nova-compute[72773]: DEBUG nova.objects.instance [None req-b3874ade-5d88-46fe-b51f-f04d6874f41e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lazy-loading 'flavor' on Instance uuid f97d8a95-e281-496b-bb62-81747a5c2ffc {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:51:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b3874ade-5d88-46fe-b51f-f04d6874f41e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.650s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:51:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-80890e9e-4b86-43cf-b26e-386b4917112f tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "f97d8a95-e281-496b-bb62-81747a5c2ffc" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:51:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-80890e9e-4b86-43cf-b26e-386b4917112f tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:51:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-80890e9e-4b86-43cf-b26e-386b4917112f tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:51:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-80890e9e-4b86-43cf-b26e-386b4917112f tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72773) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 16 22:51:33 user nova-compute[72773]: DEBUG nova.objects.instance [None req-80890e9e-4b86-43cf-b26e-386b4917112f tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lazy-loading 'flavor' on Instance uuid f97d8a95-e281-496b-bb62-81747a5c2ffc {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:51:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:51:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:51:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:51:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:51:34 user nova-compute[72773]: DEBUG nova.compute.manager [req-dea4335b-f7dd-4cbd-939d-0021aab09f38 req-15e426c6-e907-4b69-b8f8-0a41fe500ccf service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Received event network-vif-unplugged-3c0ffcbd-768e-4040-8765-663fa495a3ab {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:51:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-dea4335b-f7dd-4cbd-939d-0021aab09f38 req-15e426c6-e907-4b69-b8f8-0a41fe500ccf service nova] Acquiring lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:51:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-dea4335b-f7dd-4cbd-939d-0021aab09f38 req-15e426c6-e907-4b69-b8f8-0a41fe500ccf service nova] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:51:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-dea4335b-f7dd-4cbd-939d-0021aab09f38 req-15e426c6-e907-4b69-b8f8-0a41fe500ccf service nova] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:51:34 user nova-compute[72773]: DEBUG nova.compute.manager [req-dea4335b-f7dd-4cbd-939d-0021aab09f38 req-15e426c6-e907-4b69-b8f8-0a41fe500ccf service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] No waiting events found dispatching network-vif-unplugged-3c0ffcbd-768e-4040-8765-663fa495a3ab {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:51:34 user nova-compute[72773]: WARNING nova.compute.manager [req-dea4335b-f7dd-4cbd-939d-0021aab09f38 req-15e426c6-e907-4b69-b8f8-0a41fe500ccf service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Received unexpected event network-vif-unplugged-3c0ffcbd-768e-4040-8765-663fa495a3ab for instance with vm_state active and task_state powering-off.
Aug 16 22:51:34 user nova-compute[72773]: DEBUG nova.objects.instance [None req-b6bfb4db-ff70-4551-a106-862d34c1d5c3 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lazy-loading 'flavor' on Instance uuid 29c612f4-5ed1-46db-bdec-0eed58384746 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:51:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b6bfb4db-ff70-4551-a106-862d34c1d5c3 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "29c612f4-5ed1-46db-bdec-0eed58384746" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.990s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:51:34 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Instance destroyed successfully.
Aug 16 22:51:34 user nova-compute[72773]: DEBUG nova.compute.manager [None req-80890e9e-4b86-43cf-b26e-386b4917112f tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:51:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-80890e9e-4b86-43cf-b26e-386b4917112f tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.939s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:51:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:51:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:51:36 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_power_states {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:51:36 user nova-compute[72773]: DEBUG nova.compute.manager [req-3772b97c-6152-4ab0-a748-5672995bac5a req-580ef8a3-ba59-45f1-92af-0974ce89a778 service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Received event network-vif-plugged-3c0ffcbd-768e-4040-8765-663fa495a3ab {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:51:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3772b97c-6152-4ab0-a748-5672995bac5a req-580ef8a3-ba59-45f1-92af-0974ce89a778 service nova] Acquiring lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:51:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3772b97c-6152-4ab0-a748-5672995bac5a req-580ef8a3-ba59-45f1-92af-0974ce89a778 service nova] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:51:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3772b97c-6152-4ab0-a748-5672995bac5a req-580ef8a3-ba59-45f1-92af-0974ce89a778 service nova] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:51:36 user nova-compute[72773]: DEBUG nova.compute.manager [req-3772b97c-6152-4ab0-a748-5672995bac5a req-580ef8a3-ba59-45f1-92af-0974ce89a778 service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] No waiting events found dispatching network-vif-plugged-3c0ffcbd-768e-4040-8765-663fa495a3ab {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:51:36 user nova-compute[72773]: WARNING nova.compute.manager [req-3772b97c-6152-4ab0-a748-5672995bac5a req-580ef8a3-ba59-45f1-92af-0974ce89a778 service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Received unexpected event network-vif-plugged-3c0ffcbd-768e-4040-8765-663fa495a3ab for instance with vm_state stopped and task_state None.
Aug 16 22:51:36 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Triggering sync for uuid f4210738-d01e-4408-a15c-aeccada6dd23 {{(pid=72773) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 22:51:36 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Triggering sync for uuid f97d8a95-e281-496b-bb62-81747a5c2ffc {{(pid=72773) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 22:51:36 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Triggering sync for uuid 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1 {{(pid=72773) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 22:51:36 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Triggering sync for uuid bc6fff46-be38-4089-a6ba-de75e0d7baab {{(pid=72773) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 22:51:36 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Triggering sync for uuid 29c612f4-5ed1-46db-bdec-0eed58384746 {{(pid=72773) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 22:51:36 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Triggering sync for uuid 0f864e66-41ac-44a5-ae3c-6edec17271cd {{(pid=72773) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 22:51:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "f4210738-d01e-4408-a15c-aeccada6dd23" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:51:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "f4210738-d01e-4408-a15c-aeccada6dd23" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:51:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "f97d8a95-e281-496b-bb62-81747a5c2ffc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:51:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:51:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:51:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:51:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "bc6fff46-be38-4089-a6ba-de75e0d7baab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:51:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "bc6fff46-be38-4089-a6ba-de75e0d7baab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:51:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "29c612f4-5ed1-46db-bdec-0eed58384746" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:51:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "29c612f4-5ed1-46db-bdec-0eed58384746" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:51:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "0f864e66-41ac-44a5-ae3c-6edec17271cd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:51:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "0f864e66-41ac-44a5-ae3c-6edec17271cd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:51:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "f4210738-d01e-4408-a15c-aeccada6dd23" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:51:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:51:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:51:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "bc6fff46-be38-4089-a6ba-de75e0d7baab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:51:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "0f864e66-41ac-44a5-ae3c-6edec17271cd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:51:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "29c612f4-5ed1-46db-bdec-0eed58384746" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:51:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:51:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:51:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:51:49 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692226294.7904706, f97d8a95-e281-496b-bb62-81747a5c2ffc => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:51:49 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] VM Stopped (Lifecycle Event)
Aug 16 22:51:49 user nova-compute[72773]: DEBUG nova.compute.manager [None req-40c739f7-978a-420a-b4db-bb9f396b16d7 None None] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:51:49 user nova-compute[72773]: DEBUG nova.compute.manager [None req-40c739f7-978a-420a-b4db-bb9f396b16d7 None None] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:51:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:51:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:52:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:52:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:52:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 22:52:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:52:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:52:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:52:00 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:52:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:52:06 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:52:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:52:08 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:52:08 user nova-compute[72773]: DEBUG nova.compute.manager [req-a303b844-5667-46b2-90a0-16a28b9ae284 req-f0c474ba-f61e-46fb-8727-ffdd0e5762b3 service nova] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Received event network-changed-7a4a74c8-6af2-4a9e-9703-a681c4042c59 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:52:08 user nova-compute[72773]: DEBUG nova.compute.manager [req-a303b844-5667-46b2-90a0-16a28b9ae284 req-f0c474ba-f61e-46fb-8727-ffdd0e5762b3 service nova] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Refreshing instance network info cache due to event network-changed-7a4a74c8-6af2-4a9e-9703-a681c4042c59. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:52:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a303b844-5667-46b2-90a0-16a28b9ae284 req-f0c474ba-f61e-46fb-8727-ffdd0e5762b3 service nova] Acquiring lock "refresh_cache-0f864e66-41ac-44a5-ae3c-6edec17271cd" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:52:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a303b844-5667-46b2-90a0-16a28b9ae284 req-f0c474ba-f61e-46fb-8727-ffdd0e5762b3 service nova] Acquired lock "refresh_cache-0f864e66-41ac-44a5-ae3c-6edec17271cd" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:52:08 user nova-compute[72773]: DEBUG nova.network.neutron [req-a303b844-5667-46b2-90a0-16a28b9ae284 req-f0c474ba-f61e-46fb-8727-ffdd0e5762b3 service nova] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Refreshing network info cache for port 7a4a74c8-6af2-4a9e-9703-a681c4042c59 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:52:09 user nova-compute[72773]: DEBUG nova.network.neutron [req-a303b844-5667-46b2-90a0-16a28b9ae284 req-f0c474ba-f61e-46fb-8727-ffdd0e5762b3 service nova] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Updated VIF entry in instance network info cache for port 7a4a74c8-6af2-4a9e-9703-a681c4042c59. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:52:09 user nova-compute[72773]: DEBUG nova.network.neutron [req-a303b844-5667-46b2-90a0-16a28b9ae284 req-f0c474ba-f61e-46fb-8727-ffdd0e5762b3 service nova] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Updating instance_info_cache with network_info: [{"id": "7a4a74c8-6af2-4a9e-9703-a681c4042c59", "address": "fa:16:3e:be:cd:6d", "network": {"id": "f9944803-97d3-451e-ade8-b8cc953c48e3", "bridge": "br-int", "label": "tempest-TestStampPattern-997567034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9da6df5003942baa7e7da93c0e3bc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a4a74c8-6a", "ovs_interfaceid": "7a4a74c8-6af2-4a9e-9703-a681c4042c59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:52:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Acquiring lock "0f864e66-41ac-44a5-ae3c-6edec17271cd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:52:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "0f864e66-41ac-44a5-ae3c-6edec17271cd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:52:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a303b844-5667-46b2-90a0-16a28b9ae284 req-f0c474ba-f61e-46fb-8727-ffdd0e5762b3 service nova] Releasing lock "refresh_cache-0f864e66-41ac-44a5-ae3c-6edec17271cd" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:52:09 user nova-compute[72773]: DEBUG nova.objects.instance [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lazy-loading 'flavor' on Instance uuid 0f864e66-41ac-44a5-ae3c-6edec17271cd {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:52:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "0f864e66-41ac-44a5-ae3c-6edec17271cd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:52:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Acquiring lock "0f864e66-41ac-44a5-ae3c-6edec17271cd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:52:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "0f864e66-41ac-44a5-ae3c-6edec17271cd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:52:09 user nova-compute[72773]: INFO nova.compute.manager [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Attaching volume 297553b8-42ea-4236-8fab-1902660a83bd to /dev/vdb
Aug 16 22:52:09 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:52:09 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:52:09 user nova-compute[72773]: DEBUG os_brick.utils [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:52:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:09 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa9a8be-f9a4-4dc5-86f1-ed6525458ea3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:09 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[10902d67-9f23-488f-9c62-666d4aa30123]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:09 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda9d10d-33c3-4f7c-91ea-81721b651578]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:09 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5641a36-a106-4434-924b-45953a5e456c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:52:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:52:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:52:09 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 22:52:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:52:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:52:09 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:52:09 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb6db43-6d0b-4d28-9418-15573bc0f172]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:52:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:52:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:52:09 user nova-compute[72773]: DEBUG os_brick.utils [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:52:09 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Updating existing volume attachment record: 14ee3404-199d-4a99-a518-4f2d7a616a16 {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:52:10 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Updating instance_info_cache with network_info: [{"id": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "address": "fa:16:3e:e2:fd:fb", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c7b3aa-98", "ovs_interfaceid": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:52:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:52:10 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 22:52:10 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:52:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:52:10 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:52:10 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:52:10 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:52:10 user nova-compute[72773]: INFO nova.compute.manager [None req-a8c8d854-fb1f-47cf-88a9-9d09eefd119f tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Get console output
Aug 16 22:52:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:52:10 user nova-compute[72773]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 16 22:52:11 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:52:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:52:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:52:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:52:11 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:52:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:52:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f864e66-41ac-44a5-ae3c-6edec17271cd/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f864e66-41ac-44a5-ae3c-6edec17271cd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f864e66-41ac-44a5-ae3c-6edec17271cd/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f864e66-41ac-44a5-ae3c-6edec17271cd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:13 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:52:13 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:52:13 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=8295MB free_disk=25.31551742553711GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:52:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:52:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:52:13 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance f4210738-d01e-4408-a15c-aeccada6dd23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:52:13 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance f97d8a95-e281-496b-bb62-81747a5c2ffc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:52:13 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance bc6fff46-be38-4089-a6ba-de75e0d7baab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:52:13 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 29c612f4-5ed1-46db-bdec-0eed58384746 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:52:13 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:52:13 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 0f864e66-41ac-44a5-ae3c-6edec17271cd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:52:13 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:52:13 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:52:14 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:52:14 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:52:14 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:52:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.324s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:52:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:52:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:52:18 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:52:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:52:19 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YudnrWfA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:52:19 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:52:19 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:52:19 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:52:19 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:52:19 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:52:19 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:52:19 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:52:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:19 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7ec5f5-3de6-40d1-ab2e-5482a38f3966]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:19 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:52:19 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:52:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:19 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4733cc96-baf3-4455-8343-d72b788cf946]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:19 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd] added
Aug 16 22:52:19 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:52:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:19 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb6b725-88d2-408b-997d-f5beeb683887]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:19 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:52:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:19 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac00715a-6c33-4c08-b4e3-88f60fc371d3]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:19 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:52:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YudnrWfA {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:19 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YudnrWfA" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[50dcc61b-ebcf-421d-9194-5701813e857a]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YudnrWfA'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:52:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7438f96-6abf-47d4-9924-3ea613e795b3]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:52:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e12a7af-00f8-490c-aa4c-f6275851ad96]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:52:20 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:52:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:52:20 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:52:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c592e82e-2a3d-43fb-929e-4c721508c880]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd, portal: 172.16.0.220,3260]
Aug 16 22:52:20 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd, portal: 172.16.0.220,3260] successful.
Aug 16 22:52:20 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:52:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[917ba2e6-4452-4c30-902b-1c344ee34d6e]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:52:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc87212c-4987-4b3c-b90f-a37b74cfe16c]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:52:20 user nova-compute[72773]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd (non-flash)
Aug 16 22:52:20 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:52:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:52:20 user nova-compute[72773]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd (non-flash)
Aug 16 22:52:20 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:52:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:52:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:52:20 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:52:20 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:52:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1313c0-eb3c-43d8-a4fa-49910e14a31a]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:20 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: None {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:52:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:52:21 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:52:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YudnrWfA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:52:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:52:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23061663661623766', 'path': '/dev/sdc'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:52:21 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061663661623766', 'path': '/dev/sdc'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:52:21 user nova-compute[72773]: DEBUG nova.objects.instance [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lazy-loading 'flavor' on Instance uuid 0f864e66-41ac-44a5-ae3c-6edec17271cd {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:52:21 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 22:52:21 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:52:21 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 22:52:21 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:52:21 user nova-compute[72773]:   <serial>297553b8-42ea-4236-8fab-1902660a83bd</serial>
Aug 16 22:52:21 user nova-compute[72773]: </disk>
Aug 16 22:52:21 user nova-compute[72773]:  {{(pid=72773) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 22:52:21 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:52:21 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:52:21 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] No VIF found with MAC fa:16:3e:be:cd:6d, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:52:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-637940f6-a7d4-404f-bce0-63217697d15c tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "0f864e66-41ac-44a5-ae3c-6edec17271cd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.434s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:52:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-23b62db6-367c-44f2-9c3d-d1e0e084ee70 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Acquiring lock "0f864e66-41ac-44a5-ae3c-6edec17271cd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:52:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-23b62db6-367c-44f2-9c3d-d1e0e084ee70 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "0f864e66-41ac-44a5-ae3c-6edec17271cd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:52:23 user nova-compute[72773]: INFO nova.compute.manager [None req-23b62db6-367c-44f2-9c3d-d1e0e084ee70 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Detaching volume 297553b8-42ea-4236-8fab-1902660a83bd
Aug 16 22:52:23 user nova-compute[72773]: INFO nova.virt.block_device [None req-23b62db6-367c-44f2-9c3d-d1e0e084ee70 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Attempting to driver detach volume 297553b8-42ea-4236-8fab-1902660a83bd from mountpoint /dev/vdb
Aug 16 22:52:23 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-23b62db6-367c-44f2-9c3d-d1e0e084ee70 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Attempting to detach device vdb from instance 0f864e66-41ac-44a5-ae3c-6edec17271cd from the persistent domain config. {{(pid=72773) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 22:52:23 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-23b62db6-367c-44f2-9c3d-d1e0e084ee70 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:52:23 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:52:23 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 22:52:23 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:52:23 user nova-compute[72773]:   <serial>297553b8-42ea-4236-8fab-1902660a83bd</serial>
Aug 16 22:52:23 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:52:23 user nova-compute[72773]: </disk>
Aug 16 22:52:23 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:52:23 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-23b62db6-367c-44f2-9c3d-d1e0e084ee70 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Successfully detached device vdb from instance 0f864e66-41ac-44a5-ae3c-6edec17271cd from the persistent domain config.
Aug 16 22:52:23 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-23b62db6-367c-44f2-9c3d-d1e0e084ee70 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0f864e66-41ac-44a5-ae3c-6edec17271cd from the live domain config. {{(pid=72773) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 22:52:23 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-23b62db6-367c-44f2-9c3d-d1e0e084ee70 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:52:23 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:52:23 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 22:52:23 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:52:23 user nova-compute[72773]:   <serial>297553b8-42ea-4236-8fab-1902660a83bd</serial>
Aug 16 22:52:23 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:52:23 user nova-compute[72773]: </disk>
Aug 16 22:52:23 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:52:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Acquiring lock "29c612f4-5ed1-46db-bdec-0eed58384746" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:52:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "29c612f4-5ed1-46db-bdec-0eed58384746" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:52:23 user nova-compute[72773]: DEBUG nova.objects.instance [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lazy-loading 'flavor' on Instance uuid 29c612f4-5ed1-46db-bdec-0eed58384746 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:52:23 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Received event <DeviceRemovedEvent: 1692226343.9578316, 0f864e66-41ac-44a5-ae3c-6edec17271cd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72773) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 22:52:23 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-23b62db6-367c-44f2-9c3d-d1e0e084ee70 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0f864e66-41ac-44a5-ae3c-6edec17271cd {{(pid=72773) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 22:52:23 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-23b62db6-367c-44f2-9c3d-d1e0e084ee70 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Successfully detached device vdb from instance 0f864e66-41ac-44a5-ae3c-6edec17271cd from the live domain config.
Aug 16 22:52:23 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23b62db6-367c-44f2-9c3d-d1e0e084ee70 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:52:23 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-23b62db6-367c-44f2-9c3d-d1e0e084ee70 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YudnrWfA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:52:23 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-23b62db6-367c-44f2-9c3d-d1e0e084ee70 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:52:23 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-23b62db6-367c-44f2-9c3d-d1e0e084ee70 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:52:23 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-23b62db6-367c-44f2-9c3d-d1e0e084ee70 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:52:23 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-23b62db6-367c-44f2-9c3d-d1e0e084ee70 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:52:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "29c612f4-5ed1-46db-bdec-0eed58384746" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.357s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:52:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:23 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aebb0af-c648-4868-a611-d0020b348bce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e573cc-2f46-4a2a-94a4-549adca7b8d0]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-23b62db6-367c-44f2-9c3d-d1e0e084ee70 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:52:24 user nova-compute[72773]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd (non-flash)
Aug 16 22:52:24 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-23b62db6-367c-44f2-9c3d-d1e0e084ee70 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:52:24 user nova-compute[72773]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd (non-flash)
Aug 16 22:52:24 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-23b62db6-367c-44f2-9c3d-d1e0e084ee70 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef5c3e7a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd'): ({'sdc'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-23b62db6-367c-44f2-9c3d-d1e0e084ee70 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Removing single pathed devices sdc {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0660dcb0-7112-4f62-b128-583560cac960]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[79433954-8d7f-498f-a2ed-32e1744335cd]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-23b62db6-367c-44f2-9c3d-d1e0e084ee70 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Flushing IO for device /dev/sdc {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e274d2a-cfcf-4356-b2b0-cf825c986a91]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-23b62db6-367c-44f2-9c3d-d1e0e084ee70 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Acquiring lock "29c612f4-5ed1-46db-bdec-0eed58384746" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "29c612f4-5ed1-46db-bdec-0eed58384746" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:52:24 user nova-compute[72773]: INFO nova.compute.manager [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Attaching volume a06cd95d-962d-4dd2-98a8-87a4bbc8a488 to /dev/vdb
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5812e0c-b2d6-49d4-9927-432b18870c9f]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-23b62db6-367c-44f2-9c3d-d1e0e084ee70 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-23b62db6-367c-44f2-9c3d-d1e0e084ee70 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-23b62db6-367c-44f2-9c3d-d1e0e084ee70 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f2c488-23a9-40f6-8bb9-fd845620b616]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-23b62db6-367c-44f2-9c3d-d1e0e084ee70 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG os_brick.utils [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1adeb558-7fe0-4c06-9731-a2f8554b82a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e3353f-bd06-4864-a55b-91f177933b3a]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-23b62db6-367c-44f2-9c3d-d1e0e084ee70 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd, portal: 172.16.0.220,3260]
Aug 16 22:52:24 user nova-compute[72773]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd, portal: 172.16.0.220,3260] successful.
Aug 16 22:52:24 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[711e1fbb-b6dc-4f73-93c7-b16704925627]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:297553b8-42ea-4236-8fab-1902660a83bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdaf9f26-ef90-43a2-921a-6382a85806fc]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-23b62db6-367c-44f2-9c3d-d1e0e084ee70 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-23b62db6-367c-44f2-9c3d-d1e0e084ee70 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-23b62db6-367c-44f2-9c3d-d1e0e084ee70 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] <== disconnect_volume: return (286ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23b62db6-367c-44f2-9c3d-d1e0e084ee70 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5fe45e-0129-49a2-987e-e06ad36238a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc507a1-b085-4375-82dd-a540f0c206b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:52:24 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:52:24 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d208ef0-c753-490c-be17-835399eb1b6d]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG os_brick.utils [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:52:24 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Updating existing volume attachment record: f89d6adf-dc6f-4e05-a90b-96c9e9a7f98c {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:52:25 user nova-compute[72773]: DEBUG nova.objects.instance [None req-23b62db6-367c-44f2-9c3d-d1e0e084ee70 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lazy-loading 'flavor' on Instance uuid 0f864e66-41ac-44a5-ae3c-6edec17271cd {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:52:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-23b62db6-367c-44f2-9c3d-d1e0e084ee70 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "0f864e66-41ac-44a5-ae3c-6edec17271cd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.731s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:52:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:52:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:52:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hodCLykY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:52:34 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:52:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:52:34 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:52:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:52:34 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:52:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4d606a-aefa-4e1e-96a8-6983bf9e3818]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:52:34 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2865f28a-9a49-43a5-b513-7f6b783942cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488] added
Aug 16 22:52:34 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6804b969-d903-42d9-837f-83bd6ab78b57]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d557406-d8d7-47c1-9522-a3d2f96e6f2a]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hodCLykY {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hodCLykY" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05f0185-9770-4c74-8f5e-28733a4acda8]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hodCLykY'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1233c0be-c42f-4b57-8e50-33bad06dc701]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[954194ea-b97d-4d34-8ba5-cc64ddbfad26]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:52:34 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:52:34 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbbdb0e-ef3f-4531-a214-a6a2a0b7feb5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488, portal: 172.16.0.220,3260]
Aug 16 22:52:34 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488, portal: 172.16.0.220,3260] successful.
Aug 16 22:52:34 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fffca5b-dd04-4043-a31e-3f0c05c98da4]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4c6538-6cbf-4094-a16f-dc48f97c7efd]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:52:34 user nova-compute[72773]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488 (non-flash)
Aug 16 22:52:34 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:52:34 user nova-compute[72773]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488 (non-flash)
Aug 16 22:52:34 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24d32bb-a42a-4721-82cc-ec9391278770]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:34 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: None {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:52:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:52:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:52:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 22:52:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:52:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:52:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:52:35 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:52:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hodCLykY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:52:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:52:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23432366537383765', 'path': '/dev/sdc'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:52:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432366537383765', 'path': '/dev/sdc'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:52:35 user nova-compute[72773]: DEBUG nova.objects.instance [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lazy-loading 'flavor' on Instance uuid 29c612f4-5ed1-46db-bdec-0eed58384746 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:52:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 22:52:35 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:52:35 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 22:52:35 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:52:35 user nova-compute[72773]:   <serial>a06cd95d-962d-4dd2-98a8-87a4bbc8a488</serial>
Aug 16 22:52:35 user nova-compute[72773]: </disk>
Aug 16 22:52:35 user nova-compute[72773]:  {{(pid=72773) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 22:52:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:52:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:52:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] No VIF found with MAC fa:16:3e:1b:7d:b0, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:52:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-383411a7-4dd8-424a-8906-fce165e80d41 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "29c612f4-5ed1-46db-bdec-0eed58384746" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.175s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:52:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ef537478-09cb-4e03-b79b-7a569089fdf4 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Acquiring lock "29c612f4-5ed1-46db-bdec-0eed58384746" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:52:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ef537478-09cb-4e03-b79b-7a569089fdf4 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "29c612f4-5ed1-46db-bdec-0eed58384746" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:52:37 user nova-compute[72773]: INFO nova.compute.manager [None req-ef537478-09cb-4e03-b79b-7a569089fdf4 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Detaching volume a06cd95d-962d-4dd2-98a8-87a4bbc8a488
Aug 16 22:52:37 user nova-compute[72773]: INFO nova.virt.block_device [None req-ef537478-09cb-4e03-b79b-7a569089fdf4 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Attempting to driver detach volume a06cd95d-962d-4dd2-98a8-87a4bbc8a488 from mountpoint /dev/vdb
Aug 16 22:52:37 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ef537478-09cb-4e03-b79b-7a569089fdf4 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Attempting to detach device vdb from instance 29c612f4-5ed1-46db-bdec-0eed58384746 from the persistent domain config. {{(pid=72773) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 22:52:37 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-ef537478-09cb-4e03-b79b-7a569089fdf4 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:52:37 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:52:37 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 22:52:37 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:52:37 user nova-compute[72773]:   <serial>a06cd95d-962d-4dd2-98a8-87a4bbc8a488</serial>
Aug 16 22:52:37 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:52:37 user nova-compute[72773]: </disk>
Aug 16 22:52:37 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:52:37 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-ef537478-09cb-4e03-b79b-7a569089fdf4 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Successfully detached device vdb from instance 29c612f4-5ed1-46db-bdec-0eed58384746 from the persistent domain config.
Aug 16 22:52:37 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ef537478-09cb-4e03-b79b-7a569089fdf4 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 29c612f4-5ed1-46db-bdec-0eed58384746 from the live domain config. {{(pid=72773) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 22:52:37 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-ef537478-09cb-4e03-b79b-7a569089fdf4 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:52:37 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:52:37 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 22:52:37 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:52:37 user nova-compute[72773]:   <serial>a06cd95d-962d-4dd2-98a8-87a4bbc8a488</serial>
Aug 16 22:52:37 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:52:37 user nova-compute[72773]: </disk>
Aug 16 22:52:37 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Received event <DeviceRemovedEvent: 1692226358.4189212, 29c612f4-5ed1-46db-bdec-0eed58384746 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72773) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-ef537478-09cb-4e03-b79b-7a569089fdf4 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 29c612f4-5ed1-46db-bdec-0eed58384746 {{(pid=72773) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 22:52:38 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-ef537478-09cb-4e03-b79b-7a569089fdf4 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Successfully detached device vdb from instance 29c612f4-5ed1-46db-bdec-0eed58384746 from the live domain config.
Aug 16 22:52:38 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef537478-09cb-4e03-b79b-7a569089fdf4 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef537478-09cb-4e03-b79b-7a569089fdf4 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hodCLykY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:52:38 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-ef537478-09cb-4e03-b79b-7a569089fdf4 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:52:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-ef537478-09cb-4e03-b79b-7a569089fdf4 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-ef537478-09cb-4e03-b79b-7a569089fdf4 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef537478-09cb-4e03-b79b-7a569089fdf4 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d11e258-e5be-4dca-8057-1410eb63418e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[78594cbd-47db-4acf-a1d9-e55d54069587]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef537478-09cb-4e03-b79b-7a569089fdf4 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:52:38 user nova-compute[72773]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488 (non-flash)
Aug 16 22:52:38 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef537478-09cb-4e03-b79b-7a569089fdf4 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:52:38 user nova-compute[72773]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488 (non-flash)
Aug 16 22:52:38 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef537478-09cb-4e03-b79b-7a569089fdf4 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef80409750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488'): ({'sdc'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-ef537478-09cb-4e03-b79b-7a569089fdf4 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Removing single pathed devices sdc {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5b38d8-01c8-42b9-a65d-ea2d92dfd250]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4eaefc9-d130-412c-aaad-6bb080d75819]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-ef537478-09cb-4e03-b79b-7a569089fdf4 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Flushing IO for device /dev/sdc {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7b8204-780b-4a21-a24c-7b29f79f4bb8]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-ef537478-09cb-4e03-b79b-7a569089fdf4 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b57b842-9406-4db1-ada9-5be7672f341f]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-ef537478-09cb-4e03-b79b-7a569089fdf4 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-ef537478-09cb-4e03-b79b-7a569089fdf4 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef537478-09cb-4e03-b79b-7a569089fdf4 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d09820-c0d5-448a-bfbb-48f2350316cc]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef537478-09cb-4e03-b79b-7a569089fdf4 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[57167207-6f05-4db8-8305-8580937b0a31]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef537478-09cb-4e03-b79b-7a569089fdf4 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488, portal: 172.16.0.220,3260]
Aug 16 22:52:38 user nova-compute[72773]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488, portal: 172.16.0.220,3260] successful.
Aug 16 22:52:38 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06cd95d-962d-4dd2-98a8-87a4bbc8a488 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bbc31d-ca57-4192-a91d-8ea7520c9f33]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef537478-09cb-4e03-b79b-7a569089fdf4 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-ef537478-09cb-4e03-b79b-7a569089fdf4 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef537478-09cb-4e03-b79b-7a569089fdf4 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] <== disconnect_volume: return (271ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:52:38 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef537478-09cb-4e03-b79b-7a569089fdf4 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:52:39 user nova-compute[72773]: DEBUG nova.objects.instance [None req-ef537478-09cb-4e03-b79b-7a569089fdf4 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lazy-loading 'flavor' on Instance uuid 29c612f4-5ed1-46db-bdec-0eed58384746 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:52:39 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-ef537478-09cb-4e03-b79b-7a569089fdf4 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "29c612f4-5ed1-46db-bdec-0eed58384746" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.640s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:52:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:52:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:52:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:52:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:52:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:01 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:53:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:06 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:53:09 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:53:09 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:53:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-bc6fff46-be38-4089-a6ba-de75e0d7baab" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:53:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-bc6fff46-be38-4089-a6ba-de75e0d7baab" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:53:09 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 22:53:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:53:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 22:53:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:53:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:53:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:10 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Updating instance_info_cache with network_info: [{"id": "1b80812a-4fad-4669-83d7-fae725016671", "address": "fa:16:3e:87:bb:32", "network": {"id": "f9944803-97d3-451e-ade8-b8cc953c48e3", "bridge": "br-int", "label": "tempest-TestStampPattern-997567034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9da6df5003942baa7e7da93c0e3bc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b80812a-4f", "ovs_interfaceid": "1b80812a-4fad-4669-83d7-fae725016671", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:53:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-bc6fff46-be38-4089-a6ba-de75e0d7baab" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:53:10 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 22:53:10 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:53:10 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:53:11 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:53:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:53:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:53:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:53:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:53:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:53:11 user nova-compute[72773]: INFO nova.compute.manager [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Terminating instance
Aug 16 22:53:11 user nova-compute[72773]: DEBUG nova.compute.manager [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:53:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:11 user nova-compute[72773]: DEBUG nova.compute.manager [req-ea6f534a-09c4-4674-8a1d-053338013f66 req-790a0c0c-af24-4581-b9bd-cc9e1447ffb5 service nova] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Received event network-vif-unplugged-b6c7b3aa-98f1-48d5-95e2-d1080cfde93d {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:53:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ea6f534a-09c4-4674-8a1d-053338013f66 req-790a0c0c-af24-4581-b9bd-cc9e1447ffb5 service nova] Acquiring lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:53:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ea6f534a-09c4-4674-8a1d-053338013f66 req-790a0c0c-af24-4581-b9bd-cc9e1447ffb5 service nova] Lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:53:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ea6f534a-09c4-4674-8a1d-053338013f66 req-790a0c0c-af24-4581-b9bd-cc9e1447ffb5 service nova] Lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:53:11 user nova-compute[72773]: DEBUG nova.compute.manager [req-ea6f534a-09c4-4674-8a1d-053338013f66 req-790a0c0c-af24-4581-b9bd-cc9e1447ffb5 service nova] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] No waiting events found dispatching network-vif-unplugged-b6c7b3aa-98f1-48d5-95e2-d1080cfde93d {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:53:11 user nova-compute[72773]: DEBUG nova.compute.manager [req-ea6f534a-09c4-4674-8a1d-053338013f66 req-790a0c0c-af24-4581-b9bd-cc9e1447ffb5 service nova] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Received event network-vif-unplugged-b6c7b3aa-98f1-48d5-95e2-d1080cfde93d for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:53:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:12 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Instance destroyed successfully.
Aug 16 22:53:12 user nova-compute[72773]: DEBUG nova.objects.instance [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lazy-loading 'resources' on Instance uuid 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:46:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1934884323',display_name='tempest-ServerActionsTestOtherA-server-1934884323',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1934884323',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8jX+pTxaeDXA5y4Lt3+HYLzwoWoj7w8Q+TaAP2Om+ZW/RXrMR/7moMcaLV8Y+iO6BXYhMxPummGFIv4FNE2LpZt+HlA5XAu1WYM2d9vz6WjOr3TWc3giU1qDh4/LEA9A==',key_name='tempest-keypair-283817410',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:48:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3dc03400ff4448682ebba991a7e8af6',ramdisk_id='',reservation_id='r-p7bzcemu',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1807466388',owner_user_name='tempest-ServerActionsTestOtherA-1807466388-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:50:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02982f15d1a640a5bc77069a906f3e9a',uuid=43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "address": "fa:16:3e:e2:fd:fb", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c7b3aa-98", "ovs_interfaceid": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Converting VIF {"id": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "address": "fa:16:3e:e2:fd:fb", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c7b3aa-98", "ovs_interfaceid": "b6c7b3aa-98f1-48d5-95e2-d1080cfde93d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:fd:fb,bridge_name='br-int',has_traffic_filtering=True,id=b6c7b3aa-98f1-48d5-95e2-d1080cfde93d,network=Network(1a1a40b0-631c-4f41-9ece-17cd713adfd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6c7b3aa-98') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG os_vif [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:fd:fb,bridge_name='br-int',has_traffic_filtering=True,id=b6c7b3aa-98f1-48d5-95e2-d1080cfde93d,network=Network(1a1a40b0-631c-4f41-9ece-17cd713adfd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6c7b3aa-98') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6c7b3aa-98, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:12 user nova-compute[72773]: INFO os_vif [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:fd:fb,bridge_name='br-int',has_traffic_filtering=True,id=b6c7b3aa-98f1-48d5-95e2-d1080cfde93d,network=Network(1a1a40b0-631c-4f41-9ece-17cd713adfd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6c7b3aa-98')
Aug 16 22:53:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eYTcvEMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:53:12 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:53:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffc19e7-1fbe-429f-a72e-f30b0d99e12c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e50268-8c16-4063-b856-dc4f109666cf]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:53:12 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 (non-flash)
Aug 16 22:53:12 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef802b8b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9'): ({'sdb'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Removing single pathed devices sdb {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8f708c-25c1-488a-9e90-99d94fc715ac]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2391abc1-cf3c-4977-85a1-67a6af034256]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Flushing IO for device /dev/sdb {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e89f6d6-e9cf-456f-9284-b173764d4315]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8552091c-abd4-4620-9e68-b2b1fcfcf588]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] SCSI volumes sdb have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26230323834303136', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a1aa5af9', '/dev/disk/by-id/scsi-1SCST_BIOa1aa5af9-b02840166950eb26') {{(pid=83955) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4470aa4-6f11-4611-9d03-79708b6c0465]: (4, None) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1881306-de40-4f9b-8820-56d651de38e2]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7228517d-f3d6-46ea-b4fa-059bfc9cc250]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9, portal: 172.16.0.220,3260]
Aug 16 22:53:12 user nova-compute[72773]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9, portal: 172.16.0.220,3260] successful.
Aug 16 22:53:12 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86656d3-d9ce-4fe1-80ad-025c266d87d9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c909f4b-36ca-4a49-a0eb-9d44c4251292]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] <== disconnect_volume: return (273ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:53:12 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Deleting instance files /opt/stack/data/nova/instances/43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1_del
Aug 16 22:53:12 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Deletion of /opt/stack/data/nova/instances/43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1_del complete
Aug 16 22:53:12 user nova-compute[72773]: INFO nova.compute.manager [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 16 22:53:12 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:53:12 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:53:13 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:53:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:53:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:53:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:53:13 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:53:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:13 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:53:13 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Took 1.05 seconds to deallocate network for instance.
Aug 16 22:53:13 user nova-compute[72773]: DEBUG nova.compute.manager [req-5d349f1f-35b9-455f-97d3-09cefc1d0b95 req-4527d2c6-4054-4c2e-b3c5-25882b4029b6 service nova] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Received event network-vif-deleted-b6c7b3aa-98f1-48d5-95e2-d1080cfde93d {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:53:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:13 user nova-compute[72773]: DEBUG nova.compute.manager [req-ff0e9956-f80c-4bc5-ac9b-a0cb6219afa5 req-21da02bc-3e5f-49de-a024-dbf61bda7a6a service nova] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Received event network-vif-plugged-b6c7b3aa-98f1-48d5-95e2-d1080cfde93d {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:53:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ff0e9956-f80c-4bc5-ac9b-a0cb6219afa5 req-21da02bc-3e5f-49de-a024-dbf61bda7a6a service nova] Acquiring lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:53:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ff0e9956-f80c-4bc5-ac9b-a0cb6219afa5 req-21da02bc-3e5f-49de-a024-dbf61bda7a6a service nova] Lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:53:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ff0e9956-f80c-4bc5-ac9b-a0cb6219afa5 req-21da02bc-3e5f-49de-a024-dbf61bda7a6a service nova] Lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:53:13 user nova-compute[72773]: DEBUG nova.compute.manager [req-ff0e9956-f80c-4bc5-ac9b-a0cb6219afa5 req-21da02bc-3e5f-49de-a024-dbf61bda7a6a service nova] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] No waiting events found dispatching network-vif-plugged-b6c7b3aa-98f1-48d5-95e2-d1080cfde93d {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:53:13 user nova-compute[72773]: WARNING nova.compute.manager [req-ff0e9956-f80c-4bc5-ac9b-a0cb6219afa5 req-21da02bc-3e5f-49de-a024-dbf61bda7a6a service nova] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Received unexpected event network-vif-plugged-b6c7b3aa-98f1-48d5-95e2-d1080cfde93d for instance with vm_state active and task_state deleting.
Aug 16 22:53:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e3c39476-ace6-4126-bfe7-f9a2f64a0ea4 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Acquiring lock "0f864e66-41ac-44a5-ae3c-6edec17271cd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:53:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e3c39476-ace6-4126-bfe7-f9a2f64a0ea4 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "0f864e66-41ac-44a5-ae3c-6edec17271cd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:53:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e3c39476-ace6-4126-bfe7-f9a2f64a0ea4 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Acquiring lock "0f864e66-41ac-44a5-ae3c-6edec17271cd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:53:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e3c39476-ace6-4126-bfe7-f9a2f64a0ea4 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "0f864e66-41ac-44a5-ae3c-6edec17271cd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:53:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e3c39476-ace6-4126-bfe7-f9a2f64a0ea4 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "0f864e66-41ac-44a5-ae3c-6edec17271cd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:53:14 user nova-compute[72773]: INFO nova.compute.manager [None req-e3c39476-ace6-4126-bfe7-f9a2f64a0ea4 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Terminating instance
Aug 16 22:53:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-e3c39476-ace6-4126-bfe7-f9a2f64a0ea4 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:53:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:14 user nova-compute[72773]: INFO nova.compute.manager [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Took 0.86 seconds to detach 1 volumes for instance.
Aug 16 22:53:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Deleting volume: a86656d3-d9ce-4fe1-80ad-025c266d87d9 {{(pid=72773) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 22:53:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:53:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:53:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f864e66-41ac-44a5-ae3c-6edec17271cd/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f864e66-41ac-44a5-ae3c-6edec17271cd/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f864e66-41ac-44a5-ae3c-6edec17271cd/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:15 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:53:15 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:53:15 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Instance destroyed successfully.
Aug 16 22:53:15 user nova-compute[72773]: DEBUG nova.objects.instance [None req-e3c39476-ace6-4126-bfe7-f9a2f64a0ea4 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lazy-loading 'resources' on Instance uuid 0f864e66-41ac-44a5-ae3c-6edec17271cd {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:53:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-e3c39476-ace6-4126-bfe7-f9a2f64a0ea4 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:50:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-455631438',display_name='tempest-TestStampPattern-server-455631438',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-455631438',id=43,image_ref='04f7f99b-8234-41d3-85d4-4720c41c67b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzC0aSRz7xXngfuyAWDxc33KMp1GyfHt4lts9ifm5UwE3d17y1lNQi+MHuQTetPPkxrDXwXT5pk8rTxZLOsiBLgU5JxY5FTEUoncDvpwTM+Osg9cwYLjr/DyE/wbeHeRQ==',key_name='tempest-TestStampPattern-749194713',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:50:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9da6df5003942baa7e7da93c0e3bc79',ramdisk_id='',reservation_id='r-18kmb5ff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='bc6fff46-be38-4089-a6ba-de75e0d7baab',image_min_disk='1',image_min_ram='0',image_owner_id='b9da6df5003942baa7e7da93c0e3bc79',image_owner_project_name='tempest-TestStampPattern-552569719',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-552569719-project-member',image_user_id='7a9bfc4519a64911b5613b3a96a461eb',owner_project_name='tempest-TestStampPattern-552569719',owner_user_name='tempest-TestStampPattern-552569719-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:50:24Z,user_data=None,user_id='7a9bfc4519a64911b5613b3a96a461eb',uuid=0f864e66-41ac-44a5-ae3c-6edec17271cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a4a74c8-6af2-4a9e-9703-a681c4042c59", "address": "fa:16:3e:be:cd:6d", "network": {"id": "f9944803-97d3-451e-ade8-b8cc953c48e3", "bridge": "br-int", "label": "tempest-TestStampPattern-997567034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9da6df5003942baa7e7da93c0e3bc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a4a74c8-6a", "ovs_interfaceid": "7a4a74c8-6af2-4a9e-9703-a681c4042c59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:53:15 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-e3c39476-ace6-4126-bfe7-f9a2f64a0ea4 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Converting VIF {"id": "7a4a74c8-6af2-4a9e-9703-a681c4042c59", "address": "fa:16:3e:be:cd:6d", "network": {"id": "f9944803-97d3-451e-ade8-b8cc953c48e3", "bridge": "br-int", "label": "tempest-TestStampPattern-997567034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9da6df5003942baa7e7da93c0e3bc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a4a74c8-6a", "ovs_interfaceid": "7a4a74c8-6af2-4a9e-9703-a681c4042c59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:53:15 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-e3c39476-ace6-4126-bfe7-f9a2f64a0ea4 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:cd:6d,bridge_name='br-int',has_traffic_filtering=True,id=7a4a74c8-6af2-4a9e-9703-a681c4042c59,network=Network(f9944803-97d3-451e-ade8-b8cc953c48e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a4a74c8-6a') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:53:15 user nova-compute[72773]: DEBUG os_vif [None req-e3c39476-ace6-4126-bfe7-f9a2f64a0ea4 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:cd:6d,bridge_name='br-int',has_traffic_filtering=True,id=7a4a74c8-6af2-4a9e-9703-a681c4042c59,network=Network(f9944803-97d3-451e-ade8-b8cc953c48e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a4a74c8-6a') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:53:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.499s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:53:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a4a74c8-6a, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:53:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:53:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:15 user nova-compute[72773]: INFO os_vif [None req-e3c39476-ace6-4126-bfe7-f9a2f64a0ea4 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:cd:6d,bridge_name='br-int',has_traffic_filtering=True,id=7a4a74c8-6af2-4a9e-9703-a681c4042c59,network=Network(f9944803-97d3-451e-ade8-b8cc953c48e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a4a74c8-6a')
Aug 16 22:53:15 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-e3c39476-ace6-4126-bfe7-f9a2f64a0ea4 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Deleting instance files /opt/stack/data/nova/instances/0f864e66-41ac-44a5-ae3c-6edec17271cd_del
Aug 16 22:53:15 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-e3c39476-ace6-4126-bfe7-f9a2f64a0ea4 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Deletion of /opt/stack/data/nova/instances/0f864e66-41ac-44a5-ae3c-6edec17271cd_del complete
Aug 16 22:53:15 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Deleted allocations for instance 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1
Aug 16 22:53:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f864e66-41ac-44a5-ae3c-6edec17271cd/disk --force-share --output=json" returned: 1 in 0.244s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f864e66-41ac-44a5-ae3c-6edec17271cd/disk --force-share --output=json' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:53:15 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000002b, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/0f864e66-41ac-44a5-ae3c-6edec17271cd/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/0f864e66-41ac-44a5-ae3c-6edec17271cd/disk
Aug 16 22:53:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:15 user nova-compute[72773]: INFO nova.compute.manager [None req-e3c39476-ace6-4126-bfe7-f9a2f64a0ea4 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 16 22:53:15 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-e3c39476-ace6-4126-bfe7-f9a2f64a0ea4 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:53:15 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:53:15 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:53:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-153857db-172d-4982-a8f8-5cd8f1352d6d tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.971s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:53:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG nova.compute.manager [req-b8fcf54f-c916-492c-9ca5-e82d66596fd1 req-1c806f2c-27c0-48d7-aa20-a8ce4d9ea301 service nova] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Received event network-changed-7a4a74c8-6af2-4a9e-9703-a681c4042c59 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG nova.compute.manager [req-b8fcf54f-c916-492c-9ca5-e82d66596fd1 req-1c806f2c-27c0-48d7-aa20-a8ce4d9ea301 service nova] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Refreshing instance network info cache due to event network-changed-7a4a74c8-6af2-4a9e-9703-a681c4042c59. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b8fcf54f-c916-492c-9ca5-e82d66596fd1 req-1c806f2c-27c0-48d7-aa20-a8ce4d9ea301 service nova] Acquiring lock "refresh_cache-0f864e66-41ac-44a5-ae3c-6edec17271cd" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b8fcf54f-c916-492c-9ca5-e82d66596fd1 req-1c806f2c-27c0-48d7-aa20-a8ce4d9ea301 service nova] Acquired lock "refresh_cache-0f864e66-41ac-44a5-ae3c-6edec17271cd" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG nova.network.neutron [req-b8fcf54f-c916-492c-9ca5-e82d66596fd1 req-1c806f2c-27c0-48d7-aa20-a8ce4d9ea301 service nova] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Refreshing network info cache for port 7a4a74c8-6af2-4a9e-9703-a681c4042c59 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG nova.compute.manager [req-4374cdcc-f6fb-40d3-872a-b7b7ed8b48d4 req-80d843e2-47b8-4f1e-9f31-24d669d2507c service nova] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Received event network-vif-deleted-7a4a74c8-6af2-4a9e-9703-a681c4042c59 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:53:16 user nova-compute[72773]: INFO nova.compute.manager [req-4374cdcc-f6fb-40d3-872a-b7b7ed8b48d4 req-80d843e2-47b8-4f1e-9f31-24d669d2507c service nova] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Neutron deleted interface 7a4a74c8-6af2-4a9e-9703-a681c4042c59; detaching it from the instance and deleting it from the info cache
Aug 16 22:53:16 user nova-compute[72773]: DEBUG nova.network.neutron [req-4374cdcc-f6fb-40d3-872a-b7b7ed8b48d4 req-80d843e2-47b8-4f1e-9f31-24d669d2507c service nova] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:53:16 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:53:16 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:53:16 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=8432MB free_disk=25.314010620117188GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:53:16 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Took 1.00 seconds to deallocate network for instance.
Aug 16 22:53:16 user nova-compute[72773]: DEBUG nova.compute.manager [req-4374cdcc-f6fb-40d3-872a-b7b7ed8b48d4 req-80d843e2-47b8-4f1e-9f31-24d669d2507c service nova] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Detach interface failed, port_id=7a4a74c8-6af2-4a9e-9703-a681c4042c59, reason: Instance 0f864e66-41ac-44a5-ae3c-6edec17271cd could not be found. {{(pid=72773) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 22:53:16 user nova-compute[72773]: INFO nova.network.neutron [req-b8fcf54f-c916-492c-9ca5-e82d66596fd1 req-1c806f2c-27c0-48d7-aa20-a8ce4d9ea301 service nova] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Port 7a4a74c8-6af2-4a9e-9703-a681c4042c59 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 16 22:53:16 user nova-compute[72773]: DEBUG nova.network.neutron [req-b8fcf54f-c916-492c-9ca5-e82d66596fd1 req-1c806f2c-27c0-48d7-aa20-a8ce4d9ea301 service nova] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b8fcf54f-c916-492c-9ca5-e82d66596fd1 req-1c806f2c-27c0-48d7-aa20-a8ce4d9ea301 service nova] Releasing lock "refresh_cache-0f864e66-41ac-44a5-ae3c-6edec17271cd" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG nova.compute.manager [req-b8fcf54f-c916-492c-9ca5-e82d66596fd1 req-1c806f2c-27c0-48d7-aa20-a8ce4d9ea301 service nova] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Received event network-vif-unplugged-7a4a74c8-6af2-4a9e-9703-a681c4042c59 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b8fcf54f-c916-492c-9ca5-e82d66596fd1 req-1c806f2c-27c0-48d7-aa20-a8ce4d9ea301 service nova] Acquiring lock "0f864e66-41ac-44a5-ae3c-6edec17271cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b8fcf54f-c916-492c-9ca5-e82d66596fd1 req-1c806f2c-27c0-48d7-aa20-a8ce4d9ea301 service nova] Lock "0f864e66-41ac-44a5-ae3c-6edec17271cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b8fcf54f-c916-492c-9ca5-e82d66596fd1 req-1c806f2c-27c0-48d7-aa20-a8ce4d9ea301 service nova] Lock "0f864e66-41ac-44a5-ae3c-6edec17271cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG nova.compute.manager [req-b8fcf54f-c916-492c-9ca5-e82d66596fd1 req-1c806f2c-27c0-48d7-aa20-a8ce4d9ea301 service nova] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] No waiting events found dispatching network-vif-unplugged-7a4a74c8-6af2-4a9e-9703-a681c4042c59 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG nova.compute.manager [req-b8fcf54f-c916-492c-9ca5-e82d66596fd1 req-1c806f2c-27c0-48d7-aa20-a8ce4d9ea301 service nova] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Received event network-vif-unplugged-7a4a74c8-6af2-4a9e-9703-a681c4042c59 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG nova.compute.manager [req-b8fcf54f-c916-492c-9ca5-e82d66596fd1 req-1c806f2c-27c0-48d7-aa20-a8ce4d9ea301 service nova] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Received event network-vif-plugged-7a4a74c8-6af2-4a9e-9703-a681c4042c59 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b8fcf54f-c916-492c-9ca5-e82d66596fd1 req-1c806f2c-27c0-48d7-aa20-a8ce4d9ea301 service nova] Acquiring lock "0f864e66-41ac-44a5-ae3c-6edec17271cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b8fcf54f-c916-492c-9ca5-e82d66596fd1 req-1c806f2c-27c0-48d7-aa20-a8ce4d9ea301 service nova] Lock "0f864e66-41ac-44a5-ae3c-6edec17271cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b8fcf54f-c916-492c-9ca5-e82d66596fd1 req-1c806f2c-27c0-48d7-aa20-a8ce4d9ea301 service nova] Lock "0f864e66-41ac-44a5-ae3c-6edec17271cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG nova.compute.manager [req-b8fcf54f-c916-492c-9ca5-e82d66596fd1 req-1c806f2c-27c0-48d7-aa20-a8ce4d9ea301 service nova] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] No waiting events found dispatching network-vif-plugged-7a4a74c8-6af2-4a9e-9703-a681c4042c59 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:53:16 user nova-compute[72773]: WARNING nova.compute.manager [req-b8fcf54f-c916-492c-9ca5-e82d66596fd1 req-1c806f2c-27c0-48d7-aa20-a8ce4d9ea301 service nova] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Received unexpected event network-vif-plugged-7a4a74c8-6af2-4a9e-9703-a681c4042c59 for instance with vm_state active and task_state deleting.
Aug 16 22:53:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e3c39476-ace6-4126-bfe7-f9a2f64a0ea4 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance f4210738-d01e-4408-a15c-aeccada6dd23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance f97d8a95-e281-496b-bb62-81747a5c2ffc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance bc6fff46-be38-4089-a6ba-de75e0d7baab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 29c612f4-5ed1-46db-bdec-0eed58384746 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 0f864e66-41ac-44a5-ae3c-6edec17271cd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.347s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e3c39476-ace6-4126-bfe7-f9a2f64a0ea4 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.229s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-e3c39476-ace6-4126-bfe7-f9a2f64a0ea4 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-e3c39476-ace6-4126-bfe7-f9a2f64a0ea4 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:53:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e3c39476-ace6-4126-bfe7-f9a2f64a0ea4 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.201s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:53:16 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-e3c39476-ace6-4126-bfe7-f9a2f64a0ea4 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Deleted allocations for instance 0f864e66-41ac-44a5-ae3c-6edec17271cd
Aug 16 22:53:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e3c39476-ace6-4126-bfe7-f9a2f64a0ea4 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "0f864e66-41ac-44a5-ae3c-6edec17271cd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.650s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:53:19 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:53:19 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:53:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:24 user nova-compute[72773]: DEBUG nova.objects.instance [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lazy-loading 'flavor' on Instance uuid f97d8a95-e281-496b-bb62-81747a5c2ffc {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:53:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "refresh_cache-f97d8a95-e281-496b-bb62-81747a5c2ffc" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:53:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquired lock "refresh_cache-f97d8a95-e281-496b-bb62-81747a5c2ffc" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:53:24 user nova-compute[72773]: DEBUG nova.network.neutron [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:53:24 user nova-compute[72773]: DEBUG nova.objects.instance [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lazy-loading 'info_cache' on Instance uuid f97d8a95-e281-496b-bb62-81747a5c2ffc {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG nova.network.neutron [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Updating instance_info_cache with network_info: [{"id": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "address": "fa:16:3e:12:35:93", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0ffcbd-76", "ovs_interfaceid": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Releasing lock "refresh_cache-f97d8a95-e281-496b-bb62-81747a5c2ffc" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:53:25 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Instance destroyed successfully.
Aug 16 22:53:25 user nova-compute[72773]: DEBUG nova.objects.instance [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lazy-loading 'resources' on Instance uuid f97d8a95-e281-496b-bb62-81747a5c2ffc {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-901024509',display_name='tempest-AttachVolumeTestJSON-server-901024509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-901024509',id=39,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMwC80zAC+DDm1/aQS1yIwW3iohkON4IwgRB4Qo30pRKnd56Cla0ZmEd6mFqvSws8dEJWHuZr06ofoAXldMYoVLEZx3MfxCSPNlh2DAJMCkFmy36ylUG4yyQmmfHxBPSw==',key_name='tempest-keypair-1482365818',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:45:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a6da6170d60c4d41b14c342700a5dd83',ramdisk_id='',reservation_id='r-20vqu8m3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-317922803',owner_user_name='tempest-AttachVolumeTestJSON-317922803-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:51:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7b76435f64e47169f3ca08aebb8e766',uuid=f97d8a95-e281-496b-bb62-81747a5c2ffc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "address": "fa:16:3e:12:35:93", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0ffcbd-76", "ovs_interfaceid": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Converting VIF {"id": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "address": "fa:16:3e:12:35:93", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0ffcbd-76", "ovs_interfaceid": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:35:93,bridge_name='br-int',has_traffic_filtering=True,id=3c0ffcbd-768e-4040-8765-663fa495a3ab,network=Network(3348a6ff-bdcc-49e3-bb0a-4839999ec213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c0ffcbd-76') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG os_vif [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:35:93,bridge_name='br-int',has_traffic_filtering=True,id=3c0ffcbd-768e-4040-8765-663fa495a3ab,network=Network(3348a6ff-bdcc-49e3-bb0a-4839999ec213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c0ffcbd-76') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c0ffcbd-76, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:25 user nova-compute[72773]: INFO os_vif [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:35:93,bridge_name='br-int',has_traffic_filtering=True,id=3c0ffcbd-768e-4040-8765-663fa495a3ab,network=Network(3348a6ff-bdcc-49e3-bb0a-4839999ec213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c0ffcbd-76')
Aug 16 22:53:25 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Start _get_guest_xml network_info=[{"id": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "address": "fa:16:3e:12:35:93", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0ffcbd-76", "ovs_interfaceid": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG nova.objects.instance [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lazy-loading 'numa_topology' on Instance uuid f97d8a95-e281-496b-bb62-81747a5c2ffc {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:53:25 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:53:25 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:53:25 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG nova.objects.instance [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lazy-loading 'vcpu_model' on Instance uuid f97d8a95-e281-496b-bb62-81747a5c2ffc {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-901024509',display_name='tempest-AttachVolumeTestJSON-server-901024509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-901024509',id=39,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMwC80zAC+DDm1/aQS1yIwW3iohkON4IwgRB4Qo30pRKnd56Cla0ZmEd6mFqvSws8dEJWHuZr06ofoAXldMYoVLEZx3MfxCSPNlh2DAJMCkFmy36ylUG4yyQmmfHxBPSw==',key_name='tempest-keypair-1482365818',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:45:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a6da6170d60c4d41b14c342700a5dd83',ramdisk_id='',reservation_id='r-20vqu8m3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-317922803',owner_user_name='tempest-AttachVolumeTestJSON-317922803-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:51:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7b76435f64e47169f3ca08aebb8e766',uuid=f97d8a95-e281-496b-bb62-81747a5c2ffc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "address": "fa:16:3e:12:35:93", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0ffcbd-76", "ovs_interfaceid": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Converting VIF {"id": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "address": "fa:16:3e:12:35:93", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0ffcbd-76", "ovs_interfaceid": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:35:93,bridge_name='br-int',has_traffic_filtering=True,id=3c0ffcbd-768e-4040-8765-663fa495a3ab,network=Network(3348a6ff-bdcc-49e3-bb0a-4839999ec213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c0ffcbd-76') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG nova.objects.instance [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lazy-loading 'pci_devices' on Instance uuid f97d8a95-e281-496b-bb62-81747a5c2ffc {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:53:25 user nova-compute[72773]:   <uuid>f97d8a95-e281-496b-bb62-81747a5c2ffc</uuid>
Aug 16 22:53:25 user nova-compute[72773]:   <name>instance-00000027</name>
Aug 16 22:53:25 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:53:25 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:53:25 user nova-compute[72773]:   <metadata>
Aug 16 22:53:25 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:53:25 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:53:25 user nova-compute[72773]:       <nova:name>tempest-AttachVolumeTestJSON-server-901024509</nova:name>
Aug 16 22:53:25 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:53:25</nova:creationTime>
Aug 16 22:53:25 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:53:25 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:53:25 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:53:25 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:53:25 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:53:25 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:53:25 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:53:25 user nova-compute[72773]:       <nova:owner>
Aug 16 22:53:25 user nova-compute[72773]:         <nova:user uuid="e7b76435f64e47169f3ca08aebb8e766">tempest-AttachVolumeTestJSON-317922803-project-member</nova:user>
Aug 16 22:53:25 user nova-compute[72773]:         <nova:project uuid="a6da6170d60c4d41b14c342700a5dd83">tempest-AttachVolumeTestJSON-317922803</nova:project>
Aug 16 22:53:25 user nova-compute[72773]:       </nova:owner>
Aug 16 22:53:25 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:53:25 user nova-compute[72773]:       <nova:ports>
Aug 16 22:53:25 user nova-compute[72773]:         <nova:port uuid="3c0ffcbd-768e-4040-8765-663fa495a3ab">
Aug 16 22:53:25 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 22:53:25 user nova-compute[72773]:         </nova:port>
Aug 16 22:53:25 user nova-compute[72773]:       </nova:ports>
Aug 16 22:53:25 user nova-compute[72773]:     </nova:instance>
Aug 16 22:53:25 user nova-compute[72773]:   </metadata>
Aug 16 22:53:25 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:53:25 user nova-compute[72773]:     <system>
Aug 16 22:53:25 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:53:25 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:53:25 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:53:25 user nova-compute[72773]:       <entry name="serial">f97d8a95-e281-496b-bb62-81747a5c2ffc</entry>
Aug 16 22:53:25 user nova-compute[72773]:       <entry name="uuid">f97d8a95-e281-496b-bb62-81747a5c2ffc</entry>
Aug 16 22:53:25 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:53:25 user nova-compute[72773]:     </system>
Aug 16 22:53:25 user nova-compute[72773]:   </sysinfo>
Aug 16 22:53:25 user nova-compute[72773]:   <os>
Aug 16 22:53:25 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:53:25 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:53:25 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:53:25 user nova-compute[72773]:   </os>
Aug 16 22:53:25 user nova-compute[72773]:   <features>
Aug 16 22:53:25 user nova-compute[72773]:     <acpi/>
Aug 16 22:53:25 user nova-compute[72773]:     <apic/>
Aug 16 22:53:25 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:53:25 user nova-compute[72773]:   </features>
Aug 16 22:53:25 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:53:25 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:53:25 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:53:25 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:53:25 user nova-compute[72773]:   </clock>
Aug 16 22:53:25 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:53:25 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:53:25 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:53:25 user nova-compute[72773]:   </cpu>
Aug 16 22:53:25 user nova-compute[72773]:   <devices>
Aug 16 22:53:25 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:53:25 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:53:25 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk"/>
Aug 16 22:53:25 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:53:25 user nova-compute[72773]:     </disk>
Aug 16 22:53:25 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:53:25 user nova-compute[72773]:       <mac address="fa:16:3e:12:35:93"/>
Aug 16 22:53:25 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:53:25 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:53:25 user nova-compute[72773]:       <target dev="tap3c0ffcbd-76"/>
Aug 16 22:53:25 user nova-compute[72773]:     </interface>
Aug 16 22:53:25 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:53:25 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/console.log" append="off"/>
Aug 16 22:53:25 user nova-compute[72773]:     </serial>
Aug 16 22:53:25 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:53:25 user nova-compute[72773]:     <video>
Aug 16 22:53:25 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:53:25 user nova-compute[72773]:     </video>
Aug 16 22:53:25 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:53:25 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:53:25 user nova-compute[72773]:     </rng>
Aug 16 22:53:25 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:53:25 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:53:25 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:53:25 user nova-compute[72773]:     </memballoon>
Aug 16 22:53:25 user nova-compute[72773]:   </devices>
Aug 16 22:53:25 user nova-compute[72773]: </domain>
Aug 16 22:53:25 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG nova.objects.instance [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lazy-loading 'trusted_certs' on Instance uuid f97d8a95-e281-496b-bb62-81747a5c2ffc {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:53:25 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.175s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:26 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:53:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:26 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Cannot resize image /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:53:26 user nova-compute[72773]: DEBUG nova.objects.instance [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lazy-loading 'migration_context' on Instance uuid f97d8a95-e281-496b-bb62-81747a5c2ffc {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:53:26 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-901024509',display_name='tempest-AttachVolumeTestJSON-server-901024509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-901024509',id=39,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMwC80zAC+DDm1/aQS1yIwW3iohkON4IwgRB4Qo30pRKnd56Cla0ZmEd6mFqvSws8dEJWHuZr06ofoAXldMYoVLEZx3MfxCSPNlh2DAJMCkFmy36ylUG4yyQmmfHxBPSw==',key_name='tempest-keypair-1482365818',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:45:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='a6da6170d60c4d41b14c342700a5dd83',ramdisk_id='',reservation_id='r-20vqu8m3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-317922803',owner_user_name='tempest-AttachVolumeTestJSON-317922803-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:51:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7b76435f64e47169f3ca08aebb8e766',uuid=f97d8a95-e281-496b-bb62-81747a5c2ffc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "address": "fa:16:3e:12:35:93", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0ffcbd-76", "ovs_interfaceid": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:53:26 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Converting VIF {"id": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "address": "fa:16:3e:12:35:93", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0ffcbd-76", "ovs_interfaceid": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:53:26 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:35:93,bridge_name='br-int',has_traffic_filtering=True,id=3c0ffcbd-768e-4040-8765-663fa495a3ab,network=Network(3348a6ff-bdcc-49e3-bb0a-4839999ec213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c0ffcbd-76') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:53:26 user nova-compute[72773]: DEBUG os_vif [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:35:93,bridge_name='br-int',has_traffic_filtering=True,id=3c0ffcbd-768e-4040-8765-663fa495a3ab,network=Network(3348a6ff-bdcc-49e3-bb0a-4839999ec213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c0ffcbd-76') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:53:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:53:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:53:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c0ffcbd-76, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:53:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3c0ffcbd-76, col_values=(('external_ids', {'iface-id': '3c0ffcbd-768e-4040-8765-663fa495a3ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:35:93', 'vm-uuid': 'f97d8a95-e281-496b-bb62-81747a5c2ffc'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:53:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:53:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:26 user nova-compute[72773]: INFO os_vif [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:35:93,bridge_name='br-int',has_traffic_filtering=True,id=3c0ffcbd-768e-4040-8765-663fa495a3ab,network=Network(3348a6ff-bdcc-49e3-bb0a-4839999ec213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c0ffcbd-76')
Aug 16 22:53:27 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692226392.180833, 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:53:27 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] VM Stopped (Lifecycle Event)
Aug 16 22:53:27 user nova-compute[72773]: DEBUG nova.compute.manager [None req-9dbef0fe-fab0-4508-adda-7506330a5edb None None] [instance: 43dd2b4a-bd24-4bf9-8c70-c90f3a42f3e1] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:53:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:27 user nova-compute[72773]: DEBUG nova.compute.manager [req-fe90775e-0d83-4340-a7dc-8be215d9ff7f req-ad88579b-ad84-4837-bad2-a977081e17d4 service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Received event network-vif-plugged-3c0ffcbd-768e-4040-8765-663fa495a3ab {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:53:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fe90775e-0d83-4340-a7dc-8be215d9ff7f req-ad88579b-ad84-4837-bad2-a977081e17d4 service nova] Acquiring lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:53:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fe90775e-0d83-4340-a7dc-8be215d9ff7f req-ad88579b-ad84-4837-bad2-a977081e17d4 service nova] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:53:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fe90775e-0d83-4340-a7dc-8be215d9ff7f req-ad88579b-ad84-4837-bad2-a977081e17d4 service nova] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:53:27 user nova-compute[72773]: DEBUG nova.compute.manager [req-fe90775e-0d83-4340-a7dc-8be215d9ff7f req-ad88579b-ad84-4837-bad2-a977081e17d4 service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] No waiting events found dispatching network-vif-plugged-3c0ffcbd-768e-4040-8765-663fa495a3ab {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:53:27 user nova-compute[72773]: WARNING nova.compute.manager [req-fe90775e-0d83-4340-a7dc-8be215d9ff7f req-ad88579b-ad84-4837-bad2-a977081e17d4 service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Received unexpected event network-vif-plugged-3c0ffcbd-768e-4040-8765-663fa495a3ab for instance with vm_state stopped and task_state powering-on.
Aug 16 22:53:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:29 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692226409.6013422, f97d8a95-e281-496b-bb62-81747a5c2ffc => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:53:29 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] VM Resumed (Lifecycle Event)
Aug 16 22:53:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:53:29 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Instance rebooted successfully.
Aug 16 22:53:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-b73e7f4b-d482-4cd0-bbcd-9df179d31bbd tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:53:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:53:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:53:29 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 16 22:53:29 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692226409.6059725, f97d8a95-e281-496b-bb62-81747a5c2ffc => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:53:29 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] VM Started (Lifecycle Event)
Aug 16 22:53:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:53:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:53:29 user nova-compute[72773]: DEBUG nova.compute.manager [req-2d4da403-8eee-4363-bd7d-5b9ca04c11a3 req-f594005c-c365-41b8-b2e4-911a49b1236c service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Received event network-vif-plugged-3c0ffcbd-768e-4040-8765-663fa495a3ab {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:53:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2d4da403-8eee-4363-bd7d-5b9ca04c11a3 req-f594005c-c365-41b8-b2e4-911a49b1236c service nova] Acquiring lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:53:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2d4da403-8eee-4363-bd7d-5b9ca04c11a3 req-f594005c-c365-41b8-b2e4-911a49b1236c service nova] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:53:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2d4da403-8eee-4363-bd7d-5b9ca04c11a3 req-f594005c-c365-41b8-b2e4-911a49b1236c service nova] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:53:29 user nova-compute[72773]: DEBUG nova.compute.manager [req-2d4da403-8eee-4363-bd7d-5b9ca04c11a3 req-f594005c-c365-41b8-b2e4-911a49b1236c service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] No waiting events found dispatching network-vif-plugged-3c0ffcbd-768e-4040-8765-663fa495a3ab {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:53:29 user nova-compute[72773]: WARNING nova.compute.manager [req-2d4da403-8eee-4363-bd7d-5b9ca04c11a3 req-f594005c-c365-41b8-b2e4-911a49b1236c service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Received unexpected event network-vif-plugged-3c0ffcbd-768e-4040-8765-663fa495a3ab for instance with vm_state active and task_state None.
Aug 16 22:53:30 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692226395.15855, 0f864e66-41ac-44a5-ae3c-6edec17271cd => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:53:30 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] VM Stopped (Lifecycle Event)
Aug 16 22:53:30 user nova-compute[72773]: DEBUG nova.compute.manager [None req-cdc4144d-3feb-47d7-9a69-7d0ee153ea44 None None] [instance: 0f864e66-41ac-44a5-ae3c-6edec17271cd] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:53:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Acquiring lock "29c612f4-5ed1-46db-bdec-0eed58384746" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:53:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "29c612f4-5ed1-46db-bdec-0eed58384746" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:53:31 user nova-compute[72773]: DEBUG nova.objects.instance [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lazy-loading 'flavor' on Instance uuid 29c612f4-5ed1-46db-bdec-0eed58384746 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:53:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "29c612f4-5ed1-46db-bdec-0eed58384746" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:53:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Acquiring lock "29c612f4-5ed1-46db-bdec-0eed58384746" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:53:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "29c612f4-5ed1-46db-bdec-0eed58384746" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:53:32 user nova-compute[72773]: INFO nova.compute.manager [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Attaching volume 9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd to /dev/vdb
Aug 16 22:53:32 user nova-compute[72773]: DEBUG os_brick.utils [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:53:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:32 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc8c607-69cb-49eb-9231-3ee7aa8e1d8d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:53:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:32 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e68571-3cc3-4dff-9127-1517ed9f84e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:53:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:32 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e79c56-d2cf-4ec8-bb43-37bd1c65fa09]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:53:32 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe06901-905b-49c4-b958-496cafa7a30a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:53:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:53:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:53:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:32 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:53:32 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:53:32 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1397538-7a6d-4a93-9b0b-ce55516741a0]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:53:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:53:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:53:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:53:32 user nova-compute[72773]: DEBUG os_brick.utils [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:53:32 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Updating existing volume attachment record: a5e70473-3d6e-4fd7-b8fa-3ced25f5f802 {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:53:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:36 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:41 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PRTCUVId', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:53:42 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:53:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:53:42 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:53:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:53:42 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:53:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb405cb-1a16-4253-8faa-d6cb0af3193e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:53:42 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ed8cfe-67f4-4955-b725-2e6b03a6d63c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd] added
Aug 16 22:53:42 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f81b42f-829d-4947-8eb7-3cb6d0ebb806]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a1d2e1-1847-4e10-941a-28ddca1fe51e]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PRTCUVId {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PRTCUVId" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f00f1e-d730-4ccd-96a8-450abdd2c5ef]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PRTCUVId'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8590dbf0-6564-4347-8972-52b2f3ea57f4]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[38544ff4-df1d-46fd-8819-e1fec5143a67]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 22:53:42 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 22:53:42 user nova-compute[72773]:  {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:53:42 user nova-compute[72773]: WARNING os_brick.initiator.connectors.iscsi [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 22:53:42 user nova-compute[72773]: 
Aug 16 22:53:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e64e275-ead5-4905-b7e1-59bffe821a36]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd, portal: 172.16.0.220,3260]
Aug 16 22:53:42 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd, portal: 172.16.0.220,3260] successful.
Aug 16 22:53:42 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8341d5-09c3-4438-b7cd-dfabdfb3506e]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a5247f-195a-4af0-ae98-7fa2b2ea0374]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd (non-flash)
Aug 16 22:53:42 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd (non-flash)
Aug 16 22:53:42 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92e0835-7f64-41c0-85c3-07398aae13fd]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:53:42 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:53:43 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:53:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PRTCUVId', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:53:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:53:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '26330396661363138', 'path': '/dev/sdb'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:53:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330396661363138', 'path': '/dev/sdb'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:53:43 user nova-compute[72773]: DEBUG nova.objects.instance [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lazy-loading 'flavor' on Instance uuid 29c612f4-5ed1-46db-bdec-0eed58384746 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:53:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 22:53:43 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:53:43 user nova-compute[72773]:   <source dev="/dev/sdb"/>
Aug 16 22:53:43 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:53:43 user nova-compute[72773]:   <serial>9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd</serial>
Aug 16 22:53:43 user nova-compute[72773]: </disk>
Aug 16 22:53:43 user nova-compute[72773]:  {{(pid=72773) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 22:53:44 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:53:44 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:53:44 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] No VIF found with MAC fa:16:3e:1b:7d:b0, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:53:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d493b9f4-b187-475a-a6bc-6d7d28608c7e tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "29c612f4-5ed1-46db-bdec-0eed58384746" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.048s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:53:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-29c95f8e-2de0-496a-a772-55716f3b6885 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Acquiring lock "29c612f4-5ed1-46db-bdec-0eed58384746" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:53:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-29c95f8e-2de0-496a-a772-55716f3b6885 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "29c612f4-5ed1-46db-bdec-0eed58384746" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:53:46 user nova-compute[72773]: INFO nova.compute.manager [None req-29c95f8e-2de0-496a-a772-55716f3b6885 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Detaching volume 9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd
Aug 16 22:53:46 user nova-compute[72773]: INFO nova.virt.block_device [None req-29c95f8e-2de0-496a-a772-55716f3b6885 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Attempting to driver detach volume 9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd from mountpoint /dev/vdb
Aug 16 22:53:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-29c95f8e-2de0-496a-a772-55716f3b6885 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Attempting to detach device vdb from instance 29c612f4-5ed1-46db-bdec-0eed58384746 from the persistent domain config. {{(pid=72773) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 22:53:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-29c95f8e-2de0-496a-a772-55716f3b6885 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:53:46 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:53:46 user nova-compute[72773]:   <source dev="/dev/sdb"/>
Aug 16 22:53:46 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:53:46 user nova-compute[72773]:   <serial>9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd</serial>
Aug 16 22:53:46 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:53:46 user nova-compute[72773]: </disk>
Aug 16 22:53:46 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:53:46 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-29c95f8e-2de0-496a-a772-55716f3b6885 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Successfully detached device vdb from instance 29c612f4-5ed1-46db-bdec-0eed58384746 from the persistent domain config.
Aug 16 22:53:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-29c95f8e-2de0-496a-a772-55716f3b6885 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 29c612f4-5ed1-46db-bdec-0eed58384746 from the live domain config. {{(pid=72773) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 22:53:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-29c95f8e-2de0-496a-a772-55716f3b6885 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:53:46 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:53:46 user nova-compute[72773]:   <source dev="/dev/sdb"/>
Aug 16 22:53:46 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:53:46 user nova-compute[72773]:   <serial>9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd</serial>
Aug 16 22:53:46 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:53:46 user nova-compute[72773]: </disk>
Aug 16 22:53:46 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Received event <DeviceRemovedEvent: 1692226427.0911596, 29c612f4-5ed1-46db-bdec-0eed58384746 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72773) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-29c95f8e-2de0-496a-a772-55716f3b6885 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 29c612f4-5ed1-46db-bdec-0eed58384746 {{(pid=72773) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 22:53:47 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-29c95f8e-2de0-496a-a772-55716f3b6885 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Successfully detached device vdb from instance 29c612f4-5ed1-46db-bdec-0eed58384746 from the live domain config.
Aug 16 22:53:47 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29c95f8e-2de0-496a-a772-55716f3b6885 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c95f8e-2de0-496a-a772-55716f3b6885 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PRTCUVId', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:53:47 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-29c95f8e-2de0-496a-a772-55716f3b6885 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:53:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-29c95f8e-2de0-496a-a772-55716f3b6885 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-29c95f8e-2de0-496a-a772-55716f3b6885 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c95f8e-2de0-496a-a772-55716f3b6885 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed62535-f591-4402-85c1-eb86329dd8dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f577a46e-7a88-42a2-9d5a-8931caf5e232]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c95f8e-2de0-496a-a772-55716f3b6885 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd (non-flash)
Aug 16 22:53:47 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c95f8e-2de0-496a-a772-55716f3b6885 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd (non-flash)
Aug 16 22:53:47 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c95f8e-2de0-496a-a772-55716f3b6885 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef5c3e7760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd'): ({'sdb'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-29c95f8e-2de0-496a-a772-55716f3b6885 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Removing single pathed devices sdb {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefc0fca-fd7c-4dbd-978f-1adf0504f656]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[11360fde-a85f-4daf-a494-b8a3ec208940]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-29c95f8e-2de0-496a-a772-55716f3b6885 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Flushing IO for device /dev/sdb {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[652b8246-a28a-4433-b177-6e805d151cf3]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-29c95f8e-2de0-496a-a772-55716f3b6885 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c821dd-d73d-4682-bfab-882e1d449792]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-29c95f8e-2de0-496a-a772-55716f3b6885 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-29c95f8e-2de0-496a-a772-55716f3b6885 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] SCSI volumes sdb have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c95f8e-2de0-496a-a772-55716f3b6885 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df11233-245a-43a9-8993-e1d6b01605f3]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c95f8e-2de0-496a-a772-55716f3b6885 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0966120-4224-472a-8067-fda0a92b6b29]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c95f8e-2de0-496a-a772-55716f3b6885 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd, portal: 172.16.0.220,3260]
Aug 16 22:53:47 user nova-compute[72773]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd, portal: 172.16.0.220,3260] successful.
Aug 16 22:53:47 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bd96104-6a87-4e4d-b8ea-77c3e1c22ccd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[65dc0f14-2daf-4ef4-a342-b253074aee16]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c95f8e-2de0-496a-a772-55716f3b6885 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-29c95f8e-2de0-496a-a772-55716f3b6885 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c95f8e-2de0-496a-a772-55716f3b6885 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] <== disconnect_volume: return (264ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:53:47 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29c95f8e-2de0-496a-a772-55716f3b6885 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:53:48 user nova-compute[72773]: DEBUG nova.objects.instance [None req-29c95f8e-2de0-496a-a772-55716f3b6885 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lazy-loading 'flavor' on Instance uuid 29c612f4-5ed1-46db-bdec-0eed58384746 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:53:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-29c95f8e-2de0-496a-a772-55716f3b6885 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "29c612f4-5ed1-46db-bdec-0eed58384746" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.608s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:53:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:53:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:01 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:54:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:54:08 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:54:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1c29cbf1-7ed9-486b-a628-f8cf2fd43e93 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "f4210738-d01e-4408-a15c-aeccada6dd23" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:54:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1c29cbf1-7ed9-486b-a628-f8cf2fd43e93 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "f4210738-d01e-4408-a15c-aeccada6dd23" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:54:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1c29cbf1-7ed9-486b-a628-f8cf2fd43e93 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "f4210738-d01e-4408-a15c-aeccada6dd23-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:54:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1c29cbf1-7ed9-486b-a628-f8cf2fd43e93 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "f4210738-d01e-4408-a15c-aeccada6dd23-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:54:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1c29cbf1-7ed9-486b-a628-f8cf2fd43e93 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "f4210738-d01e-4408-a15c-aeccada6dd23-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:54:08 user nova-compute[72773]: INFO nova.compute.manager [None req-1c29cbf1-7ed9-486b-a628-f8cf2fd43e93 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Terminating instance
Aug 16 22:54:08 user nova-compute[72773]: DEBUG nova.compute.manager [None req-1c29cbf1-7ed9-486b-a628-f8cf2fd43e93 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:54:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:08 user nova-compute[72773]: DEBUG nova.compute.manager [req-0ac65612-cd1a-444b-a2d7-5eecfe52ada2 req-ad56c6c0-3111-455f-9d8c-3fa474a020ca service nova] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Received event network-vif-unplugged-bb573e79-a106-40c5-8c53-ab73eb6ba240 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:54:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0ac65612-cd1a-444b-a2d7-5eecfe52ada2 req-ad56c6c0-3111-455f-9d8c-3fa474a020ca service nova] Acquiring lock "f4210738-d01e-4408-a15c-aeccada6dd23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:54:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0ac65612-cd1a-444b-a2d7-5eecfe52ada2 req-ad56c6c0-3111-455f-9d8c-3fa474a020ca service nova] Lock "f4210738-d01e-4408-a15c-aeccada6dd23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:54:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0ac65612-cd1a-444b-a2d7-5eecfe52ada2 req-ad56c6c0-3111-455f-9d8c-3fa474a020ca service nova] Lock "f4210738-d01e-4408-a15c-aeccada6dd23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:54:08 user nova-compute[72773]: DEBUG nova.compute.manager [req-0ac65612-cd1a-444b-a2d7-5eecfe52ada2 req-ad56c6c0-3111-455f-9d8c-3fa474a020ca service nova] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] No waiting events found dispatching network-vif-unplugged-bb573e79-a106-40c5-8c53-ab73eb6ba240 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:54:08 user nova-compute[72773]: DEBUG nova.compute.manager [req-0ac65612-cd1a-444b-a2d7-5eecfe52ada2 req-ad56c6c0-3111-455f-9d8c-3fa474a020ca service nova] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Received event network-vif-unplugged-bb573e79-a106-40c5-8c53-ab73eb6ba240 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:54:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:09 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Instance destroyed successfully.
Aug 16 22:54:09 user nova-compute[72773]: DEBUG nova.objects.instance [None req-1c29cbf1-7ed9-486b-a628-f8cf2fd43e93 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lazy-loading 'resources' on Instance uuid f4210738-d01e-4408-a15c-aeccada6dd23 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:54:09 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-1c29cbf1-7ed9-486b-a628-f8cf2fd43e93 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1821628640',display_name='tempest-ServerActionsTestOtherA-server-1821628640',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1821628640',id=29,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8jX+pTxaeDXA5y4Lt3+HYLzwoWoj7w8Q+TaAP2Om+ZW/RXrMR/7moMcaLV8Y+iO6BXYhMxPummGFIv4FNE2LpZt+HlA5XAu1WYM2d9vz6WjOr3TWc3giU1qDh4/LEA9A==',key_name='tempest-keypair-283817410',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:35:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3dc03400ff4448682ebba991a7e8af6',ramdisk_id='',reservation_id='r-izyj3zjs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1807466388',owner_user_name='tempest-ServerActionsTestOtherA-1807466388-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:35:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02982f15d1a640a5bc77069a906f3e9a',uuid=f4210738-d01e-4408-a15c-aeccada6dd23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb573e79-a106-40c5-8c53-ab73eb6ba240", "address": "fa:16:3e:1e:80:9b", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb573e79-a1", "ovs_interfaceid": "bb573e79-a106-40c5-8c53-ab73eb6ba240", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:54:09 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-1c29cbf1-7ed9-486b-a628-f8cf2fd43e93 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Converting VIF {"id": "bb573e79-a106-40c5-8c53-ab73eb6ba240", "address": "fa:16:3e:1e:80:9b", "network": {"id": "1a1a40b0-631c-4f41-9ece-17cd713adfd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1882521174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3dc03400ff4448682ebba991a7e8af6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb573e79-a1", "ovs_interfaceid": "bb573e79-a106-40c5-8c53-ab73eb6ba240", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:54:09 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-1c29cbf1-7ed9-486b-a628-f8cf2fd43e93 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:80:9b,bridge_name='br-int',has_traffic_filtering=True,id=bb573e79-a106-40c5-8c53-ab73eb6ba240,network=Network(1a1a40b0-631c-4f41-9ece-17cd713adfd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb573e79-a1') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:54:09 user nova-compute[72773]: DEBUG os_vif [None req-1c29cbf1-7ed9-486b-a628-f8cf2fd43e93 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:80:9b,bridge_name='br-int',has_traffic_filtering=True,id=bb573e79-a106-40c5-8c53-ab73eb6ba240,network=Network(1a1a40b0-631c-4f41-9ece-17cd713adfd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb573e79-a1') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:54:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb573e79-a1, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:54:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:54:09 user nova-compute[72773]: INFO os_vif [None req-1c29cbf1-7ed9-486b-a628-f8cf2fd43e93 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:80:9b,bridge_name='br-int',has_traffic_filtering=True,id=bb573e79-a106-40c5-8c53-ab73eb6ba240,network=Network(1a1a40b0-631c-4f41-9ece-17cd713adfd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb573e79-a1')
Aug 16 22:54:09 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-1c29cbf1-7ed9-486b-a628-f8cf2fd43e93 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Deleting instance files /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23_del
Aug 16 22:54:09 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-1c29cbf1-7ed9-486b-a628-f8cf2fd43e93 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Deletion of /opt/stack/data/nova/instances/f4210738-d01e-4408-a15c-aeccada6dd23_del complete
Aug 16 22:54:09 user nova-compute[72773]: INFO nova.compute.manager [None req-1c29cbf1-7ed9-486b-a628-f8cf2fd43e93 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 16 22:54:09 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-1c29cbf1-7ed9-486b-a628-f8cf2fd43e93 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:54:09 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:54:09 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:54:09 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:54:09 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:54:09 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Took 0.52 seconds to deallocate network for instance.
Aug 16 22:54:09 user nova-compute[72773]: DEBUG nova.compute.manager [req-54744aec-0364-4c98-85d3-86636b4ea157 req-42a145aa-eec4-43c4-a575-0901589026a5 service nova] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Received event network-vif-deleted-bb573e79-a106-40c5-8c53-ab73eb6ba240 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:54:09 user nova-compute[72773]: INFO nova.compute.manager [req-54744aec-0364-4c98-85d3-86636b4ea157 req-42a145aa-eec4-43c4-a575-0901589026a5 service nova] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Neutron deleted interface bb573e79-a106-40c5-8c53-ab73eb6ba240; detaching it from the instance and deleting it from the info cache
Aug 16 22:54:09 user nova-compute[72773]: DEBUG nova.network.neutron [req-54744aec-0364-4c98-85d3-86636b4ea157 req-42a145aa-eec4-43c4-a575-0901589026a5 service nova] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:54:09 user nova-compute[72773]: DEBUG nova.compute.manager [req-54744aec-0364-4c98-85d3-86636b4ea157 req-42a145aa-eec4-43c4-a575-0901589026a5 service nova] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Detach interface failed, port_id=bb573e79-a106-40c5-8c53-ab73eb6ba240, reason: Instance f4210738-d01e-4408-a15c-aeccada6dd23 could not be found. {{(pid=72773) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 22:54:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1c29cbf1-7ed9-486b-a628-f8cf2fd43e93 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:54:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1c29cbf1-7ed9-486b-a628-f8cf2fd43e93 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:54:10 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-1c29cbf1-7ed9-486b-a628-f8cf2fd43e93 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:54:10 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-1c29cbf1-7ed9-486b-a628-f8cf2fd43e93 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:54:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1c29cbf1-7ed9-486b-a628-f8cf2fd43e93 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.212s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:54:10 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-1c29cbf1-7ed9-486b-a628-f8cf2fd43e93 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Deleted allocations for instance f4210738-d01e-4408-a15c-aeccada6dd23
Aug 16 22:54:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-1c29cbf1-7ed9-486b-a628-f8cf2fd43e93 tempest-ServerActionsTestOtherA-1807466388 tempest-ServerActionsTestOtherA-1807466388-project-member] Lock "f4210738-d01e-4408-a15c-aeccada6dd23" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.860s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:54:10 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:54:10 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:54:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-29c612f4-5ed1-46db-bdec-0eed58384746" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:54:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-29c612f4-5ed1-46db-bdec-0eed58384746" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:54:10 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 22:54:10 user nova-compute[72773]: DEBUG nova.compute.manager [req-db9b8d3c-355c-4c77-9331-d96ad64157c8 req-d5a5ea66-4905-4506-83b0-a1530b0a6f11 service nova] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Received event network-vif-plugged-bb573e79-a106-40c5-8c53-ab73eb6ba240 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:54:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-db9b8d3c-355c-4c77-9331-d96ad64157c8 req-d5a5ea66-4905-4506-83b0-a1530b0a6f11 service nova] Acquiring lock "f4210738-d01e-4408-a15c-aeccada6dd23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:54:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-db9b8d3c-355c-4c77-9331-d96ad64157c8 req-d5a5ea66-4905-4506-83b0-a1530b0a6f11 service nova] Lock "f4210738-d01e-4408-a15c-aeccada6dd23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:54:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-db9b8d3c-355c-4c77-9331-d96ad64157c8 req-d5a5ea66-4905-4506-83b0-a1530b0a6f11 service nova] Lock "f4210738-d01e-4408-a15c-aeccada6dd23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:54:10 user nova-compute[72773]: DEBUG nova.compute.manager [req-db9b8d3c-355c-4c77-9331-d96ad64157c8 req-d5a5ea66-4905-4506-83b0-a1530b0a6f11 service nova] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] No waiting events found dispatching network-vif-plugged-bb573e79-a106-40c5-8c53-ab73eb6ba240 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:54:10 user nova-compute[72773]: WARNING nova.compute.manager [req-db9b8d3c-355c-4c77-9331-d96ad64157c8 req-d5a5ea66-4905-4506-83b0-a1530b0a6f11 service nova] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Received unexpected event network-vif-plugged-bb573e79-a106-40c5-8c53-ab73eb6ba240 for instance with vm_state deleted and task_state None.
Aug 16 22:54:10 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Updating instance_info_cache with network_info: [{"id": "e184f66d-572d-452b-8675-006aeef3c372", "address": "fa:16:3e:1b:7d:b0", "network": {"id": "2e9dee37-d081-4059-a22c-e8aa5cacfc75", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2058131931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7bd0a0d273048b68a1f3a800be7da5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape184f66d-57", "ovs_interfaceid": "e184f66d-572d-452b-8675-006aeef3c372", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:54:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-29c612f4-5ed1-46db-bdec-0eed58384746" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:54:10 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 22:54:11 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:54:13 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:54:13 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:54:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:54:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:54:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:54:13 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:54:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:54:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:54:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:54:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:54:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:54:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:54:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:54:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:54:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:54:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:54:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:54:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:54:15 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:54:15 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:54:15 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=8485MB free_disk=25.340778350830078GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:54:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:54:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:54:15 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance f97d8a95-e281-496b-bb62-81747a5c2ffc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:54:15 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance bc6fff46-be38-4089-a6ba-de75e0d7baab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:54:15 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 29c612f4-5ed1-46db-bdec-0eed58384746 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:54:15 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:54:15 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:54:15 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:54:15 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:54:15 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:54:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.338s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:54:16 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:54:16 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:54:16 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:54:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:54:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:21 user nova-compute[72773]: DEBUG nova.compute.manager [req-a742dda9-29e2-4d41-bda1-b0159979f71f req-3ef67971-9292-4580-934a-57b5da900ad1 service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Received event network-changed-1b80812a-4fad-4669-83d7-fae725016671 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:54:21 user nova-compute[72773]: DEBUG nova.compute.manager [req-a742dda9-29e2-4d41-bda1-b0159979f71f req-3ef67971-9292-4580-934a-57b5da900ad1 service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Refreshing instance network info cache due to event network-changed-1b80812a-4fad-4669-83d7-fae725016671. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:54:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a742dda9-29e2-4d41-bda1-b0159979f71f req-3ef67971-9292-4580-934a-57b5da900ad1 service nova] Acquiring lock "refresh_cache-bc6fff46-be38-4089-a6ba-de75e0d7baab" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:54:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a742dda9-29e2-4d41-bda1-b0159979f71f req-3ef67971-9292-4580-934a-57b5da900ad1 service nova] Acquired lock "refresh_cache-bc6fff46-be38-4089-a6ba-de75e0d7baab" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:54:21 user nova-compute[72773]: DEBUG nova.network.neutron [req-a742dda9-29e2-4d41-bda1-b0159979f71f req-3ef67971-9292-4580-934a-57b5da900ad1 service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Refreshing network info cache for port 1b80812a-4fad-4669-83d7-fae725016671 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:54:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-982383bc-7ea4-4cae-87be-9445fa348071 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Acquiring lock "bc6fff46-be38-4089-a6ba-de75e0d7baab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:54:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-982383bc-7ea4-4cae-87be-9445fa348071 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "bc6fff46-be38-4089-a6ba-de75e0d7baab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:54:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-982383bc-7ea4-4cae-87be-9445fa348071 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Acquiring lock "bc6fff46-be38-4089-a6ba-de75e0d7baab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:54:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-982383bc-7ea4-4cae-87be-9445fa348071 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "bc6fff46-be38-4089-a6ba-de75e0d7baab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:54:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-982383bc-7ea4-4cae-87be-9445fa348071 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "bc6fff46-be38-4089-a6ba-de75e0d7baab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:54:21 user nova-compute[72773]: INFO nova.compute.manager [None req-982383bc-7ea4-4cae-87be-9445fa348071 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Terminating instance
Aug 16 22:54:21 user nova-compute[72773]: DEBUG nova.compute.manager [None req-982383bc-7ea4-4cae-87be-9445fa348071 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:54:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:22 user nova-compute[72773]: DEBUG nova.compute.manager [req-7e51d1ab-e3b2-4b8e-93f6-05decc9b9f41 req-7aeef4a2-f38b-4681-b25a-bbadd56c20dd service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Received event network-vif-unplugged-1b80812a-4fad-4669-83d7-fae725016671 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:54:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-7e51d1ab-e3b2-4b8e-93f6-05decc9b9f41 req-7aeef4a2-f38b-4681-b25a-bbadd56c20dd service nova] Acquiring lock "bc6fff46-be38-4089-a6ba-de75e0d7baab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:54:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-7e51d1ab-e3b2-4b8e-93f6-05decc9b9f41 req-7aeef4a2-f38b-4681-b25a-bbadd56c20dd service nova] Lock "bc6fff46-be38-4089-a6ba-de75e0d7baab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:54:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-7e51d1ab-e3b2-4b8e-93f6-05decc9b9f41 req-7aeef4a2-f38b-4681-b25a-bbadd56c20dd service nova] Lock "bc6fff46-be38-4089-a6ba-de75e0d7baab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:54:22 user nova-compute[72773]: DEBUG nova.compute.manager [req-7e51d1ab-e3b2-4b8e-93f6-05decc9b9f41 req-7aeef4a2-f38b-4681-b25a-bbadd56c20dd service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] No waiting events found dispatching network-vif-unplugged-1b80812a-4fad-4669-83d7-fae725016671 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:54:22 user nova-compute[72773]: DEBUG nova.compute.manager [req-7e51d1ab-e3b2-4b8e-93f6-05decc9b9f41 req-7aeef4a2-f38b-4681-b25a-bbadd56c20dd service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Received event network-vif-unplugged-1b80812a-4fad-4669-83d7-fae725016671 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:54:22 user nova-compute[72773]: DEBUG nova.network.neutron [req-a742dda9-29e2-4d41-bda1-b0159979f71f req-3ef67971-9292-4580-934a-57b5da900ad1 service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Updated VIF entry in instance network info cache for port 1b80812a-4fad-4669-83d7-fae725016671. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:54:22 user nova-compute[72773]: DEBUG nova.network.neutron [req-a742dda9-29e2-4d41-bda1-b0159979f71f req-3ef67971-9292-4580-934a-57b5da900ad1 service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Updating instance_info_cache with network_info: [{"id": "1b80812a-4fad-4669-83d7-fae725016671", "address": "fa:16:3e:87:bb:32", "network": {"id": "f9944803-97d3-451e-ade8-b8cc953c48e3", "bridge": "br-int", "label": "tempest-TestStampPattern-997567034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9da6df5003942baa7e7da93c0e3bc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b80812a-4f", "ovs_interfaceid": "1b80812a-4fad-4669-83d7-fae725016671", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:54:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a742dda9-29e2-4d41-bda1-b0159979f71f req-3ef67971-9292-4580-934a-57b5da900ad1 service nova] Releasing lock "refresh_cache-bc6fff46-be38-4089-a6ba-de75e0d7baab" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:54:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:22 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Instance destroyed successfully.
Aug 16 22:54:22 user nova-compute[72773]: DEBUG nova.objects.instance [None req-982383bc-7ea4-4cae-87be-9445fa348071 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lazy-loading 'resources' on Instance uuid bc6fff46-be38-4089-a6ba-de75e0d7baab {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:54:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-982383bc-7ea4-4cae-87be-9445fa348071 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:46:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-947253699',display_name='tempest-TestStampPattern-server-947253699',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-947253699',id=41,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzC0aSRz7xXngfuyAWDxc33KMp1GyfHt4lts9ifm5UwE3d17y1lNQi+MHuQTetPPkxrDXwXT5pk8rTxZLOsiBLgU5JxY5FTEUoncDvpwTM+Osg9cwYLjr/DyE/wbeHeRQ==',key_name='tempest-TestStampPattern-749194713',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:46:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9da6df5003942baa7e7da93c0e3bc79',ramdisk_id='',reservation_id='r-5ljg97yr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-552569719',owner_user_name='tempest-TestStampPattern-552569719-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:50:14Z,user_data=None,user_id='7a9bfc4519a64911b5613b3a96a461eb',uuid=bc6fff46-be38-4089-a6ba-de75e0d7baab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b80812a-4fad-4669-83d7-fae725016671", "address": "fa:16:3e:87:bb:32", "network": {"id": "f9944803-97d3-451e-ade8-b8cc953c48e3", "bridge": "br-int", "label": "tempest-TestStampPattern-997567034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9da6df5003942baa7e7da93c0e3bc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b80812a-4f", "ovs_interfaceid": "1b80812a-4fad-4669-83d7-fae725016671", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:54:22 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-982383bc-7ea4-4cae-87be-9445fa348071 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Converting VIF {"id": "1b80812a-4fad-4669-83d7-fae725016671", "address": "fa:16:3e:87:bb:32", "network": {"id": "f9944803-97d3-451e-ade8-b8cc953c48e3", "bridge": "br-int", "label": "tempest-TestStampPattern-997567034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9da6df5003942baa7e7da93c0e3bc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b80812a-4f", "ovs_interfaceid": "1b80812a-4fad-4669-83d7-fae725016671", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:54:22 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-982383bc-7ea4-4cae-87be-9445fa348071 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:bb:32,bridge_name='br-int',has_traffic_filtering=True,id=1b80812a-4fad-4669-83d7-fae725016671,network=Network(f9944803-97d3-451e-ade8-b8cc953c48e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b80812a-4f') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:54:22 user nova-compute[72773]: DEBUG os_vif [None req-982383bc-7ea4-4cae-87be-9445fa348071 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:bb:32,bridge_name='br-int',has_traffic_filtering=True,id=1b80812a-4fad-4669-83d7-fae725016671,network=Network(f9944803-97d3-451e-ade8-b8cc953c48e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b80812a-4f') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:54:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b80812a-4f, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:54:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:54:22 user nova-compute[72773]: INFO os_vif [None req-982383bc-7ea4-4cae-87be-9445fa348071 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:bb:32,bridge_name='br-int',has_traffic_filtering=True,id=1b80812a-4fad-4669-83d7-fae725016671,network=Network(f9944803-97d3-451e-ade8-b8cc953c48e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b80812a-4f')
Aug 16 22:54:22 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-982383bc-7ea4-4cae-87be-9445fa348071 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Deleting instance files /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab_del
Aug 16 22:54:22 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-982383bc-7ea4-4cae-87be-9445fa348071 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Deletion of /opt/stack/data/nova/instances/bc6fff46-be38-4089-a6ba-de75e0d7baab_del complete
Aug 16 22:54:22 user nova-compute[72773]: INFO nova.compute.manager [None req-982383bc-7ea4-4cae-87be-9445fa348071 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 16 22:54:22 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-982383bc-7ea4-4cae-87be-9445fa348071 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:54:22 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:54:22 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:54:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:23 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:54:23 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Took 0.66 seconds to deallocate network for instance.
Aug 16 22:54:23 user nova-compute[72773]: DEBUG nova.compute.manager [req-efdcae21-4e6d-4027-9f87-cb96ebdffce5 req-89aa9bfe-7d0a-4b3f-a85a-0f4ab300b0c3 service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Received event network-vif-deleted-1b80812a-4fad-4669-83d7-fae725016671 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:54:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-982383bc-7ea4-4cae-87be-9445fa348071 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:54:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-982383bc-7ea4-4cae-87be-9445fa348071 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:54:23 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-982383bc-7ea4-4cae-87be-9445fa348071 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:54:23 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-982383bc-7ea4-4cae-87be-9445fa348071 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:54:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-982383bc-7ea4-4cae-87be-9445fa348071 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:54:23 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-982383bc-7ea4-4cae-87be-9445fa348071 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Deleted allocations for instance bc6fff46-be38-4089-a6ba-de75e0d7baab
Aug 16 22:54:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-982383bc-7ea4-4cae-87be-9445fa348071 tempest-TestStampPattern-552569719 tempest-TestStampPattern-552569719-project-member] Lock "bc6fff46-be38-4089-a6ba-de75e0d7baab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.930s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:54:24 user nova-compute[72773]: DEBUG nova.compute.manager [req-0c688703-3a49-4720-ac4b-f26403685d7d req-f80dff7c-6fb2-42ea-b68a-02538a66b4f5 service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Received event network-vif-plugged-1b80812a-4fad-4669-83d7-fae725016671 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:54:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0c688703-3a49-4720-ac4b-f26403685d7d req-f80dff7c-6fb2-42ea-b68a-02538a66b4f5 service nova] Acquiring lock "bc6fff46-be38-4089-a6ba-de75e0d7baab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:54:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0c688703-3a49-4720-ac4b-f26403685d7d req-f80dff7c-6fb2-42ea-b68a-02538a66b4f5 service nova] Lock "bc6fff46-be38-4089-a6ba-de75e0d7baab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:54:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0c688703-3a49-4720-ac4b-f26403685d7d req-f80dff7c-6fb2-42ea-b68a-02538a66b4f5 service nova] Lock "bc6fff46-be38-4089-a6ba-de75e0d7baab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:54:24 user nova-compute[72773]: DEBUG nova.compute.manager [req-0c688703-3a49-4720-ac4b-f26403685d7d req-f80dff7c-6fb2-42ea-b68a-02538a66b4f5 service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] No waiting events found dispatching network-vif-plugged-1b80812a-4fad-4669-83d7-fae725016671 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:54:24 user nova-compute[72773]: WARNING nova.compute.manager [req-0c688703-3a49-4720-ac4b-f26403685d7d req-f80dff7c-6fb2-42ea-b68a-02538a66b4f5 service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Received unexpected event network-vif-plugged-1b80812a-4fad-4669-83d7-fae725016671 for instance with vm_state deleted and task_state None.
Aug 16 22:54:24 user nova-compute[72773]: DEBUG nova.compute.manager [req-0c688703-3a49-4720-ac4b-f26403685d7d req-f80dff7c-6fb2-42ea-b68a-02538a66b4f5 service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Received event network-vif-plugged-1b80812a-4fad-4669-83d7-fae725016671 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:54:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0c688703-3a49-4720-ac4b-f26403685d7d req-f80dff7c-6fb2-42ea-b68a-02538a66b4f5 service nova] Acquiring lock "bc6fff46-be38-4089-a6ba-de75e0d7baab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:54:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0c688703-3a49-4720-ac4b-f26403685d7d req-f80dff7c-6fb2-42ea-b68a-02538a66b4f5 service nova] Lock "bc6fff46-be38-4089-a6ba-de75e0d7baab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:54:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0c688703-3a49-4720-ac4b-f26403685d7d req-f80dff7c-6fb2-42ea-b68a-02538a66b4f5 service nova] Lock "bc6fff46-be38-4089-a6ba-de75e0d7baab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:54:24 user nova-compute[72773]: DEBUG nova.compute.manager [req-0c688703-3a49-4720-ac4b-f26403685d7d req-f80dff7c-6fb2-42ea-b68a-02538a66b4f5 service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] No waiting events found dispatching network-vif-plugged-1b80812a-4fad-4669-83d7-fae725016671 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:54:24 user nova-compute[72773]: WARNING nova.compute.manager [req-0c688703-3a49-4720-ac4b-f26403685d7d req-f80dff7c-6fb2-42ea-b68a-02538a66b4f5 service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Received unexpected event network-vif-plugged-1b80812a-4fad-4669-83d7-fae725016671 for instance with vm_state deleted and task_state None.
Aug 16 22:54:24 user nova-compute[72773]: DEBUG nova.compute.manager [req-0c688703-3a49-4720-ac4b-f26403685d7d req-f80dff7c-6fb2-42ea-b68a-02538a66b4f5 service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Received event network-vif-plugged-1b80812a-4fad-4669-83d7-fae725016671 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:54:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0c688703-3a49-4720-ac4b-f26403685d7d req-f80dff7c-6fb2-42ea-b68a-02538a66b4f5 service nova] Acquiring lock "bc6fff46-be38-4089-a6ba-de75e0d7baab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:54:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0c688703-3a49-4720-ac4b-f26403685d7d req-f80dff7c-6fb2-42ea-b68a-02538a66b4f5 service nova] Lock "bc6fff46-be38-4089-a6ba-de75e0d7baab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:54:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0c688703-3a49-4720-ac4b-f26403685d7d req-f80dff7c-6fb2-42ea-b68a-02538a66b4f5 service nova] Lock "bc6fff46-be38-4089-a6ba-de75e0d7baab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:54:24 user nova-compute[72773]: DEBUG nova.compute.manager [req-0c688703-3a49-4720-ac4b-f26403685d7d req-f80dff7c-6fb2-42ea-b68a-02538a66b4f5 service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] No waiting events found dispatching network-vif-plugged-1b80812a-4fad-4669-83d7-fae725016671 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:54:24 user nova-compute[72773]: WARNING nova.compute.manager [req-0c688703-3a49-4720-ac4b-f26403685d7d req-f80dff7c-6fb2-42ea-b68a-02538a66b4f5 service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Received unexpected event network-vif-plugged-1b80812a-4fad-4669-83d7-fae725016671 for instance with vm_state deleted and task_state None.
Aug 16 22:54:24 user nova-compute[72773]: DEBUG nova.compute.manager [req-0c688703-3a49-4720-ac4b-f26403685d7d req-f80dff7c-6fb2-42ea-b68a-02538a66b4f5 service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Received event network-vif-unplugged-1b80812a-4fad-4669-83d7-fae725016671 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:54:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0c688703-3a49-4720-ac4b-f26403685d7d req-f80dff7c-6fb2-42ea-b68a-02538a66b4f5 service nova] Acquiring lock "bc6fff46-be38-4089-a6ba-de75e0d7baab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:54:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0c688703-3a49-4720-ac4b-f26403685d7d req-f80dff7c-6fb2-42ea-b68a-02538a66b4f5 service nova] Lock "bc6fff46-be38-4089-a6ba-de75e0d7baab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:54:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0c688703-3a49-4720-ac4b-f26403685d7d req-f80dff7c-6fb2-42ea-b68a-02538a66b4f5 service nova] Lock "bc6fff46-be38-4089-a6ba-de75e0d7baab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:54:24 user nova-compute[72773]: DEBUG nova.compute.manager [req-0c688703-3a49-4720-ac4b-f26403685d7d req-f80dff7c-6fb2-42ea-b68a-02538a66b4f5 service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] No waiting events found dispatching network-vif-unplugged-1b80812a-4fad-4669-83d7-fae725016671 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:54:24 user nova-compute[72773]: WARNING nova.compute.manager [req-0c688703-3a49-4720-ac4b-f26403685d7d req-f80dff7c-6fb2-42ea-b68a-02538a66b4f5 service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Received unexpected event network-vif-unplugged-1b80812a-4fad-4669-83d7-fae725016671 for instance with vm_state deleted and task_state None.
Aug 16 22:54:24 user nova-compute[72773]: DEBUG nova.compute.manager [req-0c688703-3a49-4720-ac4b-f26403685d7d req-f80dff7c-6fb2-42ea-b68a-02538a66b4f5 service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Received event network-vif-plugged-1b80812a-4fad-4669-83d7-fae725016671 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:54:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0c688703-3a49-4720-ac4b-f26403685d7d req-f80dff7c-6fb2-42ea-b68a-02538a66b4f5 service nova] Acquiring lock "bc6fff46-be38-4089-a6ba-de75e0d7baab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:54:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0c688703-3a49-4720-ac4b-f26403685d7d req-f80dff7c-6fb2-42ea-b68a-02538a66b4f5 service nova] Lock "bc6fff46-be38-4089-a6ba-de75e0d7baab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:54:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0c688703-3a49-4720-ac4b-f26403685d7d req-f80dff7c-6fb2-42ea-b68a-02538a66b4f5 service nova] Lock "bc6fff46-be38-4089-a6ba-de75e0d7baab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:54:24 user nova-compute[72773]: DEBUG nova.compute.manager [req-0c688703-3a49-4720-ac4b-f26403685d7d req-f80dff7c-6fb2-42ea-b68a-02538a66b4f5 service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] No waiting events found dispatching network-vif-plugged-1b80812a-4fad-4669-83d7-fae725016671 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:54:24 user nova-compute[72773]: WARNING nova.compute.manager [req-0c688703-3a49-4720-ac4b-f26403685d7d req-f80dff7c-6fb2-42ea-b68a-02538a66b4f5 service nova] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Received unexpected event network-vif-plugged-1b80812a-4fad-4669-83d7-fae725016671 for instance with vm_state deleted and task_state None.
Aug 16 22:54:24 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692226449.2158415, f4210738-d01e-4408-a15c-aeccada6dd23 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:54:24 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] VM Stopped (Lifecycle Event)
Aug 16 22:54:24 user nova-compute[72773]: DEBUG nova.compute.manager [None req-fb826dd2-ad35-4467-8d73-d9e05f9cec75 None None] [instance: f4210738-d01e-4408-a15c-aeccada6dd23] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:54:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:54:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 22:54:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:54:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:54:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:54:37 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692226462.66223, bc6fff46-be38-4089-a6ba-de75e0d7baab => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:54:37 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] VM Stopped (Lifecycle Event)
Aug 16 22:54:37 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a49559f1-23e6-42d6-b1fd-0f1c9a9ece0c None None] [instance: bc6fff46-be38-4089-a6ba-de75e0d7baab] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:54:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:54:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:54:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 22:54:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:54:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:54:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:54:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 22:54:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:54:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:54:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:54:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 22:54:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:54:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:54:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:54:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:55:01 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:55:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:55:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 22:55:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:55:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:55:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:08 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:55:10 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:55:10 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:55:10 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Rebuilding the list of instances to heal {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 22:55:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-f97d8a95-e281-496b-bb62-81747a5c2ffc" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:55:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-f97d8a95-e281-496b-bb62-81747a5c2ffc" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:55:10 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 22:55:10 user nova-compute[72773]: DEBUG nova.objects.instance [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lazy-loading 'info_cache' on Instance uuid f97d8a95-e281-496b-bb62-81747a5c2ffc {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:55:11 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Updating instance_info_cache with network_info: [{"id": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "address": "fa:16:3e:12:35:93", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0ffcbd-76", "ovs_interfaceid": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:55:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-f97d8a95-e281-496b-bb62-81747a5c2ffc" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:55:11 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 22:55:11 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:55:11 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:55:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:55:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 22:55:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:55:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:55:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:13 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:55:15 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:55:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:55:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:55:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:55:15 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:55:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:55:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:55:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:55:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f8f1f565-dd27-4ac0-9eec-785bbeb79afe tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "f97d8a95-e281-496b-bb62-81747a5c2ffc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:55:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f8f1f565-dd27-4ac0-9eec-785bbeb79afe tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:55:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f8f1f565-dd27-4ac0-9eec-785bbeb79afe tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:55:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f8f1f565-dd27-4ac0-9eec-785bbeb79afe tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:55:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f8f1f565-dd27-4ac0-9eec-785bbeb79afe tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:55:16 user nova-compute[72773]: INFO nova.compute.manager [None req-f8f1f565-dd27-4ac0-9eec-785bbeb79afe tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Terminating instance
Aug 16 22:55:16 user nova-compute[72773]: DEBUG nova.compute.manager [None req-f8f1f565-dd27-4ac0-9eec-785bbeb79afe tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:55:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:55:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:16 user nova-compute[72773]: DEBUG nova.compute.manager [req-29ef3e0e-310d-49e2-9370-0dba18e0019b req-3cad6a5d-efd2-4b64-97d1-90d0084e8edb service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Received event network-vif-unplugged-3c0ffcbd-768e-4040-8765-663fa495a3ab {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:55:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-29ef3e0e-310d-49e2-9370-0dba18e0019b req-3cad6a5d-efd2-4b64-97d1-90d0084e8edb service nova] Acquiring lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:55:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-29ef3e0e-310d-49e2-9370-0dba18e0019b req-3cad6a5d-efd2-4b64-97d1-90d0084e8edb service nova] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:55:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-29ef3e0e-310d-49e2-9370-0dba18e0019b req-3cad6a5d-efd2-4b64-97d1-90d0084e8edb service nova] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:55:16 user nova-compute[72773]: DEBUG nova.compute.manager [req-29ef3e0e-310d-49e2-9370-0dba18e0019b req-3cad6a5d-efd2-4b64-97d1-90d0084e8edb service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] No waiting events found dispatching network-vif-unplugged-3c0ffcbd-768e-4040-8765-663fa495a3ab {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:55:16 user nova-compute[72773]: DEBUG nova.compute.manager [req-29ef3e0e-310d-49e2-9370-0dba18e0019b req-3cad6a5d-efd2-4b64-97d1-90d0084e8edb service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Received event network-vif-unplugged-3c0ffcbd-768e-4040-8765-663fa495a3ab for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:55:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:55:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:55:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:55:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:55:16 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Instance destroyed successfully.
Aug 16 22:55:16 user nova-compute[72773]: DEBUG nova.objects.instance [None req-f8f1f565-dd27-4ac0-9eec-785bbeb79afe tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lazy-loading 'resources' on Instance uuid f97d8a95-e281-496b-bb62-81747a5c2ffc {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:55:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-f8f1f565-dd27-4ac0-9eec-785bbeb79afe tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-901024509',display_name='tempest-AttachVolumeTestJSON-server-901024509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-901024509',id=39,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMwC80zAC+DDm1/aQS1yIwW3iohkON4IwgRB4Qo30pRKnd56Cla0ZmEd6mFqvSws8dEJWHuZr06ofoAXldMYoVLEZx3MfxCSPNlh2DAJMCkFmy36ylUG4yyQmmfHxBPSw==',key_name='tempest-keypair-1482365818',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:45:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6da6170d60c4d41b14c342700a5dd83',ramdisk_id='',reservation_id='r-20vqu8m3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-317922803',owner_user_name='tempest-AttachVolumeTestJSON-317922803-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:53:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7b76435f64e47169f3ca08aebb8e766',uuid=f97d8a95-e281-496b-bb62-81747a5c2ffc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "address": "fa:16:3e:12:35:93", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0ffcbd-76", "ovs_interfaceid": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:55:16 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-f8f1f565-dd27-4ac0-9eec-785bbeb79afe tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Converting VIF {"id": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "address": "fa:16:3e:12:35:93", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c0ffcbd-76", "ovs_interfaceid": "3c0ffcbd-768e-4040-8765-663fa495a3ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:55:16 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-f8f1f565-dd27-4ac0-9eec-785bbeb79afe tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:35:93,bridge_name='br-int',has_traffic_filtering=True,id=3c0ffcbd-768e-4040-8765-663fa495a3ab,network=Network(3348a6ff-bdcc-49e3-bb0a-4839999ec213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c0ffcbd-76') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:55:16 user nova-compute[72773]: DEBUG os_vif [None req-f8f1f565-dd27-4ac0-9eec-785bbeb79afe tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:35:93,bridge_name='br-int',has_traffic_filtering=True,id=3c0ffcbd-768e-4040-8765-663fa495a3ab,network=Network(3348a6ff-bdcc-49e3-bb0a-4839999ec213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c0ffcbd-76') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:55:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c0ffcbd-76, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:55:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:55:17 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:55:17 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:55:17 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=8626MB free_disk=25.46429443359375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:55:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:55:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:55:17 user nova-compute[72773]: INFO os_vif [None req-f8f1f565-dd27-4ac0-9eec-785bbeb79afe tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:35:93,bridge_name='br-int',has_traffic_filtering=True,id=3c0ffcbd-768e-4040-8765-663fa495a3ab,network=Network(3348a6ff-bdcc-49e3-bb0a-4839999ec213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c0ffcbd-76')
Aug 16 22:55:17 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-f8f1f565-dd27-4ac0-9eec-785bbeb79afe tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Deleting instance files /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc_del
Aug 16 22:55:17 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-f8f1f565-dd27-4ac0-9eec-785bbeb79afe tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Deletion of /opt/stack/data/nova/instances/f97d8a95-e281-496b-bb62-81747a5c2ffc_del complete
Aug 16 22:55:17 user nova-compute[72773]: INFO nova.compute.manager [None req-f8f1f565-dd27-4ac0-9eec-785bbeb79afe tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Took 1.35 seconds to destroy the instance on the hypervisor.
Aug 16 22:55:17 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-f8f1f565-dd27-4ac0-9eec-785bbeb79afe tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:55:17 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:55:17 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:55:17 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance f97d8a95-e281-496b-bb62-81747a5c2ffc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:55:17 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 29c612f4-5ed1-46db-bdec-0eed58384746 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:55:17 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:55:17 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:55:17 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:55:17 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:55:17 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:55:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.287s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:55:18 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:55:18 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Took 0.99 seconds to deallocate network for instance.
Aug 16 22:55:18 user nova-compute[72773]: DEBUG nova.compute.manager [req-cc43c06b-d41a-4e61-90cc-ab8fa1cf51aa req-16f7d9b8-298a-4170-9ee0-fde86b783e71 service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Received event network-vif-deleted-3c0ffcbd-768e-4040-8765-663fa495a3ab {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:55:18 user nova-compute[72773]: INFO nova.compute.manager [req-cc43c06b-d41a-4e61-90cc-ab8fa1cf51aa req-16f7d9b8-298a-4170-9ee0-fde86b783e71 service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Neutron deleted interface 3c0ffcbd-768e-4040-8765-663fa495a3ab; detaching it from the instance and deleting it from the info cache
Aug 16 22:55:18 user nova-compute[72773]: DEBUG nova.network.neutron [req-cc43c06b-d41a-4e61-90cc-ab8fa1cf51aa req-16f7d9b8-298a-4170-9ee0-fde86b783e71 service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:55:18 user nova-compute[72773]: DEBUG nova.compute.manager [req-3010f916-8ed7-416c-8a2a-64389f80c995 req-82a09fc9-c5d5-48bb-91e6-e9743477f25e service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Received event network-vif-plugged-3c0ffcbd-768e-4040-8765-663fa495a3ab {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:55:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3010f916-8ed7-416c-8a2a-64389f80c995 req-82a09fc9-c5d5-48bb-91e6-e9743477f25e service nova] Acquiring lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:55:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3010f916-8ed7-416c-8a2a-64389f80c995 req-82a09fc9-c5d5-48bb-91e6-e9743477f25e service nova] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:55:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3010f916-8ed7-416c-8a2a-64389f80c995 req-82a09fc9-c5d5-48bb-91e6-e9743477f25e service nova] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:55:18 user nova-compute[72773]: DEBUG nova.compute.manager [req-3010f916-8ed7-416c-8a2a-64389f80c995 req-82a09fc9-c5d5-48bb-91e6-e9743477f25e service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] No waiting events found dispatching network-vif-plugged-3c0ffcbd-768e-4040-8765-663fa495a3ab {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:55:18 user nova-compute[72773]: WARNING nova.compute.manager [req-3010f916-8ed7-416c-8a2a-64389f80c995 req-82a09fc9-c5d5-48bb-91e6-e9743477f25e service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Received unexpected event network-vif-plugged-3c0ffcbd-768e-4040-8765-663fa495a3ab for instance with vm_state active and task_state deleting.
Aug 16 22:55:18 user nova-compute[72773]: DEBUG nova.compute.manager [req-cc43c06b-d41a-4e61-90cc-ab8fa1cf51aa req-16f7d9b8-298a-4170-9ee0-fde86b783e71 service nova] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Detach interface failed, port_id=3c0ffcbd-768e-4040-8765-663fa495a3ab, reason: Instance f97d8a95-e281-496b-bb62-81747a5c2ffc could not be found. {{(pid=72773) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 22:55:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f8f1f565-dd27-4ac0-9eec-785bbeb79afe tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:55:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f8f1f565-dd27-4ac0-9eec-785bbeb79afe tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:55:18 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-f8f1f565-dd27-4ac0-9eec-785bbeb79afe tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:55:18 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-f8f1f565-dd27-4ac0-9eec-785bbeb79afe tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:55:18 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:55:18 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:55:18 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:55:18 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:55:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f8f1f565-dd27-4ac0-9eec-785bbeb79afe tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.160s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:55:18 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-f8f1f565-dd27-4ac0-9eec-785bbeb79afe tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Deleted allocations for instance f97d8a95-e281-496b-bb62-81747a5c2ffc
Aug 16 22:55:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f8f1f565-dd27-4ac0-9eec-785bbeb79afe tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "f97d8a95-e281-496b-bb62-81747a5c2ffc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.701s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:55:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c7a1aedf-7fad-4742-8aa8-3d38db888a45 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Acquiring lock "29c612f4-5ed1-46db-bdec-0eed58384746" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:55:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c7a1aedf-7fad-4742-8aa8-3d38db888a45 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "29c612f4-5ed1-46db-bdec-0eed58384746" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:55:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c7a1aedf-7fad-4742-8aa8-3d38db888a45 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Acquiring lock "29c612f4-5ed1-46db-bdec-0eed58384746-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:55:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c7a1aedf-7fad-4742-8aa8-3d38db888a45 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "29c612f4-5ed1-46db-bdec-0eed58384746-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:55:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c7a1aedf-7fad-4742-8aa8-3d38db888a45 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "29c612f4-5ed1-46db-bdec-0eed58384746-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:55:19 user nova-compute[72773]: INFO nova.compute.manager [None req-c7a1aedf-7fad-4742-8aa8-3d38db888a45 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Terminating instance
Aug 16 22:55:19 user nova-compute[72773]: DEBUG nova.compute.manager [None req-c7a1aedf-7fad-4742-8aa8-3d38db888a45 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:55:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-aefac5d6-ceb2-499f-b220-0a20432caac6 req-ad1fd74a-8800-445a-be3f-4e12b5516796 service nova] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Received event network-vif-unplugged-e184f66d-572d-452b-8675-006aeef3c372 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:55:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-aefac5d6-ceb2-499f-b220-0a20432caac6 req-ad1fd74a-8800-445a-be3f-4e12b5516796 service nova] Acquiring lock "29c612f4-5ed1-46db-bdec-0eed58384746-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:55:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-aefac5d6-ceb2-499f-b220-0a20432caac6 req-ad1fd74a-8800-445a-be3f-4e12b5516796 service nova] Lock "29c612f4-5ed1-46db-bdec-0eed58384746-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:55:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-aefac5d6-ceb2-499f-b220-0a20432caac6 req-ad1fd74a-8800-445a-be3f-4e12b5516796 service nova] Lock "29c612f4-5ed1-46db-bdec-0eed58384746-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:55:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-aefac5d6-ceb2-499f-b220-0a20432caac6 req-ad1fd74a-8800-445a-be3f-4e12b5516796 service nova] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] No waiting events found dispatching network-vif-unplugged-e184f66d-572d-452b-8675-006aeef3c372 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:55:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-aefac5d6-ceb2-499f-b220-0a20432caac6 req-ad1fd74a-8800-445a-be3f-4e12b5516796 service nova] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Received event network-vif-unplugged-e184f66d-572d-452b-8675-006aeef3c372 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:55:20 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Instance destroyed successfully.
Aug 16 22:55:20 user nova-compute[72773]: DEBUG nova.objects.instance [None req-c7a1aedf-7fad-4742-8aa8-3d38db888a45 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lazy-loading 'resources' on Instance uuid 29c612f4-5ed1-46db-bdec-0eed58384746 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:55:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-c7a1aedf-7fad-4742-8aa8-3d38db888a45 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:47:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1502735280',display_name='tempest-SnapshotDataIntegrityTests-server-1502735280',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1502735280',id=42,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5iPz4RqtHj+wnpwx9tVR+hSztjc3SxPYoDOEsdm04V0TvYD07oWN1Ftosq6Ny11IvI81kxhLhyXI9YMBoFUa6mtudHON17yNHrcIw5BEODJyKwTBkGranvYsLBZik5SQ==',key_name='tempest-keypair-1492439283',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:47:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7bd0a0d273048b68a1f3a800be7da5c',ramdisk_id='',reservation_id='r-rz0sgfeu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-760317901',owner_user_name='tempest-SnapshotDataIntegrityTests-760317901-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:47:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc5eadd5926b4e9d80f55e6b28376e5e',uuid=29c612f4-5ed1-46db-bdec-0eed58384746,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e184f66d-572d-452b-8675-006aeef3c372", "address": "fa:16:3e:1b:7d:b0", "network": {"id": "2e9dee37-d081-4059-a22c-e8aa5cacfc75", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2058131931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7bd0a0d273048b68a1f3a800be7da5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape184f66d-57", "ovs_interfaceid": "e184f66d-572d-452b-8675-006aeef3c372", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:55:20 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-c7a1aedf-7fad-4742-8aa8-3d38db888a45 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Converting VIF {"id": "e184f66d-572d-452b-8675-006aeef3c372", "address": "fa:16:3e:1b:7d:b0", "network": {"id": "2e9dee37-d081-4059-a22c-e8aa5cacfc75", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2058131931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7bd0a0d273048b68a1f3a800be7da5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape184f66d-57", "ovs_interfaceid": "e184f66d-572d-452b-8675-006aeef3c372", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:55:20 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-c7a1aedf-7fad-4742-8aa8-3d38db888a45 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:7d:b0,bridge_name='br-int',has_traffic_filtering=True,id=e184f66d-572d-452b-8675-006aeef3c372,network=Network(2e9dee37-d081-4059-a22c-e8aa5cacfc75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape184f66d-57') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:55:20 user nova-compute[72773]: DEBUG os_vif [None req-c7a1aedf-7fad-4742-8aa8-3d38db888a45 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:7d:b0,bridge_name='br-int',has_traffic_filtering=True,id=e184f66d-572d-452b-8675-006aeef3c372,network=Network(2e9dee37-d081-4059-a22c-e8aa5cacfc75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape184f66d-57') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:55:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape184f66d-57, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:55:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:55:20 user nova-compute[72773]: INFO os_vif [None req-c7a1aedf-7fad-4742-8aa8-3d38db888a45 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:7d:b0,bridge_name='br-int',has_traffic_filtering=True,id=e184f66d-572d-452b-8675-006aeef3c372,network=Network(2e9dee37-d081-4059-a22c-e8aa5cacfc75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape184f66d-57')
Aug 16 22:55:20 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-c7a1aedf-7fad-4742-8aa8-3d38db888a45 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Deleting instance files /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746_del
Aug 16 22:55:20 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-c7a1aedf-7fad-4742-8aa8-3d38db888a45 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Deletion of /opt/stack/data/nova/instances/29c612f4-5ed1-46db-bdec-0eed58384746_del complete
Aug 16 22:55:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:20 user nova-compute[72773]: INFO nova.compute.manager [None req-c7a1aedf-7fad-4742-8aa8-3d38db888a45 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 16 22:55:20 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-c7a1aedf-7fad-4742-8aa8-3d38db888a45 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:55:20 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:55:20 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:55:22 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:55:22 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Took 1.31 seconds to deallocate network for instance.
Aug 16 22:55:22 user nova-compute[72773]: DEBUG nova.compute.manager [req-3ad0e195-7f3e-4f2d-b7ba-7dc58d1c8637 req-ac469473-aedc-468a-a607-2efad0163d42 service nova] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Received event network-vif-deleted-e184f66d-572d-452b-8675-006aeef3c372 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:55:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c7a1aedf-7fad-4742-8aa8-3d38db888a45 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:55:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c7a1aedf-7fad-4742-8aa8-3d38db888a45 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:55:22 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-c7a1aedf-7fad-4742-8aa8-3d38db888a45 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:55:22 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-c7a1aedf-7fad-4742-8aa8-3d38db888a45 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:55:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c7a1aedf-7fad-4742-8aa8-3d38db888a45 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.149s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:55:22 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-c7a1aedf-7fad-4742-8aa8-3d38db888a45 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Deleted allocations for instance 29c612f4-5ed1-46db-bdec-0eed58384746
Aug 16 22:55:22 user nova-compute[72773]: DEBUG nova.compute.manager [req-d51fefa1-9c7c-4b17-b8bb-e07821ecd62b req-3769e28d-d346-4487-8891-94ef28461804 service nova] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Received event network-vif-plugged-e184f66d-572d-452b-8675-006aeef3c372 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:55:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d51fefa1-9c7c-4b17-b8bb-e07821ecd62b req-3769e28d-d346-4487-8891-94ef28461804 service nova] Acquiring lock "29c612f4-5ed1-46db-bdec-0eed58384746-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:55:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d51fefa1-9c7c-4b17-b8bb-e07821ecd62b req-3769e28d-d346-4487-8891-94ef28461804 service nova] Lock "29c612f4-5ed1-46db-bdec-0eed58384746-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:55:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d51fefa1-9c7c-4b17-b8bb-e07821ecd62b req-3769e28d-d346-4487-8891-94ef28461804 service nova] Lock "29c612f4-5ed1-46db-bdec-0eed58384746-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:55:22 user nova-compute[72773]: DEBUG nova.compute.manager [req-d51fefa1-9c7c-4b17-b8bb-e07821ecd62b req-3769e28d-d346-4487-8891-94ef28461804 service nova] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] No waiting events found dispatching network-vif-plugged-e184f66d-572d-452b-8675-006aeef3c372 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:55:22 user nova-compute[72773]: WARNING nova.compute.manager [req-d51fefa1-9c7c-4b17-b8bb-e07821ecd62b req-3769e28d-d346-4487-8891-94ef28461804 service nova] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Received unexpected event network-vif-plugged-e184f66d-572d-452b-8675-006aeef3c372 for instance with vm_state deleted and task_state None.
Aug 16 22:55:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c7a1aedf-7fad-4742-8aa8-3d38db888a45 tempest-SnapshotDataIntegrityTests-760317901 tempest-SnapshotDataIntegrityTests-760317901-project-member] Lock "29c612f4-5ed1-46db-bdec-0eed58384746" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.550s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:55:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:31 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692226516.9003582, f97d8a95-e281-496b-bb62-81747a5c2ffc => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:55:31 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] VM Stopped (Lifecycle Event)
Aug 16 22:55:31 user nova-compute[72773]: DEBUG nova.compute.manager [None req-9a3df962-e550-47d5-9162-686121183028 None None] [instance: f97d8a95-e281-496b-bb62-81747a5c2ffc] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:55:35 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692226520.7289228, 29c612f4-5ed1-46db-bdec-0eed58384746 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:55:35 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] VM Stopped (Lifecycle Event)
Aug 16 22:55:35 user nova-compute[72773]: DEBUG nova.compute.manager [None req-d4b58a64-74f8-4f99-8d5c-c739cf9e2f23 None None] [instance: 29c612f4-5ed1-46db-bdec-0eed58384746] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:55:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:55:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 22:55:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:55:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:55:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:36 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:55:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:03 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:56:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "efe5f821-78a9-46f4-8e88-ca3aa05f5645" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:56:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "efe5f821-78a9-46f4-8e88-ca3aa05f5645" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:56:04 user nova-compute[72773]: DEBUG nova.compute.manager [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:56:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:56:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:56:04 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:56:04 user nova-compute[72773]: INFO nova.compute.claims [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Claim successful on node user
Aug 16 22:56:05 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:56:05 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:56:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.195s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:56:05 user nova-compute[72773]: DEBUG nova.compute.manager [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:56:05 user nova-compute[72773]: DEBUG nova.compute.manager [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:56:05 user nova-compute[72773]: DEBUG nova.network.neutron [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:56:05 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:56:05 user nova-compute[72773]: DEBUG nova.compute.manager [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:56:05 user nova-compute[72773]: INFO nova.virt.block_device [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Booting with volume snapshot d68072ba-f9e5-45b8-84a3-2c1c6500ab08 at /dev/vda
Aug 16 22:56:05 user nova-compute[72773]: DEBUG nova.policy [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f12eb2e28904f63baa1ddce4641e180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cd967e4254cfd9b8aee140f640682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:56:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:06 user nova-compute[72773]: DEBUG nova.network.neutron [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Successfully created port: 38596b2b-30af-42b9-91f1-4e1f93a5fb7d {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:56:06 user nova-compute[72773]: DEBUG nova.network.neutron [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Successfully updated port: 38596b2b-30af-42b9-91f1-4e1f93a5fb7d {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:56:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "refresh_cache-efe5f821-78a9-46f4-8e88-ca3aa05f5645" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:56:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquired lock "refresh_cache-efe5f821-78a9-46f4-8e88-ca3aa05f5645" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:56:06 user nova-compute[72773]: DEBUG nova.network.neutron [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:56:07 user nova-compute[72773]: DEBUG nova.compute.manager [req-a7a10faa-f07e-4b0d-a7e0-f1365025962b req-3eeef261-bf59-4ebb-b1f8-325be0b1480d service nova] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Received event network-changed-38596b2b-30af-42b9-91f1-4e1f93a5fb7d {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:56:07 user nova-compute[72773]: DEBUG nova.compute.manager [req-a7a10faa-f07e-4b0d-a7e0-f1365025962b req-3eeef261-bf59-4ebb-b1f8-325be0b1480d service nova] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Refreshing instance network info cache due to event network-changed-38596b2b-30af-42b9-91f1-4e1f93a5fb7d. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:56:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a7a10faa-f07e-4b0d-a7e0-f1365025962b req-3eeef261-bf59-4ebb-b1f8-325be0b1480d service nova] Acquiring lock "refresh_cache-efe5f821-78a9-46f4-8e88-ca3aa05f5645" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:56:07 user nova-compute[72773]: DEBUG nova.network.neutron [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:56:07 user nova-compute[72773]: DEBUG nova.network.neutron [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Updating instance_info_cache with network_info: [{"id": "38596b2b-30af-42b9-91f1-4e1f93a5fb7d", "address": "fa:16:3e:e1:f5:af", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38596b2b-30", "ovs_interfaceid": "38596b2b-30af-42b9-91f1-4e1f93a5fb7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:56:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Releasing lock "refresh_cache-efe5f821-78a9-46f4-8e88-ca3aa05f5645" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:56:07 user nova-compute[72773]: DEBUG nova.compute.manager [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Instance network_info: |[{"id": "38596b2b-30af-42b9-91f1-4e1f93a5fb7d", "address": "fa:16:3e:e1:f5:af", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38596b2b-30", "ovs_interfaceid": "38596b2b-30af-42b9-91f1-4e1f93a5fb7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:56:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a7a10faa-f07e-4b0d-a7e0-f1365025962b req-3eeef261-bf59-4ebb-b1f8-325be0b1480d service nova] Acquired lock "refresh_cache-efe5f821-78a9-46f4-8e88-ca3aa05f5645" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:56:07 user nova-compute[72773]: DEBUG nova.network.neutron [req-a7a10faa-f07e-4b0d-a7e0-f1365025962b req-3eeef261-bf59-4ebb-b1f8-325be0b1480d service nova] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Refreshing network info cache for port 38596b2b-30af-42b9-91f1-4e1f93a5fb7d {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:56:08 user nova-compute[72773]: DEBUG nova.network.neutron [req-a7a10faa-f07e-4b0d-a7e0-f1365025962b req-3eeef261-bf59-4ebb-b1f8-325be0b1480d service nova] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Updated VIF entry in instance network info cache for port 38596b2b-30af-42b9-91f1-4e1f93a5fb7d. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:56:08 user nova-compute[72773]: DEBUG nova.network.neutron [req-a7a10faa-f07e-4b0d-a7e0-f1365025962b req-3eeef261-bf59-4ebb-b1f8-325be0b1480d service nova] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Updating instance_info_cache with network_info: [{"id": "38596b2b-30af-42b9-91f1-4e1f93a5fb7d", "address": "fa:16:3e:e1:f5:af", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38596b2b-30", "ovs_interfaceid": "38596b2b-30af-42b9-91f1-4e1f93a5fb7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:56:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a7a10faa-f07e-4b0d-a7e0-f1365025962b req-3eeef261-bf59-4ebb-b1f8-325be0b1480d service nova] Releasing lock "refresh_cache-efe5f821-78a9-46f4-8e88-ca3aa05f5645" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:56:09 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:56:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:56:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:56:10 user nova-compute[72773]: DEBUG nova.compute.manager [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:56:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:56:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:56:10 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:56:10 user nova-compute[72773]: INFO nova.compute.claims [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Claim successful on node user
Aug 16 22:56:10 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:56:10 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:56:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.240s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:56:10 user nova-compute[72773]: DEBUG nova.compute.manager [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:56:10 user nova-compute[72773]: DEBUG nova.compute.manager [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:56:10 user nova-compute[72773]: DEBUG nova.network.neutron [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:56:10 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:56:10 user nova-compute[72773]: DEBUG nova.compute.manager [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:56:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:56:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:10 user nova-compute[72773]: DEBUG nova.policy [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7b76435f64e47169f3ca08aebb8e766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da6170d60c4d41b14c342700a5dd83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:56:10 user nova-compute[72773]: DEBUG nova.compute.manager [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:56:10 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:56:10 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Creating image(s)
Aug 16 22:56:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "/opt/stack/data/nova/instances/11552ea0-97b9-48ce-b384-6af3e29cc6e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:56:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "/opt/stack/data/nova/instances/11552ea0-97b9-48ce-b384-6af3e29cc6e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:56:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "/opt/stack/data/nova/instances/11552ea0-97b9-48ce-b384-6af3e29cc6e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:56:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG os_brick.utils [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.201s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[af024f88-23a4-4c1f-b6ec-2d3171574f4b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d76169-9bb8-4a0c-8b10-bb0ef8e46086]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb08d0ba-135e-4dc4-9af7-494b8b4b5835]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e042f191-9f28-4640-bd17-056054150679]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:56:11 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:56:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0c7565-7d46-4d16-89be-46d98ed5f761]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG os_brick.utils [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Updating existing volume attachment record: 146da1a6-5087-43de-864d-52a65ab29ea2 {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.213s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/11552ea0-97b9-48ce-b384-6af3e29cc6e6/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/11552ea0-97b9-48ce-b384-6af3e29cc6e6/disk 1073741824" returned: 0 in 0.052s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Didn't find any instances for network info cache update. {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.189s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11552ea0-97b9-48ce-b384-6af3e29cc6e6/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11552ea0-97b9-48ce-b384-6af3e29cc6e6/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11552ea0-97b9-48ce-b384-6af3e29cc6e6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Cannot resize image /opt/stack/data/nova/instances/11552ea0-97b9-48ce-b384-6af3e29cc6e6/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG nova.objects.instance [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lazy-loading 'migration_context' on Instance uuid 11552ea0-97b9-48ce-b384-6af3e29cc6e6 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Ensure instance console log exists: /opt/stack/data/nova/instances/11552ea0-97b9-48ce-b384-6af3e29cc6e6/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:56:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:56:12 user nova-compute[72773]: DEBUG nova.network.neutron [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Successfully created port: 029f188c-955a-42ef-9d93-39ac195f9000 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:56:13 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG nova.network.neutron [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Successfully updated port: 029f188c-955a-42ef-9d93-39ac195f9000 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "refresh_cache-11552ea0-97b9-48ce-b384-6af3e29cc6e6" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquired lock "refresh_cache-11552ea0-97b9-48ce-b384-6af3e29cc6e6" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG nova.network.neutron [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG nova.compute.manager [req-2a815b58-638c-4640-a708-5318972460b0 req-9e80a996-3901-442a-898b-897d69ac229f service nova] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Received event network-changed-029f188c-955a-42ef-9d93-39ac195f9000 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG nova.compute.manager [req-2a815b58-638c-4640-a708-5318972460b0 req-9e80a996-3901-442a-898b-897d69ac229f service nova] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Refreshing instance network info cache due to event network-changed-029f188c-955a-42ef-9d93-39ac195f9000. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2a815b58-638c-4640-a708-5318972460b0 req-9e80a996-3901-442a-898b-897d69ac229f service nova] Acquiring lock "refresh_cache-11552ea0-97b9-48ce-b384-6af3e29cc6e6" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG nova.network.neutron [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG nova.network.neutron [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Updating instance_info_cache with network_info: [{"id": "029f188c-955a-42ef-9d93-39ac195f9000", "address": "fa:16:3e:bd:8d:bc", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap029f188c-95", "ovs_interfaceid": "029f188c-955a-42ef-9d93-39ac195f9000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Releasing lock "refresh_cache-11552ea0-97b9-48ce-b384-6af3e29cc6e6" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Instance network_info: |[{"id": "029f188c-955a-42ef-9d93-39ac195f9000", "address": "fa:16:3e:bd:8d:bc", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap029f188c-95", "ovs_interfaceid": "029f188c-955a-42ef-9d93-39ac195f9000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2a815b58-638c-4640-a708-5318972460b0 req-9e80a996-3901-442a-898b-897d69ac229f service nova] Acquired lock "refresh_cache-11552ea0-97b9-48ce-b384-6af3e29cc6e6" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG nova.network.neutron [req-2a815b58-638c-4640-a708-5318972460b0 req-9e80a996-3901-442a-898b-897d69ac229f service nova] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Refreshing network info cache for port 029f188c-955a-42ef-9d93-39ac195f9000 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Start _get_guest_xml network_info=[{"id": "029f188c-955a-42ef-9d93-39ac195f9000", "address": "fa:16:3e:bd:8d:bc", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap029f188c-95", "ovs_interfaceid": "029f188c-955a-42ef-9d93-39ac195f9000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:56:14 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:56:14 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:56:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:56:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-477883364',display_name='tempest-AttachVolumeTestJSON-server-477883364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-477883364',id=45,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSzA2K9VwiYCWokHpru2VxEfDbvCooqM54AiAcZAVkr+649JrLxo35Fb8NpUtA1fNBBY0beBtfDg1/1Vv3zYA02y3nTZS/5JaupzqmCd1VwKfuKUdbXUDL6M9YWdgsIvA==',key_name='tempest-keypair-1884694588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6da6170d60c4d41b14c342700a5dd83',ramdisk_id='',reservation_id='r-2r9p7pnp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-317922803',owner_user_name='tempest-AttachVolumeTestJSON-317922803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:56:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7b76435f64e47169f3ca08aebb8e766',uuid=11552ea0-97b9-48ce-b384-6af3e29cc6e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "029f188c-955a-42ef-9d93-39ac195f9000", "address": "fa:16:3e:bd:8d:bc", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap029f188c-95", "ovs_interfaceid": "029f188c-955a-42ef-9d93-39ac195f9000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Converting VIF {"id": "029f188c-955a-42ef-9d93-39ac195f9000", "address": "fa:16:3e:bd:8d:bc", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap029f188c-95", "ovs_interfaceid": "029f188c-955a-42ef-9d93-39ac195f9000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:8d:bc,bridge_name='br-int',has_traffic_filtering=True,id=029f188c-955a-42ef-9d93-39ac195f9000,network=Network(3348a6ff-bdcc-49e3-bb0a-4839999ec213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap029f188c-95') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG nova.objects.instance [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lazy-loading 'pci_devices' on Instance uuid 11552ea0-97b9-48ce-b384-6af3e29cc6e6 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:56:14 user nova-compute[72773]:   <uuid>11552ea0-97b9-48ce-b384-6af3e29cc6e6</uuid>
Aug 16 22:56:14 user nova-compute[72773]:   <name>instance-0000002d</name>
Aug 16 22:56:14 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:56:14 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:56:14 user nova-compute[72773]:   <metadata>
Aug 16 22:56:14 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:56:14 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:56:14 user nova-compute[72773]:       <nova:name>tempest-AttachVolumeTestJSON-server-477883364</nova:name>
Aug 16 22:56:14 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:56:14</nova:creationTime>
Aug 16 22:56:14 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:56:14 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:56:14 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:56:14 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:56:14 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:56:14 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:56:14 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:56:14 user nova-compute[72773]:       <nova:owner>
Aug 16 22:56:14 user nova-compute[72773]:         <nova:user uuid="e7b76435f64e47169f3ca08aebb8e766">tempest-AttachVolumeTestJSON-317922803-project-member</nova:user>
Aug 16 22:56:14 user nova-compute[72773]:         <nova:project uuid="a6da6170d60c4d41b14c342700a5dd83">tempest-AttachVolumeTestJSON-317922803</nova:project>
Aug 16 22:56:14 user nova-compute[72773]:       </nova:owner>
Aug 16 22:56:14 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 22:56:14 user nova-compute[72773]:       <nova:ports>
Aug 16 22:56:14 user nova-compute[72773]:         <nova:port uuid="029f188c-955a-42ef-9d93-39ac195f9000">
Aug 16 22:56:14 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 22:56:14 user nova-compute[72773]:         </nova:port>
Aug 16 22:56:14 user nova-compute[72773]:       </nova:ports>
Aug 16 22:56:14 user nova-compute[72773]:     </nova:instance>
Aug 16 22:56:14 user nova-compute[72773]:   </metadata>
Aug 16 22:56:14 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:56:14 user nova-compute[72773]:     <system>
Aug 16 22:56:14 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:56:14 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:56:14 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:56:14 user nova-compute[72773]:       <entry name="serial">11552ea0-97b9-48ce-b384-6af3e29cc6e6</entry>
Aug 16 22:56:14 user nova-compute[72773]:       <entry name="uuid">11552ea0-97b9-48ce-b384-6af3e29cc6e6</entry>
Aug 16 22:56:14 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:56:14 user nova-compute[72773]:     </system>
Aug 16 22:56:14 user nova-compute[72773]:   </sysinfo>
Aug 16 22:56:14 user nova-compute[72773]:   <os>
Aug 16 22:56:14 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:56:14 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:56:14 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:56:14 user nova-compute[72773]:   </os>
Aug 16 22:56:14 user nova-compute[72773]:   <features>
Aug 16 22:56:14 user nova-compute[72773]:     <acpi/>
Aug 16 22:56:14 user nova-compute[72773]:     <apic/>
Aug 16 22:56:14 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:56:14 user nova-compute[72773]:   </features>
Aug 16 22:56:14 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:56:14 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:56:14 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:56:14 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:56:14 user nova-compute[72773]:   </clock>
Aug 16 22:56:14 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:56:14 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:56:14 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:56:14 user nova-compute[72773]:   </cpu>
Aug 16 22:56:14 user nova-compute[72773]:   <devices>
Aug 16 22:56:14 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:56:14 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:56:14 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/11552ea0-97b9-48ce-b384-6af3e29cc6e6/disk"/>
Aug 16 22:56:14 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:56:14 user nova-compute[72773]:     </disk>
Aug 16 22:56:14 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:56:14 user nova-compute[72773]:       <mac address="fa:16:3e:bd:8d:bc"/>
Aug 16 22:56:14 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:56:14 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:56:14 user nova-compute[72773]:       <target dev="tap029f188c-95"/>
Aug 16 22:56:14 user nova-compute[72773]:     </interface>
Aug 16 22:56:14 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:56:14 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/11552ea0-97b9-48ce-b384-6af3e29cc6e6/console.log" append="off"/>
Aug 16 22:56:14 user nova-compute[72773]:     </serial>
Aug 16 22:56:14 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:56:14 user nova-compute[72773]:     <video>
Aug 16 22:56:14 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:56:14 user nova-compute[72773]:     </video>
Aug 16 22:56:14 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:56:14 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:56:14 user nova-compute[72773]:     </rng>
Aug 16 22:56:14 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:56:14 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:56:14 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:56:14 user nova-compute[72773]:     </memballoon>
Aug 16 22:56:14 user nova-compute[72773]:   </devices>
Aug 16 22:56:14 user nova-compute[72773]: </domain>
Aug 16 22:56:14 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:56:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-477883364',display_name='tempest-AttachVolumeTestJSON-server-477883364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-477883364',id=45,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSzA2K9VwiYCWokHpru2VxEfDbvCooqM54AiAcZAVkr+649JrLxo35Fb8NpUtA1fNBBY0beBtfDg1/1Vv3zYA02y3nTZS/5JaupzqmCd1VwKfuKUdbXUDL6M9YWdgsIvA==',key_name='tempest-keypair-1884694588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6da6170d60c4d41b14c342700a5dd83',ramdisk_id='',reservation_id='r-2r9p7pnp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-317922803',owner_user_name='tempest-AttachVolumeTestJSON-317922803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:56:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7b76435f64e47169f3ca08aebb8e766',uuid=11552ea0-97b9-48ce-b384-6af3e29cc6e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "029f188c-955a-42ef-9d93-39ac195f9000", "address": "fa:16:3e:bd:8d:bc", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap029f188c-95", "ovs_interfaceid": "029f188c-955a-42ef-9d93-39ac195f9000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Converting VIF {"id": "029f188c-955a-42ef-9d93-39ac195f9000", "address": "fa:16:3e:bd:8d:bc", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap029f188c-95", "ovs_interfaceid": "029f188c-955a-42ef-9d93-39ac195f9000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:8d:bc,bridge_name='br-int',has_traffic_filtering=True,id=029f188c-955a-42ef-9d93-39ac195f9000,network=Network(3348a6ff-bdcc-49e3-bb0a-4839999ec213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap029f188c-95') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG os_vif [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:8d:bc,bridge_name='br-int',has_traffic_filtering=True,id=029f188c-955a-42ef-9d93-39ac195f9000,network=Network(3348a6ff-bdcc-49e3-bb0a-4839999ec213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap029f188c-95') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap029f188c-95, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap029f188c-95, col_values=(('external_ids', {'iface-id': '029f188c-955a-42ef-9d93-39ac195f9000', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:8d:bc', 'vm-uuid': '11552ea0-97b9-48ce-b384-6af3e29cc6e6'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:14 user nova-compute[72773]: INFO os_vif [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:8d:bc,bridge_name='br-int',has_traffic_filtering=True,id=029f188c-955a-42ef-9d93-39ac195f9000,network=Network(3348a6ff-bdcc-49e3-bb0a-4839999ec213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap029f188c-95')
Aug 16 22:56:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:56:14 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] No VIF found with MAC fa:16:3e:bd:8d:bc, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:56:15 user nova-compute[72773]: DEBUG nova.network.neutron [req-2a815b58-638c-4640-a708-5318972460b0 req-9e80a996-3901-442a-898b-897d69ac229f service nova] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Updated VIF entry in instance network info cache for port 029f188c-955a-42ef-9d93-39ac195f9000. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:56:15 user nova-compute[72773]: DEBUG nova.network.neutron [req-2a815b58-638c-4640-a708-5318972460b0 req-9e80a996-3901-442a-898b-897d69ac229f service nova] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Updating instance_info_cache with network_info: [{"id": "029f188c-955a-42ef-9d93-39ac195f9000", "address": "fa:16:3e:bd:8d:bc", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap029f188c-95", "ovs_interfaceid": "029f188c-955a-42ef-9d93-39ac195f9000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:56:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2a815b58-638c-4640-a708-5318972460b0 req-9e80a996-3901-442a-898b-897d69ac229f service nova] Releasing lock "refresh_cache-11552ea0-97b9-48ce-b384-6af3e29cc6e6" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:56:15 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:56:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:56:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:56:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:56:15 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:56:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:16 user nova-compute[72773]: DEBUG nova.compute.manager [req-8634d18d-64a6-450a-bd19-e76dfab7879d req-7018aac2-5205-4f51-9074-66b4aefbc8a6 service nova] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Received event network-vif-plugged-029f188c-955a-42ef-9d93-39ac195f9000 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:56:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-8634d18d-64a6-450a-bd19-e76dfab7879d req-7018aac2-5205-4f51-9074-66b4aefbc8a6 service nova] Acquiring lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:56:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-8634d18d-64a6-450a-bd19-e76dfab7879d req-7018aac2-5205-4f51-9074-66b4aefbc8a6 service nova] Lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:56:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-8634d18d-64a6-450a-bd19-e76dfab7879d req-7018aac2-5205-4f51-9074-66b4aefbc8a6 service nova] Lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:56:16 user nova-compute[72773]: DEBUG nova.compute.manager [req-8634d18d-64a6-450a-bd19-e76dfab7879d req-7018aac2-5205-4f51-9074-66b4aefbc8a6 service nova] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] No waiting events found dispatching network-vif-plugged-029f188c-955a-42ef-9d93-39ac195f9000 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:56:16 user nova-compute[72773]: WARNING nova.compute.manager [req-8634d18d-64a6-450a-bd19-e76dfab7879d req-7018aac2-5205-4f51-9074-66b4aefbc8a6 service nova] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Received unexpected event network-vif-plugged-029f188c-955a-42ef-9d93-39ac195f9000 for instance with vm_state building and task_state spawning.
Aug 16 22:56:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11552ea0-97b9-48ce-b384-6af3e29cc6e6/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:56:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11552ea0-97b9-48ce-b384-6af3e29cc6e6/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:56:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11552ea0-97b9-48ce-b384-6af3e29cc6e6/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:56:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11552ea0-97b9-48ce-b384-6af3e29cc6e6/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:56:17 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:56:17 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:56:17 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=8784MB free_disk=25.50701141357422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:56:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:56:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:56:18 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance efe5f821-78a9-46f4-8e88-ca3aa05f5645 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:56:18 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 11552ea0-97b9-48ce-b384-6af3e29cc6e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:56:18 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:56:18 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:56:18 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Refreshing inventories for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 22:56:18 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Updating ProviderTree inventory for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 22:56:18 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Updating inventory in ProviderTree for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 22:56:18 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Refreshing aggregate associations for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e, aggregates: None {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 22:56:18 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Refreshing trait associations for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 22:56:18 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:56:18 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:56:18 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:56:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.527s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:56:18 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692226578.637731, 11552ea0-97b9-48ce-b384-6af3e29cc6e6 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:56:18 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] VM Resumed (Lifecycle Event)
Aug 16 22:56:18 user nova-compute[72773]: DEBUG nova.compute.manager [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:56:18 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:56:18 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Instance spawned successfully.
Aug 16 22:56:18 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:56:18 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:56:18 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:56:18 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:56:18 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:56:18 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:56:18 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:56:18 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:56:18 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:56:18 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:56:18 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692226578.6416345, 11552ea0-97b9-48ce-b384-6af3e29cc6e6 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:56:18 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] VM Started (Lifecycle Event)
Aug 16 22:56:18 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:56:18 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:56:18 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:56:18 user nova-compute[72773]: INFO nova.compute.manager [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Took 7.93 seconds to spawn the instance on the hypervisor.
Aug 16 22:56:18 user nova-compute[72773]: DEBUG nova.compute.manager [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:56:18 user nova-compute[72773]: DEBUG nova.compute.manager [req-65175341-4097-45f0-ad31-5e95baadb0a2 req-68189969-1ce3-47b5-bd53-402a198b2ef5 service nova] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Received event network-vif-plugged-029f188c-955a-42ef-9d93-39ac195f9000 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:56:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-65175341-4097-45f0-ad31-5e95baadb0a2 req-68189969-1ce3-47b5-bd53-402a198b2ef5 service nova] Acquiring lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:56:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-65175341-4097-45f0-ad31-5e95baadb0a2 req-68189969-1ce3-47b5-bd53-402a198b2ef5 service nova] Lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:56:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-65175341-4097-45f0-ad31-5e95baadb0a2 req-68189969-1ce3-47b5-bd53-402a198b2ef5 service nova] Lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:56:18 user nova-compute[72773]: DEBUG nova.compute.manager [req-65175341-4097-45f0-ad31-5e95baadb0a2 req-68189969-1ce3-47b5-bd53-402a198b2ef5 service nova] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] No waiting events found dispatching network-vif-plugged-029f188c-955a-42ef-9d93-39ac195f9000 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:56:18 user nova-compute[72773]: WARNING nova.compute.manager [req-65175341-4097-45f0-ad31-5e95baadb0a2 req-68189969-1ce3-47b5-bd53-402a198b2ef5 service nova] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Received unexpected event network-vif-plugged-029f188c-955a-42ef-9d93-39ac195f9000 for instance with vm_state building and task_state spawning.
Aug 16 22:56:18 user nova-compute[72773]: INFO nova.compute.manager [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Took 8.55 seconds to build instance.
Aug 16 22:56:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-314b6a0a-af79-440c-9323-4f321dded85a tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.658s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:56:19 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:56:19 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:56:19 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:56:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:20 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:56:20 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Cleaning up deleted instances with incomplete migration  {{(pid=72773) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 22:56:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:21 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:56:22 user nova-compute[72773]: DEBUG nova.compute.manager [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:56:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:56:22 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Creating image(s)
Aug 16 22:56:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Did not create local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 22:56:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Ensure instance console log exists: /opt/stack/data/nova/instances/efe5f821-78a9-46f4-8e88-ca3aa05f5645/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:56:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:56:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:56:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:56:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Start _get_guest_xml network_info=[{"id": "38596b2b-30af-42b9-91f1-4e1f93a5fb7d", "address": "fa:16:3e:e1:f5:af", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38596b2b-30", "ovs_interfaceid": "38596b2b-30af-42b9-91f1-4e1f93a5fb7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '146da1a6-5087-43de-864d-52a65ab29ea2', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idrCyUct', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'efe5f821-78a9-46f4-8e88-ca3aa05f5645', 'attached_at': '', 'detached_at': '', 'volume_id': '40727847-b65c-425e-9e1e-c1f189756f52', 'serial': '40727847-b65c-425e-9e1e-c1f189756f52'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:56:22 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:56:22 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:56:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:56:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:56:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:56:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:56:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:56:22 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:56:22 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:56:22 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:56:22 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:56:22 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:56:22 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:56:22 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:56:22 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:56:22 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:56:22 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:56:22 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:56:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:56:22 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idrCyUct', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:56:22 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:56:22 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:56:22 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:56:22 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:56:22 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:56:22 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:56:22 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:56:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:56:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:56:22 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4e6ae8-2046-4057-b9fd-afa9ad4c81b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:56:22 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:56:22 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:56:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:56:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:56:22 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[719bcb51-7cfe-433a-a033-93f39f7b7258]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:56:22 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52] added
Aug 16 22:56:22 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:56:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[64872ea6-ded5-429d-8612-67233b791bcf]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5cb157-c280-4ff8-8de3-f4b33f91deb4]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v idrCyUct {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v idrCyUct" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ea9606-4aa0-445b-9a8b-72dc12a432a0]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'idrCyUct'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[03457ef0-d012-42ae-b4a0-c26eb282cc76]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3156235a-c9da-4a53-9ce3-987a63e4d645]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 22:56:23 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 22:56:23 user nova-compute[72773]:  {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:56:23 user nova-compute[72773]: WARNING os_brick.initiator.connectors.iscsi [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 22:56:23 user nova-compute[72773]: 
Aug 16 22:56:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a354351-398a-4547-97e8-2b9994b4417e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52, portal: 172.16.0.220,3260]
Aug 16 22:56:23 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52, portal: 172.16.0.220,3260] successful.
Aug 16 22:56:23 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[36caa77c-0fb6-493b-8f70-229c83052e10]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cf52f9-e602-4543-b051-0032ea93e8a6]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52 (non-flash)
Aug 16 22:56:23 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52 (non-flash)
Aug 16 22:56:23 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[53172874-5c95-4e7b-9607-66b60369aa9c]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:56:23 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idrCyUct', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:56:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:56:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23234393562343361', 'path': '/dev/sdb'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:56:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234393562343361', 'path': '/dev/sdb'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:56:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:56:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-391613629',display_name='tempest-TestVolumeBootPattern-server-391613629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-391613629',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a51cd967e4254cfd9b8aee140f640682',ramdisk_id='',reservation_id='r-lk0g1vvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1862722655',owner_user_name='tempest-TestVolumeBootPattern-1862722655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:56:05Z,user_data=None,user_id='3f12eb2e28904f63baa1ddce4641e180',uuid=efe5f821-78a9-46f4-8e88-ca3aa05f5645,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38596b2b-30af-42b9-91f1-4e1f93a5fb7d", "address": "fa:16:3e:e1:f5:af", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38596b2b-30", "ovs_interfaceid": "38596b2b-30af-42b9-91f1-4e1f93a5fb7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:56:24 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converting VIF {"id": "38596b2b-30af-42b9-91f1-4e1f93a5fb7d", "address": "fa:16:3e:e1:f5:af", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38596b2b-30", "ovs_interfaceid": "38596b2b-30af-42b9-91f1-4e1f93a5fb7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:56:24 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:f5:af,bridge_name='br-int',has_traffic_filtering=True,id=38596b2b-30af-42b9-91f1-4e1f93a5fb7d,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38596b2b-30') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:56:24 user nova-compute[72773]: DEBUG nova.objects.instance [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lazy-loading 'pci_devices' on Instance uuid efe5f821-78a9-46f4-8e88-ca3aa05f5645 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:56:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:56:24 user nova-compute[72773]:   <uuid>efe5f821-78a9-46f4-8e88-ca3aa05f5645</uuid>
Aug 16 22:56:24 user nova-compute[72773]:   <name>instance-0000002c</name>
Aug 16 22:56:24 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:56:24 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:56:24 user nova-compute[72773]:   <metadata>
Aug 16 22:56:24 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:56:24 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:56:24 user nova-compute[72773]:       <nova:name>tempest-TestVolumeBootPattern-server-391613629</nova:name>
Aug 16 22:56:24 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:56:22</nova:creationTime>
Aug 16 22:56:24 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:56:24 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:56:24 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:56:24 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:56:24 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:56:24 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:56:24 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:56:24 user nova-compute[72773]:       <nova:owner>
Aug 16 22:56:24 user nova-compute[72773]:         <nova:user uuid="3f12eb2e28904f63baa1ddce4641e180">tempest-TestVolumeBootPattern-1862722655-project-member</nova:user>
Aug 16 22:56:24 user nova-compute[72773]:         <nova:project uuid="a51cd967e4254cfd9b8aee140f640682">tempest-TestVolumeBootPattern-1862722655</nova:project>
Aug 16 22:56:24 user nova-compute[72773]:       </nova:owner>
Aug 16 22:56:24 user nova-compute[72773]:       <nova:ports>
Aug 16 22:56:24 user nova-compute[72773]:         <nova:port uuid="38596b2b-30af-42b9-91f1-4e1f93a5fb7d">
Aug 16 22:56:24 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 22:56:24 user nova-compute[72773]:         </nova:port>
Aug 16 22:56:24 user nova-compute[72773]:       </nova:ports>
Aug 16 22:56:24 user nova-compute[72773]:     </nova:instance>
Aug 16 22:56:24 user nova-compute[72773]:   </metadata>
Aug 16 22:56:24 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:56:24 user nova-compute[72773]:     <system>
Aug 16 22:56:24 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:56:24 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:56:24 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:56:24 user nova-compute[72773]:       <entry name="serial">efe5f821-78a9-46f4-8e88-ca3aa05f5645</entry>
Aug 16 22:56:24 user nova-compute[72773]:       <entry name="uuid">efe5f821-78a9-46f4-8e88-ca3aa05f5645</entry>
Aug 16 22:56:24 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:56:24 user nova-compute[72773]:     </system>
Aug 16 22:56:24 user nova-compute[72773]:   </sysinfo>
Aug 16 22:56:24 user nova-compute[72773]:   <os>
Aug 16 22:56:24 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:56:24 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:56:24 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:56:24 user nova-compute[72773]:   </os>
Aug 16 22:56:24 user nova-compute[72773]:   <features>
Aug 16 22:56:24 user nova-compute[72773]:     <acpi/>
Aug 16 22:56:24 user nova-compute[72773]:     <apic/>
Aug 16 22:56:24 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:56:24 user nova-compute[72773]:   </features>
Aug 16 22:56:24 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:56:24 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:56:24 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:56:24 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:56:24 user nova-compute[72773]:   </clock>
Aug 16 22:56:24 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:56:24 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:56:24 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:56:24 user nova-compute[72773]:   </cpu>
Aug 16 22:56:24 user nova-compute[72773]:   <devices>
Aug 16 22:56:24 user nova-compute[72773]:     <disk type="block" device="disk">
Aug 16 22:56:24 user nova-compute[72773]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:56:24 user nova-compute[72773]:       <source dev="/dev/sdb"/>
Aug 16 22:56:24 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:56:24 user nova-compute[72773]:       <serial>40727847-b65c-425e-9e1e-c1f189756f52</serial>
Aug 16 22:56:24 user nova-compute[72773]:     </disk>
Aug 16 22:56:24 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:56:24 user nova-compute[72773]:       <mac address="fa:16:3e:e1:f5:af"/>
Aug 16 22:56:24 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:56:24 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:56:24 user nova-compute[72773]:       <target dev="tap38596b2b-30"/>
Aug 16 22:56:24 user nova-compute[72773]:     </interface>
Aug 16 22:56:24 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:56:24 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/efe5f821-78a9-46f4-8e88-ca3aa05f5645/console.log" append="off"/>
Aug 16 22:56:24 user nova-compute[72773]:     </serial>
Aug 16 22:56:24 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:56:24 user nova-compute[72773]:     <video>
Aug 16 22:56:24 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:56:24 user nova-compute[72773]:     </video>
Aug 16 22:56:24 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:56:24 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:56:24 user nova-compute[72773]:     </rng>
Aug 16 22:56:24 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:56:24 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:56:24 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:56:24 user nova-compute[72773]:     </memballoon>
Aug 16 22:56:24 user nova-compute[72773]:   </devices>
Aug 16 22:56:24 user nova-compute[72773]: </domain>
Aug 16 22:56:24 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:56:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:56:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-391613629',display_name='tempest-TestVolumeBootPattern-server-391613629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-391613629',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a51cd967e4254cfd9b8aee140f640682',ramdisk_id='',reservation_id='r-lk0g1vvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1862722655',owner_user_name='tempest-TestVolumeBootPattern-1862722655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:56:05Z,user_data=None,user_id='3f12eb2e28904f63baa1ddce4641e180',uuid=efe5f821-78a9-46f4-8e88-ca3aa05f5645,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38596b2b-30af-42b9-91f1-4e1f93a5fb7d", "address": "fa:16:3e:e1:f5:af", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38596b2b-30", "ovs_interfaceid": "38596b2b-30af-42b9-91f1-4e1f93a5fb7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:56:24 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converting VIF {"id": "38596b2b-30af-42b9-91f1-4e1f93a5fb7d", "address": "fa:16:3e:e1:f5:af", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38596b2b-30", "ovs_interfaceid": "38596b2b-30af-42b9-91f1-4e1f93a5fb7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:56:24 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:f5:af,bridge_name='br-int',has_traffic_filtering=True,id=38596b2b-30af-42b9-91f1-4e1f93a5fb7d,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38596b2b-30') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:56:24 user nova-compute[72773]: DEBUG os_vif [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:f5:af,bridge_name='br-int',has_traffic_filtering=True,id=38596b2b-30af-42b9-91f1-4e1f93a5fb7d,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38596b2b-30') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:56:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:56:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:56:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38596b2b-30, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:56:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap38596b2b-30, col_values=(('external_ids', {'iface-id': '38596b2b-30af-42b9-91f1-4e1f93a5fb7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:f5:af', 'vm-uuid': 'efe5f821-78a9-46f4-8e88-ca3aa05f5645'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:56:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:56:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:24 user nova-compute[72773]: INFO os_vif [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:f5:af,bridge_name='br-int',has_traffic_filtering=True,id=38596b2b-30af-42b9-91f1-4e1f93a5fb7d,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38596b2b-30')
Aug 16 22:56:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:56:24 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] No VIF found with MAC fa:16:3e:e1:f5:af, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:56:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:25 user nova-compute[72773]: DEBUG nova.compute.manager [req-a592c9aa-bd45-4a4e-923e-a3d0d8019ef6 req-83ee5e05-9580-4923-a280-87f4e56262a2 service nova] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Received event network-vif-plugged-38596b2b-30af-42b9-91f1-4e1f93a5fb7d {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:56:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a592c9aa-bd45-4a4e-923e-a3d0d8019ef6 req-83ee5e05-9580-4923-a280-87f4e56262a2 service nova] Acquiring lock "efe5f821-78a9-46f4-8e88-ca3aa05f5645-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:56:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a592c9aa-bd45-4a4e-923e-a3d0d8019ef6 req-83ee5e05-9580-4923-a280-87f4e56262a2 service nova] Lock "efe5f821-78a9-46f4-8e88-ca3aa05f5645-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:56:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a592c9aa-bd45-4a4e-923e-a3d0d8019ef6 req-83ee5e05-9580-4923-a280-87f4e56262a2 service nova] Lock "efe5f821-78a9-46f4-8e88-ca3aa05f5645-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:56:25 user nova-compute[72773]: DEBUG nova.compute.manager [req-a592c9aa-bd45-4a4e-923e-a3d0d8019ef6 req-83ee5e05-9580-4923-a280-87f4e56262a2 service nova] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] No waiting events found dispatching network-vif-plugged-38596b2b-30af-42b9-91f1-4e1f93a5fb7d {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:56:25 user nova-compute[72773]: WARNING nova.compute.manager [req-a592c9aa-bd45-4a4e-923e-a3d0d8019ef6 req-83ee5e05-9580-4923-a280-87f4e56262a2 service nova] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Received unexpected event network-vif-plugged-38596b2b-30af-42b9-91f1-4e1f93a5fb7d for instance with vm_state building and task_state spawning.
Aug 16 22:56:26 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:56:26 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Cleaning up deleted instances {{(pid=72773) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 22:56:26 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] There are 0 instances to clean {{(pid=72773) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 22:56:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:28 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692226588.018979, efe5f821-78a9-46f4-8e88-ca3aa05f5645 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:56:28 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] VM Resumed (Lifecycle Event)
Aug 16 22:56:28 user nova-compute[72773]: DEBUG nova.compute.manager [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:56:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:56:28 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Instance spawned successfully.
Aug 16 22:56:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:56:28 user nova-compute[72773]: DEBUG nova.compute.manager [req-5c76414d-2da9-4cc9-9aad-c95e847603f6 req-828a1bd9-f5a8-4732-9582-99dae42e1c84 service nova] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Received event network-vif-plugged-38596b2b-30af-42b9-91f1-4e1f93a5fb7d {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:56:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5c76414d-2da9-4cc9-9aad-c95e847603f6 req-828a1bd9-f5a8-4732-9582-99dae42e1c84 service nova] Acquiring lock "efe5f821-78a9-46f4-8e88-ca3aa05f5645-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:56:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5c76414d-2da9-4cc9-9aad-c95e847603f6 req-828a1bd9-f5a8-4732-9582-99dae42e1c84 service nova] Lock "efe5f821-78a9-46f4-8e88-ca3aa05f5645-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:56:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5c76414d-2da9-4cc9-9aad-c95e847603f6 req-828a1bd9-f5a8-4732-9582-99dae42e1c84 service nova] Lock "efe5f821-78a9-46f4-8e88-ca3aa05f5645-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:56:28 user nova-compute[72773]: DEBUG nova.compute.manager [req-5c76414d-2da9-4cc9-9aad-c95e847603f6 req-828a1bd9-f5a8-4732-9582-99dae42e1c84 service nova] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] No waiting events found dispatching network-vif-plugged-38596b2b-30af-42b9-91f1-4e1f93a5fb7d {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:56:28 user nova-compute[72773]: WARNING nova.compute.manager [req-5c76414d-2da9-4cc9-9aad-c95e847603f6 req-828a1bd9-f5a8-4732-9582-99dae42e1c84 service nova] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Received unexpected event network-vif-plugged-38596b2b-30af-42b9-91f1-4e1f93a5fb7d for instance with vm_state building and task_state spawning.
Aug 16 22:56:28 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:56:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:56:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:56:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:56:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:56:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:56:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:56:28 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:56:28 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:56:28 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692226588.021922, efe5f821-78a9-46f4-8e88-ca3aa05f5645 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:56:28 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] VM Started (Lifecycle Event)
Aug 16 22:56:28 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:56:28 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:56:28 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:56:28 user nova-compute[72773]: INFO nova.compute.manager [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Took 5.32 seconds to spawn the instance on the hypervisor.
Aug 16 22:56:28 user nova-compute[72773]: DEBUG nova.compute.manager [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:56:28 user nova-compute[72773]: INFO nova.compute.manager [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Took 23.39 seconds to build instance.
Aug 16 22:56:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-78ecfd76-7f02-4dff-b700-16286d42d65a tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "efe5f821-78a9-46f4-8e88-ca3aa05f5645" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.489s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:56:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:54 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:56:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:57:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:57:03 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:57:04 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:57:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:57:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:57:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 22:57:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:57:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:57:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:57:09 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:57:11 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:57:11 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:57:13 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:57:13 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:57:13 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Rebuilding the list of instances to heal {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 22:57:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-efe5f821-78a9-46f4-8e88-ca3aa05f5645" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:57:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-efe5f821-78a9-46f4-8e88-ca3aa05f5645" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:57:13 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 22:57:13 user nova-compute[72773]: DEBUG nova.objects.instance [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lazy-loading 'info_cache' on Instance uuid efe5f821-78a9-46f4-8e88-ca3aa05f5645 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:57:13 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Updating instance_info_cache with network_info: [{"id": "38596b2b-30af-42b9-91f1-4e1f93a5fb7d", "address": "fa:16:3e:e1:f5:af", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38596b2b-30", "ovs_interfaceid": "38596b2b-30af-42b9-91f1-4e1f93a5fb7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:57:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-efe5f821-78a9-46f4-8e88-ca3aa05f5645" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:57:13 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 22:57:13 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:57:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:57:15 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:57:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:57:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:57:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:57:15 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:57:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 22:57:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11552ea0-97b9-48ce-b384-6af3e29cc6e6/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:57:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11552ea0-97b9-48ce-b384-6af3e29cc6e6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:57:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11552ea0-97b9-48ce-b384-6af3e29cc6e6/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:57:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11552ea0-97b9-48ce-b384-6af3e29cc6e6/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:57:16 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:57:16 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:57:16 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=8619MB free_disk=25.46780014038086GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:57:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:57:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:57:16 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance efe5f821-78a9-46f4-8e88-ca3aa05f5645 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:57:16 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 11552ea0-97b9-48ce-b384-6af3e29cc6e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:57:16 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:57:16 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:57:16 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:57:16 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:57:16 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:57:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:57:18 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:57:18 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:57:18 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:57:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:57:21 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:57:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:57:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:57:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:57:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:57:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:57:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 22:57:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:57:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:57:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:57:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:57:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:57:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:57:54 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:57:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "efe5f821-78a9-46f4-8e88-ca3aa05f5645" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:57:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "efe5f821-78a9-46f4-8e88-ca3aa05f5645" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:57:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "efe5f821-78a9-46f4-8e88-ca3aa05f5645-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:57:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "efe5f821-78a9-46f4-8e88-ca3aa05f5645-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:57:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "efe5f821-78a9-46f4-8e88-ca3aa05f5645-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:57:55 user nova-compute[72773]: INFO nova.compute.manager [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Terminating instance
Aug 16 22:57:55 user nova-compute[72773]: DEBUG nova.compute.manager [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:57:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:57:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:57:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:57:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG nova.compute.manager [req-6ff0aff8-b668-48d0-b9e1-1d7f8bd9db37 req-bb2741f5-f024-4a8a-a5ba-5e41e08f6149 service nova] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Received event network-vif-unplugged-38596b2b-30af-42b9-91f1-4e1f93a5fb7d {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6ff0aff8-b668-48d0-b9e1-1d7f8bd9db37 req-bb2741f5-f024-4a8a-a5ba-5e41e08f6149 service nova] Acquiring lock "efe5f821-78a9-46f4-8e88-ca3aa05f5645-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6ff0aff8-b668-48d0-b9e1-1d7f8bd9db37 req-bb2741f5-f024-4a8a-a5ba-5e41e08f6149 service nova] Lock "efe5f821-78a9-46f4-8e88-ca3aa05f5645-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6ff0aff8-b668-48d0-b9e1-1d7f8bd9db37 req-bb2741f5-f024-4a8a-a5ba-5e41e08f6149 service nova] Lock "efe5f821-78a9-46f4-8e88-ca3aa05f5645-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG nova.compute.manager [req-6ff0aff8-b668-48d0-b9e1-1d7f8bd9db37 req-bb2741f5-f024-4a8a-a5ba-5e41e08f6149 service nova] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] No waiting events found dispatching network-vif-unplugged-38596b2b-30af-42b9-91f1-4e1f93a5fb7d {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG nova.compute.manager [req-6ff0aff8-b668-48d0-b9e1-1d7f8bd9db37 req-bb2741f5-f024-4a8a-a5ba-5e41e08f6149 service nova] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Received event network-vif-unplugged-38596b2b-30af-42b9-91f1-4e1f93a5fb7d for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:57:56 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Instance destroyed successfully.
Aug 16 22:57:56 user nova-compute[72773]: DEBUG nova.objects.instance [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lazy-loading 'resources' on Instance uuid efe5f821-78a9-46f4-8e88-ca3aa05f5645 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:56:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-391613629',display_name='tempest-TestVolumeBootPattern-server-391613629',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-391613629',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:56:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a51cd967e4254cfd9b8aee140f640682',ramdisk_id='',reservation_id='r-lk0g1vvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1862722655',owner_user_name='tempest-TestVolumeBootPattern-1862722655-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:56:28Z,user_data=None,user_id='3f12eb2e28904f63baa1ddce4641e180',uuid=efe5f821-78a9-46f4-8e88-ca3aa05f5645,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38596b2b-30af-42b9-91f1-4e1f93a5fb7d", "address": "fa:16:3e:e1:f5:af", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38596b2b-30", "ovs_interfaceid": "38596b2b-30af-42b9-91f1-4e1f93a5fb7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converting VIF {"id": "38596b2b-30af-42b9-91f1-4e1f93a5fb7d", "address": "fa:16:3e:e1:f5:af", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38596b2b-30", "ovs_interfaceid": "38596b2b-30af-42b9-91f1-4e1f93a5fb7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:f5:af,bridge_name='br-int',has_traffic_filtering=True,id=38596b2b-30af-42b9-91f1-4e1f93a5fb7d,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38596b2b-30') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG os_vif [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:f5:af,bridge_name='br-int',has_traffic_filtering=True,id=38596b2b-30af-42b9-91f1-4e1f93a5fb7d,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38596b2b-30') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38596b2b-30, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:57:56 user nova-compute[72773]: INFO os_vif [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:f5:af,bridge_name='br-int',has_traffic_filtering=True,id=38596b2b-30af-42b9-91f1-4e1f93a5fb7d,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38596b2b-30')
Aug 16 22:57:56 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idrCyUct', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:57:56 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:57:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6035a160-7a6a-48b5-b0c2-821d39c68c4e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21141e4-daff-4771-a0c6-2f61e88a1d20]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52 (non-flash)
Aug 16 22:57:56 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52 (non-flash)
Aug 16 22:57:56 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef5c5a0550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52'): ({'sdb'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Removing single pathed devices sdb {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[42107459-0aec-4e1e-bfb9-38ba6813d046]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4ece7f-5984-40de-88cf-6c336aa2bd77]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Flushing IO for device /dev/sdb {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadb8efa-304c-4d60-a7ca-b50175a962fe]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.068s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffaccdb-0cfe-4d7c-a83b-61a1cc99fe31]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] SCSI volumes sdb have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23234393562343361', '/dev/disk/by-id/scsi-1SCST_BIOa3c26e2c-2495b43acf1a36a2', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a3c26e2c') {{(pid=83955) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd5b631-5bc0-4658-a228-2fd489e3a8a9]: (4, None) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dccded1-a340-4740-ab19-5ff008967ec6]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e869179-3f31-403a-b068-b96be808b15f]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52, portal: 172.16.0.220,3260]
Aug 16 22:57:56 user nova-compute[72773]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52, portal: 172.16.0.220,3260] successful.
Aug 16 22:57:56 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40727847-b65c-425e-9e1e-c1f189756f52 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbda21d6-b9dc-436f-8aa3-35a72891d3c7]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] <== disconnect_volume: return (300ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:57:56 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Deleting instance files /opt/stack/data/nova/instances/efe5f821-78a9-46f4-8e88-ca3aa05f5645_del
Aug 16 22:57:56 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Deletion of /opt/stack/data/nova/instances/efe5f821-78a9-46f4-8e88-ca3aa05f5645_del complete
Aug 16 22:57:56 user nova-compute[72773]: INFO nova.compute.manager [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 16 22:57:56 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:57:56 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:57:57 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:57:57 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Took 0.50 seconds to deallocate network for instance.
Aug 16 22:57:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:57:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-c125e6d3-9d4f-4453-af7f-f02f739eeeb5 req-f933024d-d33f-4e1a-b86a-d72083829ee5 service nova] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Received event network-vif-plugged-38596b2b-30af-42b9-91f1-4e1f93a5fb7d {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:57:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c125e6d3-9d4f-4453-af7f-f02f739eeeb5 req-f933024d-d33f-4e1a-b86a-d72083829ee5 service nova] Acquiring lock "efe5f821-78a9-46f4-8e88-ca3aa05f5645-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:57:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c125e6d3-9d4f-4453-af7f-f02f739eeeb5 req-f933024d-d33f-4e1a-b86a-d72083829ee5 service nova] Lock "efe5f821-78a9-46f4-8e88-ca3aa05f5645-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:57:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c125e6d3-9d4f-4453-af7f-f02f739eeeb5 req-f933024d-d33f-4e1a-b86a-d72083829ee5 service nova] Lock "efe5f821-78a9-46f4-8e88-ca3aa05f5645-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:57:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-c125e6d3-9d4f-4453-af7f-f02f739eeeb5 req-f933024d-d33f-4e1a-b86a-d72083829ee5 service nova] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] No waiting events found dispatching network-vif-plugged-38596b2b-30af-42b9-91f1-4e1f93a5fb7d {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:57:58 user nova-compute[72773]: WARNING nova.compute.manager [req-c125e6d3-9d4f-4453-af7f-f02f739eeeb5 req-f933024d-d33f-4e1a-b86a-d72083829ee5 service nova] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Received unexpected event network-vif-plugged-38596b2b-30af-42b9-91f1-4e1f93a5fb7d for instance with vm_state active and task_state deleting.
Aug 16 22:57:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-c125e6d3-9d4f-4453-af7f-f02f739eeeb5 req-f933024d-d33f-4e1a-b86a-d72083829ee5 service nova] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Received event network-vif-deleted-38596b2b-30af-42b9-91f1-4e1f93a5fb7d {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:57:58 user nova-compute[72773]: INFO nova.compute.manager [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Took 0.86 seconds to detach 1 volumes for instance.
Aug 16 22:57:58 user nova-compute[72773]: DEBUG nova.compute.manager [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Deleting volume: 40727847-b65c-425e-9e1e-c1f189756f52 {{(pid=72773) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 22:57:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:57:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:57:58 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:57:58 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:57:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:57:58 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Deleted allocations for instance efe5f821-78a9-46f4-8e88-ca3aa05f5645
Aug 16 22:57:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-9943a7c9-bdbd-4fa1-88b7-4c45797da9f8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "efe5f821-78a9-46f4-8e88-ca3aa05f5645" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.978s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:58:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:02 user nova-compute[72773]: DEBUG nova.compute.manager [req-46f7fb72-12d7-4fef-a9d1-f6371790bbd3 req-067a4a4b-00c0-4679-999b-d49e8434626e service nova] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Received event network-changed-029f188c-955a-42ef-9d93-39ac195f9000 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:58:02 user nova-compute[72773]: DEBUG nova.compute.manager [req-46f7fb72-12d7-4fef-a9d1-f6371790bbd3 req-067a4a4b-00c0-4679-999b-d49e8434626e service nova] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Refreshing instance network info cache due to event network-changed-029f188c-955a-42ef-9d93-39ac195f9000. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:58:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-46f7fb72-12d7-4fef-a9d1-f6371790bbd3 req-067a4a4b-00c0-4679-999b-d49e8434626e service nova] Acquiring lock "refresh_cache-11552ea0-97b9-48ce-b384-6af3e29cc6e6" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:58:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-46f7fb72-12d7-4fef-a9d1-f6371790bbd3 req-067a4a4b-00c0-4679-999b-d49e8434626e service nova] Acquired lock "refresh_cache-11552ea0-97b9-48ce-b384-6af3e29cc6e6" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:58:02 user nova-compute[72773]: DEBUG nova.network.neutron [req-46f7fb72-12d7-4fef-a9d1-f6371790bbd3 req-067a4a4b-00c0-4679-999b-d49e8434626e service nova] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Refreshing network info cache for port 029f188c-955a-42ef-9d93-39ac195f9000 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:58:03 user nova-compute[72773]: DEBUG nova.network.neutron [req-46f7fb72-12d7-4fef-a9d1-f6371790bbd3 req-067a4a4b-00c0-4679-999b-d49e8434626e service nova] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Updated VIF entry in instance network info cache for port 029f188c-955a-42ef-9d93-39ac195f9000. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:58:03 user nova-compute[72773]: DEBUG nova.network.neutron [req-46f7fb72-12d7-4fef-a9d1-f6371790bbd3 req-067a4a4b-00c0-4679-999b-d49e8434626e service nova] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Updating instance_info_cache with network_info: [{"id": "029f188c-955a-42ef-9d93-39ac195f9000", "address": "fa:16:3e:bd:8d:bc", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap029f188c-95", "ovs_interfaceid": "029f188c-955a-42ef-9d93-39ac195f9000", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:58:03 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-46f7fb72-12d7-4fef-a9d1-f6371790bbd3 req-067a4a4b-00c0-4679-999b-d49e8434626e service nova] Releasing lock "refresh_cache-11552ea0-97b9-48ce-b384-6af3e29cc6e6" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:58:04 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:58:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:58:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:58:06 user nova-compute[72773]: DEBUG nova.objects.instance [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lazy-loading 'flavor' on Instance uuid 11552ea0-97b9-48ce-b384-6af3e29cc6e6 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:58:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:58:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:58:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:58:07 user nova-compute[72773]: INFO nova.compute.manager [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Attaching volume 931a14d4-fac6-4107-9032-0d14aeac839d to /dev/vdb
Aug 16 22:58:07 user nova-compute[72773]: DEBUG os_brick.utils [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:58:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:07 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6e1011-e3b5-4409-b175-715c8745ed19]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:07 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e5130b-965e-4dbb-a38d-3f989af92ff7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:07 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2403b2e0-60f7-4886-b1f8-ed17680e6d4e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:07 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cbd3f2-175d-4795-b54d-e1e29d29cce0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:58:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:58:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:58:07 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:58:07 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40b9466-eead-434e-82ec-2e8049bd6143]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:58:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:58:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:58:07 user nova-compute[72773]: DEBUG os_brick.utils [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:58:07 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Updating existing volume attachment record: 589000b5-343e-40c6-9036-83d3e1eb680b {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:58:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:09 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:58:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:11 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:58:11 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692226676.522723, efe5f821-78a9-46f4-8e88-ca3aa05f5645 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:58:11 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] VM Stopped (Lifecycle Event)
Aug 16 22:58:11 user nova-compute[72773]: DEBUG nova.compute.manager [None req-44fcf631-440a-4f0a-a4ce-9044427b3424 None None] [instance: efe5f821-78a9-46f4-8e88-ca3aa05f5645] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:58:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "363f870e-a6d9-4664-9b9c-c343f3548b31" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:58:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:58:12 user nova-compute[72773]: DEBUG nova.compute.manager [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:58:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:58:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:58:12 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:58:12 user nova-compute[72773]: INFO nova.compute.claims [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Claim successful on node user
Aug 16 22:58:13 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:58:13 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:58:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.330s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:58:13 user nova-compute[72773]: DEBUG nova.compute.manager [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:58:13 user nova-compute[72773]: DEBUG nova.compute.manager [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:58:13 user nova-compute[72773]: DEBUG nova.network.neutron [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:58:13 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:58:13 user nova-compute[72773]: DEBUG nova.compute.manager [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:58:13 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:58:13 user nova-compute[72773]: DEBUG nova.policy [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d71f078c09c449ca7747a74d5bfb138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de13176691174b7eab7cb53a49df2933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:58:13 user nova-compute[72773]: DEBUG nova.compute.manager [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:58:13 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:58:13 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Creating image(s)
Aug 16 22:58:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "/opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:58:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "/opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:58:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "/opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:58:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "0dfed614ad2ff93c1fc5c734a13d40bde8266518" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:58:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "0dfed614ad2ff93c1fc5c734a13d40bde8266518" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:58:13 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0dfed614ad2ff93c1fc5c734a13d40bde8266518.part --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0dfed614ad2ff93c1fc5c734a13d40bde8266518.part --force-share --output=json" returned: 0 in 0.237s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:14 user nova-compute[72773]: DEBUG nova.virt.images [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] 55396c78-d108-4d39-b9f2-7ba759f49030 was qcow2, converting to raw {{(pid=72773) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 22:58:14 user nova-compute[72773]: DEBUG nova.privsep.utils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72773) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 22:58:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0dfed614ad2ff93c1fc5c734a13d40bde8266518.part /opt/stack/data/nova/instances/_base/0dfed614ad2ff93c1fc5c734a13d40bde8266518.converted {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:14 user nova-compute[72773]: DEBUG nova.network.neutron [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Successfully created port: da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:58:14 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:58:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:58:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-11552ea0-97b9-48ce-b384-6af3e29cc6e6" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:58:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-11552ea0-97b9-48ce-b384-6af3e29cc6e6" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:58:14 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 22:58:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0dfed614ad2ff93c1fc5c734a13d40bde8266518.part /opt/stack/data/nova/instances/_base/0dfed614ad2ff93c1fc5c734a13d40bde8266518.converted" returned: 0 in 0.547s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0dfed614ad2ff93c1fc5c734a13d40bde8266518.converted --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0dfed614ad2ff93c1fc5c734a13d40bde8266518.converted --force-share --output=json" returned: 0 in 0.190s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "0dfed614ad2ff93c1fc5c734a13d40bde8266518" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.453s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:58:14 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0dfed614ad2ff93c1fc5c734a13d40bde8266518 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0dfed614ad2ff93c1fc5c734a13d40bde8266518 --force-share --output=json" returned: 0 in 0.192s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "0dfed614ad2ff93c1fc5c734a13d40bde8266518" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "0dfed614ad2ff93c1fc5c734a13d40bde8266518" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0dfed614ad2ff93c1fc5c734a13d40bde8266518 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.network.neutron [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Successfully updated port: da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Updating instance_info_cache with network_info: [{"id": "029f188c-955a-42ef-9d93-39ac195f9000", "address": "fa:16:3e:bd:8d:bc", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap029f188c-95", "ovs_interfaceid": "029f188c-955a-42ef-9d93-39ac195f9000", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "refresh_cache-363f870e-a6d9-4664-9b9c-c343f3548b31" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquired lock "refresh_cache-363f870e-a6d9-4664-9b9c-c343f3548b31" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.network.neutron [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-11552ea0-97b9-48ce-b384-6af3e29cc6e6" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0dfed614ad2ff93c1fc5c734a13d40bde8266518 --force-share --output=json" returned: 0 in 0.204s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0dfed614ad2ff93c1fc5c734a13d40bde8266518,backing_fmt=raw /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.network.neutron [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0dfed614ad2ff93c1fc5c734a13d40bde8266518,backing_fmt=raw /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk 1073741824" returned: 0 in 0.064s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "0dfed614ad2ff93c1fc5c734a13d40bde8266518" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0dfed614ad2ff93c1fc5c734a13d40bde8266518 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.compute.manager [req-4fdfd836-2543-41fd-a2f2-4a55b0f7779a req-264f3625-22b5-4147-b15d-fbf67bc517b8 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Received event network-changed-da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.compute.manager [req-4fdfd836-2543-41fd-a2f2-4a55b0f7779a req-264f3625-22b5-4147-b15d-fbf67bc517b8 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Refreshing instance network info cache due to event network-changed-da5c32fa-d87d-47dc-8c64-1a4858645ade. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4fdfd836-2543-41fd-a2f2-4a55b0f7779a req-264f3625-22b5-4147-b15d-fbf67bc517b8 service nova] Acquiring lock "refresh_cache-363f870e-a6d9-4664-9b9c-c343f3548b31" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0dfed614ad2ff93c1fc5c734a13d40bde8266518 --force-share --output=json" returned: 0 in 0.205s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Checking if we can resize image /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11552ea0-97b9-48ce-b384-6af3e29cc6e6/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.network.neutron [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Updating instance_info_cache with network_info: [{"id": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "address": "fa:16:3e:43:25:e9", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda5c32fa-d8", "ovs_interfaceid": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Releasing lock "refresh_cache-363f870e-a6d9-4664-9b9c-c343f3548b31" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.compute.manager [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Instance network_info: |[{"id": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "address": "fa:16:3e:43:25:e9", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda5c32fa-d8", "ovs_interfaceid": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4fdfd836-2543-41fd-a2f2-4a55b0f7779a req-264f3625-22b5-4147-b15d-fbf67bc517b8 service nova] Acquired lock "refresh_cache-363f870e-a6d9-4664-9b9c-c343f3548b31" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.network.neutron [req-4fdfd836-2543-41fd-a2f2-4a55b0f7779a req-264f3625-22b5-4147-b15d-fbf67bc517b8 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Refreshing network info cache for port da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Cannot resize image /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.objects.instance [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lazy-loading 'migration_context' on Instance uuid 363f870e-a6d9-4664-9b9c-c343f3548b31 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Ensure instance console log exists: /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Start _get_guest_xml network_info=[{"id": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "address": "fa:16:3e:43:25:e9", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda5c32fa-d8", "ovs_interfaceid": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=55396c78-d108-4d39-b9f2-7ba759f49030,min_disk=0,min_ram=0,name='tempest-scenario-img--1824398666',owner='de13176691174b7eab7cb53a49df2933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:58:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '55396c78-d108-4d39-b9f2-7ba759f49030'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:15 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:58:15 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:58:10Z,direct_url=<?>,disk_format='qcow2',id=55396c78-d108-4d39-b9f2-7ba759f49030,min_disk=0,min_ram=0,name='tempest-scenario-img--1824398666',owner='de13176691174b7eab7cb53a49df2933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:58:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:58:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1929886723',display_name='tempest-TestMinimumBasicScenario-server-1929886723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1929886723',id=46,image_ref='55396c78-d108-4d39-b9f2-7ba759f49030',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI402WRvzhHoWPlxJnK+49US+Dx0HFSoQpX0AVquPP6MN6mleC061OydIxKJZzm2AkNdqosEj7vZy2cxiyzg4zIOJkhRtfytxqslKlLgcdQwsAvlZWqlzYIUpZ5DKe1TIw==',key_name='tempest-TestMinimumBasicScenario-127360055',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de13176691174b7eab7cb53a49df2933',ramdisk_id='',reservation_id='r-544u47jf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='55396c78-d108-4d39-b9f2-7ba759f49030',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1869730972',owner_user_name='tempest-TestMinimumBasicScenario-1869730972-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:58:13Z,user_data=None,user_id='4d71f078c09c449ca7747a74d5bfb138',uuid=363f870e-a6d9-4664-9b9c-c343f3548b31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "address": "fa:16:3e:43:25:e9", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda5c32fa-d8", "ovs_interfaceid": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Converting VIF {"id": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "address": "fa:16:3e:43:25:e9", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda5c32fa-d8", "ovs_interfaceid": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:25:e9,bridge_name='br-int',has_traffic_filtering=True,id=da5c32fa-d87d-47dc-8c64-1a4858645ade,network=Network(206eb708-434c-424b-86c4-5f958178361d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda5c32fa-d8') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.objects.instance [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lazy-loading 'pci_devices' on Instance uuid 363f870e-a6d9-4664-9b9c-c343f3548b31 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11552ea0-97b9-48ce-b384-6af3e29cc6e6/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11552ea0-97b9-48ce-b384-6af3e29cc6e6/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:58:15 user nova-compute[72773]:   <uuid>363f870e-a6d9-4664-9b9c-c343f3548b31</uuid>
Aug 16 22:58:15 user nova-compute[72773]:   <name>instance-0000002e</name>
Aug 16 22:58:15 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:58:15 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:58:15 user nova-compute[72773]:   <metadata>
Aug 16 22:58:15 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:58:15 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:58:15 user nova-compute[72773]:       <nova:name>tempest-TestMinimumBasicScenario-server-1929886723</nova:name>
Aug 16 22:58:15 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:58:15</nova:creationTime>
Aug 16 22:58:15 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:58:15 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:58:15 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:58:15 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:58:15 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:58:15 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:58:15 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:58:15 user nova-compute[72773]:       <nova:owner>
Aug 16 22:58:15 user nova-compute[72773]:         <nova:user uuid="4d71f078c09c449ca7747a74d5bfb138">tempest-TestMinimumBasicScenario-1869730972-project-member</nova:user>
Aug 16 22:58:15 user nova-compute[72773]:         <nova:project uuid="de13176691174b7eab7cb53a49df2933">tempest-TestMinimumBasicScenario-1869730972</nova:project>
Aug 16 22:58:15 user nova-compute[72773]:       </nova:owner>
Aug 16 22:58:15 user nova-compute[72773]:       <nova:root type="image" uuid="55396c78-d108-4d39-b9f2-7ba759f49030"/>
Aug 16 22:58:15 user nova-compute[72773]:       <nova:ports>
Aug 16 22:58:15 user nova-compute[72773]:         <nova:port uuid="da5c32fa-d87d-47dc-8c64-1a4858645ade">
Aug 16 22:58:15 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 22:58:15 user nova-compute[72773]:         </nova:port>
Aug 16 22:58:15 user nova-compute[72773]:       </nova:ports>
Aug 16 22:58:15 user nova-compute[72773]:     </nova:instance>
Aug 16 22:58:15 user nova-compute[72773]:   </metadata>
Aug 16 22:58:15 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:58:15 user nova-compute[72773]:     <system>
Aug 16 22:58:15 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:58:15 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:58:15 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:58:15 user nova-compute[72773]:       <entry name="serial">363f870e-a6d9-4664-9b9c-c343f3548b31</entry>
Aug 16 22:58:15 user nova-compute[72773]:       <entry name="uuid">363f870e-a6d9-4664-9b9c-c343f3548b31</entry>
Aug 16 22:58:15 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:58:15 user nova-compute[72773]:     </system>
Aug 16 22:58:15 user nova-compute[72773]:   </sysinfo>
Aug 16 22:58:15 user nova-compute[72773]:   <os>
Aug 16 22:58:15 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:58:15 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:58:15 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:58:15 user nova-compute[72773]:   </os>
Aug 16 22:58:15 user nova-compute[72773]:   <features>
Aug 16 22:58:15 user nova-compute[72773]:     <acpi/>
Aug 16 22:58:15 user nova-compute[72773]:     <apic/>
Aug 16 22:58:15 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:58:15 user nova-compute[72773]:   </features>
Aug 16 22:58:15 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:58:15 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:58:15 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:58:15 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:58:15 user nova-compute[72773]:   </clock>
Aug 16 22:58:15 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:58:15 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:58:15 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:58:15 user nova-compute[72773]:   </cpu>
Aug 16 22:58:15 user nova-compute[72773]:   <devices>
Aug 16 22:58:15 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 22:58:15 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 22:58:15 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk"/>
Aug 16 22:58:15 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:58:15 user nova-compute[72773]:     </disk>
Aug 16 22:58:15 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:58:15 user nova-compute[72773]:       <mac address="fa:16:3e:43:25:e9"/>
Aug 16 22:58:15 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:58:15 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:58:15 user nova-compute[72773]:       <target dev="tapda5c32fa-d8"/>
Aug 16 22:58:15 user nova-compute[72773]:     </interface>
Aug 16 22:58:15 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:58:15 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/console.log" append="off"/>
Aug 16 22:58:15 user nova-compute[72773]:     </serial>
Aug 16 22:58:15 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:58:15 user nova-compute[72773]:     <video>
Aug 16 22:58:15 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:58:15 user nova-compute[72773]:     </video>
Aug 16 22:58:15 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:58:15 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:58:15 user nova-compute[72773]:     </rng>
Aug 16 22:58:15 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:58:15 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:58:15 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:58:15 user nova-compute[72773]:     </memballoon>
Aug 16 22:58:15 user nova-compute[72773]:   </devices>
Aug 16 22:58:15 user nova-compute[72773]: </domain>
Aug 16 22:58:15 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:58:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1929886723',display_name='tempest-TestMinimumBasicScenario-server-1929886723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1929886723',id=46,image_ref='55396c78-d108-4d39-b9f2-7ba759f49030',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI402WRvzhHoWPlxJnK+49US+Dx0HFSoQpX0AVquPP6MN6mleC061OydIxKJZzm2AkNdqosEj7vZy2cxiyzg4zIOJkhRtfytxqslKlLgcdQwsAvlZWqlzYIUpZ5DKe1TIw==',key_name='tempest-TestMinimumBasicScenario-127360055',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de13176691174b7eab7cb53a49df2933',ramdisk_id='',reservation_id='r-544u47jf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='55396c78-d108-4d39-b9f2-7ba759f49030',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1869730972',owner_user_name='tempest-TestMinimumBasicScenario-1869730972-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:58:13Z,user_data=None,user_id='4d71f078c09c449ca7747a74d5bfb138',uuid=363f870e-a6d9-4664-9b9c-c343f3548b31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "address": "fa:16:3e:43:25:e9", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda5c32fa-d8", "ovs_interfaceid": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Converting VIF {"id": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "address": "fa:16:3e:43:25:e9", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda5c32fa-d8", "ovs_interfaceid": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:25:e9,bridge_name='br-int',has_traffic_filtering=True,id=da5c32fa-d87d-47dc-8c64-1a4858645ade,network=Network(206eb708-434c-424b-86c4-5f958178361d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda5c32fa-d8') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG os_vif [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:25:e9,bridge_name='br-int',has_traffic_filtering=True,id=da5c32fa-d87d-47dc-8c64-1a4858645ade,network=Network(206eb708-434c-424b-86c4-5f958178361d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda5c32fa-d8') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda5c32fa-d8, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:58:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapda5c32fa-d8, col_values=(('external_ids', {'iface-id': 'da5c32fa-d87d-47dc-8c64-1a4858645ade', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:25:e9', 'vm-uuid': '363f870e-a6d9-4664-9b9c-c343f3548b31'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:58:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:58:16 user nova-compute[72773]: INFO os_vif [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:25:e9,bridge_name='br-int',has_traffic_filtering=True,id=da5c32fa-d87d-47dc-8c64-1a4858645ade,network=Network(206eb708-434c-424b-86c4-5f958178361d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda5c32fa-d8')
Aug 16 22:58:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:58:16 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] No VIF found with MAC fa:16:3e:43:25:e9, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:58:16 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11552ea0-97b9-48ce-b384-6af3e29cc6e6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:16 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:58:16 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:58:16 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=8713MB free_disk=25.404151916503906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:58:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:58:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:58:16 user nova-compute[72773]: DEBUG nova.network.neutron [req-4fdfd836-2543-41fd-a2f2-4a55b0f7779a req-264f3625-22b5-4147-b15d-fbf67bc517b8 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Updated VIF entry in instance network info cache for port da5c32fa-d87d-47dc-8c64-1a4858645ade. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:58:16 user nova-compute[72773]: DEBUG nova.network.neutron [req-4fdfd836-2543-41fd-a2f2-4a55b0f7779a req-264f3625-22b5-4147-b15d-fbf67bc517b8 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Updating instance_info_cache with network_info: [{"id": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "address": "fa:16:3e:43:25:e9", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda5c32fa-d8", "ovs_interfaceid": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:58:16 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 11552ea0-97b9-48ce-b384-6af3e29cc6e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:58:16 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 363f870e-a6d9-4664-9b9c-c343f3548b31 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:58:16 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:58:16 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:58:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4fdfd836-2543-41fd-a2f2-4a55b0f7779a req-264f3625-22b5-4147-b15d-fbf67bc517b8 service nova] Releasing lock "refresh_cache-363f870e-a6d9-4664-9b9c-c343f3548b31" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:58:16 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:58:16 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:58:16 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:58:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:58:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:17 user nova-compute[72773]: DEBUG nova.compute.manager [req-d170aff7-3807-4e45-b0ab-87b1cf9ea3e1 req-44ca4a6e-8ae1-4831-b64f-5063a6d401b0 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Received event network-vif-plugged-da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:58:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d170aff7-3807-4e45-b0ab-87b1cf9ea3e1 req-44ca4a6e-8ae1-4831-b64f-5063a6d401b0 service nova] Acquiring lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:58:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d170aff7-3807-4e45-b0ab-87b1cf9ea3e1 req-44ca4a6e-8ae1-4831-b64f-5063a6d401b0 service nova] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:58:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d170aff7-3807-4e45-b0ab-87b1cf9ea3e1 req-44ca4a6e-8ae1-4831-b64f-5063a6d401b0 service nova] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:58:17 user nova-compute[72773]: DEBUG nova.compute.manager [req-d170aff7-3807-4e45-b0ab-87b1cf9ea3e1 req-44ca4a6e-8ae1-4831-b64f-5063a6d401b0 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] No waiting events found dispatching network-vif-plugged-da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:58:17 user nova-compute[72773]: WARNING nova.compute.manager [req-d170aff7-3807-4e45-b0ab-87b1cf9ea3e1 req-44ca4a6e-8ae1-4831-b64f-5063a6d401b0 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Received unexpected event network-vif-plugged-da5c32fa-d87d-47dc-8c64-1a4858645ade for instance with vm_state building and task_state spawning.
Aug 16 22:58:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIgoVZER', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:58:18 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:58:18 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:58:18 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:58:18 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:58:18 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:58:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[65466300-2ac8-4e5d-ae7f-8903beccdd9c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:58:18 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[529c8839-a375-475e-9098-77c56988e2e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d] added
Aug 16 22:58:18 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f99884-6bd9-4637-ad13-532215baeb56]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[001f62cd-0b24-478b-8f0c-93a2bf80756a]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sIgoVZER {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sIgoVZER" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c049a025-6ba4-463f-8945-dbd944c5cc15]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sIgoVZER'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15cc371-d29f-4706-9fc9-01d57d239700]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9cd3a3-c8fd-4c1e-88fa-f87798fb0646]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 22:58:18 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 22:58:18 user nova-compute[72773]:  {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:58:18 user nova-compute[72773]: WARNING os_brick.initiator.connectors.iscsi [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 22:58:18 user nova-compute[72773]: 
Aug 16 22:58:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e253c5c-2e38-4f71-8f76-9ee69fd9c963]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d, portal: 172.16.0.220,3260]
Aug 16 22:58:18 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d, portal: 172.16.0.220,3260] successful.
Aug 16 22:58:18 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdd7cf3-7784-4f98-b0f9-bed7d1024c98]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3a9359-6a36-4460-b216-898d939b55ce]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d (non-flash)
Aug 16 22:58:18 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d (non-flash)
Aug 16 22:58:18 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c2bc15-880c-452f-ab1e-2c2e63675b12]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:58:18 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIgoVZER', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:58:19 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692226699.5438988, 363f870e-a6d9-4664-9b9c-c343f3548b31 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:58:19 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] VM Resumed (Lifecycle Event)
Aug 16 22:58:19 user nova-compute[72773]: DEBUG nova.compute.manager [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:58:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:58:19 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Instance spawned successfully.
Aug 16 22:58:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:58:19 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:58:19 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:58:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:58:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:58:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:58:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:58:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:58:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:58:19 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:58:19 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692226699.5479686, 363f870e-a6d9-4664-9b9c-c343f3548b31 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:58:19 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] VM Started (Lifecycle Event)
Aug 16 22:58:19 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:58:19 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23561653435383263', 'path': '/dev/sdb'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:58:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561653435383263', 'path': '/dev/sdb'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:58:19 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:58:19 user nova-compute[72773]: DEBUG nova.objects.instance [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lazy-loading 'flavor' on Instance uuid 11552ea0-97b9-48ce-b384-6af3e29cc6e6 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:58:19 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:58:19 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 22:58:19 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:58:19 user nova-compute[72773]:   <source dev="/dev/sdb"/>
Aug 16 22:58:19 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:58:19 user nova-compute[72773]:   <serial>931a14d4-fac6-4107-9032-0d14aeac839d</serial>
Aug 16 22:58:19 user nova-compute[72773]: </disk>
Aug 16 22:58:19 user nova-compute[72773]:  {{(pid=72773) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 22:58:19 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:58:19 user nova-compute[72773]: INFO nova.compute.manager [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Took 6.17 seconds to spawn the instance on the hypervisor.
Aug 16 22:58:19 user nova-compute[72773]: DEBUG nova.compute.manager [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:58:19 user nova-compute[72773]: DEBUG nova.compute.manager [req-62026a80-d6f0-400f-8c6d-15d17693a607 req-923de043-29d8-4ce2-93b7-1939a0836171 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Received event network-vif-plugged-da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:58:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-62026a80-d6f0-400f-8c6d-15d17693a607 req-923de043-29d8-4ce2-93b7-1939a0836171 service nova] Acquiring lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:58:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-62026a80-d6f0-400f-8c6d-15d17693a607 req-923de043-29d8-4ce2-93b7-1939a0836171 service nova] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:58:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-62026a80-d6f0-400f-8c6d-15d17693a607 req-923de043-29d8-4ce2-93b7-1939a0836171 service nova] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:58:19 user nova-compute[72773]: DEBUG nova.compute.manager [req-62026a80-d6f0-400f-8c6d-15d17693a607 req-923de043-29d8-4ce2-93b7-1939a0836171 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] No waiting events found dispatching network-vif-plugged-da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:58:19 user nova-compute[72773]: WARNING nova.compute.manager [req-62026a80-d6f0-400f-8c6d-15d17693a607 req-923de043-29d8-4ce2-93b7-1939a0836171 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Received unexpected event network-vif-plugged-da5c32fa-d87d-47dc-8c64-1a4858645ade for instance with vm_state building and task_state spawning.
Aug 16 22:58:19 user nova-compute[72773]: INFO nova.compute.manager [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Took 6.81 seconds to build instance.
Aug 16 22:58:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-51855972-b011-4c0c-b584-f6abb13aeb85 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.900s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:58:19 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:58:19 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:58:19 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:58:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:58:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:58:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] No VIF found with MAC fa:16:3e:bd:8d:bc, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:58:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-28401b9d-feac-4055-8c74-3be6b94ed381 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.026s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:58:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:58:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:58:23 user nova-compute[72773]: DEBUG nova.objects.instance [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lazy-loading 'flavor' on Instance uuid 11552ea0-97b9-48ce-b384-6af3e29cc6e6 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:58:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:58:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:58:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:58:24 user nova-compute[72773]: INFO nova.compute.manager [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Attaching volume 67f7b170-b2bb-4138-8b4d-51c17965c8c6 to /dev/vdc
Aug 16 22:58:24 user nova-compute[72773]: DEBUG os_brick.utils [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:58:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:24 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a836f22-471b-4502-af65-a608e49efba1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:24 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e83592-b18a-4d8a-9b07-605df7e95023]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:24 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb73db9-1f18-4f2f-8b18-251a8d5f28f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:24 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a12797-6b77-427e-a97c-ae826f40d3ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:58:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:58:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:24 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:58:24 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:58:24 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8107d7f0-031b-489b-9263-4d8356820709]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:58:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:58:24 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:58:24 user nova-compute[72773]: DEBUG os_brick.utils [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:58:24 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Updating existing volume attachment record: 4e801146-6823-4637-884f-faaaf830e5f8 {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:58:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:58:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 22:58:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:58:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 22:58:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CkdWLutm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:58:34 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:58:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:58:34 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:58:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:58:34 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:58:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a625fbc-6317-4966-85c6-e9eadd904f3d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:58:34 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e851087-c4c4-482e-8b9c-7fd7c6470ca9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6] added
Aug 16 22:58:34 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac10434a-81b3-4e50-ad34-6dffb57026fe]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f64a9b0-0ecf-45fe-acab-ce5255dc1b8b]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CkdWLutm {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CkdWLutm" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbbc712-fd55-4304-9660-9817836b51dd]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CkdWLutm'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e526470-e0c5-4bec-9cbd-91afa3f86c57]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96f39a5-0ae7-4e38-a779-b41416e72c83]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d (non-flash)
Aug 16 22:58:34 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d (non-flash)
Aug 16 22:58:34 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a186afe-e611-4375-a51c-69fac977e3f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6, portal: 172.16.0.220,3260]
Aug 16 22:58:34 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6, portal: 172.16.0.220,3260] successful.
Aug 16 22:58:34 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdf84e8-71b8-467e-be59-f2ddaacaa81d]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e3ac2a-a2a5-4cc7-bd79-3472574e553c]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d (non-flash)
Aug 16 22:58:34 user nova-compute[72773]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6 (non-flash)
Aug 16 22:58:34 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d (non-flash)
Aug 16 22:58:34 user nova-compute[72773]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6 (non-flash)
Aug 16 22:58:34 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3075ac0a-e7e7-4a9c-bbbe-bedb17c25824]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:34 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: None {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:58:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:35 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:58:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CkdWLutm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:58:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:58:35 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23763316332336161', 'path': '/dev/sdc'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:58:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763316332336161', 'path': '/dev/sdc'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:58:35 user nova-compute[72773]: DEBUG nova.objects.instance [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lazy-loading 'flavor' on Instance uuid 11552ea0-97b9-48ce-b384-6af3e29cc6e6 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:58:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 22:58:35 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:58:35 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 22:58:35 user nova-compute[72773]:   <target dev="vdc" bus="virtio"/>
Aug 16 22:58:35 user nova-compute[72773]:   <serial>67f7b170-b2bb-4138-8b4d-51c17965c8c6</serial>
Aug 16 22:58:35 user nova-compute[72773]: </disk>
Aug 16 22:58:35 user nova-compute[72773]:  {{(pid=72773) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 22:58:36 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:58:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:58:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:58:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] No VIF found with MAC fa:16:3e:bd:8d:bc, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:58:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-bf535340-b5dc-4255-aaee-cf463a0e2a42 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.294s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:58:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d38d2248-b8d6-4112-998f-5689b6c0137e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:58:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d38d2248-b8d6-4112-998f-5689b6c0137e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:58:37 user nova-compute[72773]: INFO nova.compute.manager [None req-d38d2248-b8d6-4112-998f-5689b6c0137e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Detaching volume 931a14d4-fac6-4107-9032-0d14aeac839d
Aug 16 22:58:37 user nova-compute[72773]: INFO nova.virt.block_device [None req-d38d2248-b8d6-4112-998f-5689b6c0137e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Attempting to driver detach volume 931a14d4-fac6-4107-9032-0d14aeac839d from mountpoint /dev/vdb
Aug 16 22:58:37 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d38d2248-b8d6-4112-998f-5689b6c0137e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Attempting to detach device vdb from instance 11552ea0-97b9-48ce-b384-6af3e29cc6e6 from the persistent domain config. {{(pid=72773) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 22:58:37 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-d38d2248-b8d6-4112-998f-5689b6c0137e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:58:37 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:58:37 user nova-compute[72773]:   <source dev="/dev/sdb"/>
Aug 16 22:58:37 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:58:37 user nova-compute[72773]:   <serial>931a14d4-fac6-4107-9032-0d14aeac839d</serial>
Aug 16 22:58:37 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:58:37 user nova-compute[72773]: </disk>
Aug 16 22:58:37 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:58:37 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-d38d2248-b8d6-4112-998f-5689b6c0137e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Successfully detached device vdb from instance 11552ea0-97b9-48ce-b384-6af3e29cc6e6 from the persistent domain config.
Aug 16 22:58:37 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d38d2248-b8d6-4112-998f-5689b6c0137e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 11552ea0-97b9-48ce-b384-6af3e29cc6e6 from the live domain config. {{(pid=72773) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 22:58:37 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-d38d2248-b8d6-4112-998f-5689b6c0137e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:58:37 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:58:37 user nova-compute[72773]:   <source dev="/dev/sdb"/>
Aug 16 22:58:37 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 22:58:37 user nova-compute[72773]:   <serial>931a14d4-fac6-4107-9032-0d14aeac839d</serial>
Aug 16 22:58:37 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 22:58:37 user nova-compute[72773]: </disk>
Aug 16 22:58:37 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:58:37 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Received event <DeviceRemovedEvent: 1692226717.9338603, 11552ea0-97b9-48ce-b384-6af3e29cc6e6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72773) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 22:58:37 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d38d2248-b8d6-4112-998f-5689b6c0137e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 11552ea0-97b9-48ce-b384-6af3e29cc6e6 {{(pid=72773) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 22:58:37 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-d38d2248-b8d6-4112-998f-5689b6c0137e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Successfully detached device vdb from instance 11552ea0-97b9-48ce-b384-6af3e29cc6e6 from the live domain config.
Aug 16 22:58:37 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d38d2248-b8d6-4112-998f-5689b6c0137e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:58:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38d2248-b8d6-4112-998f-5689b6c0137e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIgoVZER', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:58:37 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-d38d2248-b8d6-4112-998f-5689b6c0137e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:58:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d38d2248-b8d6-4112-998f-5689b6c0137e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:58:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d38d2248-b8d6-4112-998f-5689b6c0137e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:58:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38d2248-b8d6-4112-998f-5689b6c0137e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:58:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f438958d-dcd1-4a4a-9a97-26d3632f10f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fb7632-9018-41f0-865f-d69cb87ecc2c]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38d2248-b8d6-4112-998f-5689b6c0137e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d (non-flash)
Aug 16 22:58:37 user nova-compute[72773]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6 (non-flash)
Aug 16 22:58:37 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:58:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38d2248-b8d6-4112-998f-5689b6c0137e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d (non-flash)
Aug 16 22:58:37 user nova-compute[72773]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6 (non-flash)
Aug 16 22:58:37 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:58:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38d2248-b8d6-4112-998f-5689b6c0137e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef5c5a0c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d'): ({'sdb'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:58:38 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d38d2248-b8d6-4112-998f-5689b6c0137e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Removing single pathed devices sdb {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:58:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:38 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d72095-67ef-4a7d-92b0-e6ba8628fdda]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:38 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0224d926-034c-4769-8a8d-d988ad8304c4]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:38 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d38d2248-b8d6-4112-998f-5689b6c0137e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Flushing IO for device /dev/sdb {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:58:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:38 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[da05e453-ffb5-4b97-8b40-36e0c93d8d21]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:38 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d38d2248-b8d6-4112-998f-5689b6c0137e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:58:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:38 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[85074534-1cb7-4038-bfea-7c758cf6bee3]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:38 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d38d2248-b8d6-4112-998f-5689b6c0137e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:58:38 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d38d2248-b8d6-4112-998f-5689b6c0137e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] SCSI volumes sdb have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:58:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38d2248-b8d6-4112-998f-5689b6c0137e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:58:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:38 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d400ac85-e76f-47a3-936c-a8f70a4ecad6]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38d2248-b8d6-4112-998f-5689b6c0137e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:58:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:38 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a03ef94-3ec5-4bcc-a935-5ca69eb4e89d]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38d2248-b8d6-4112-998f-5689b6c0137e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d, portal: 172.16.0.220,3260]
Aug 16 22:58:38 user nova-compute[72773]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d, portal: 172.16.0.220,3260] successful.
Aug 16 22:58:38 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:58:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:931a14d4-fac6-4107-9032-0d14aeac839d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:38 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1320cd08-4142-4f56-bb05-bc0c6fc4c130]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38d2248-b8d6-4112-998f-5689b6c0137e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:58:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d38d2248-b8d6-4112-998f-5689b6c0137e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:58:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38d2248-b8d6-4112-998f-5689b6c0137e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] <== disconnect_volume: return (287ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:58:38 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d38d2248-b8d6-4112-998f-5689b6c0137e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:58:38 user nova-compute[72773]: DEBUG nova.objects.instance [None req-d38d2248-b8d6-4112-998f-5689b6c0137e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lazy-loading 'flavor' on Instance uuid 11552ea0-97b9-48ce-b384-6af3e29cc6e6 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:58:39 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d38d2248-b8d6-4112-998f-5689b6c0137e tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.619s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:58:39 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7655c9ba-f264-4a64-854b-48dab9856ee9 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:58:39 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7655c9ba-f264-4a64-854b-48dab9856ee9 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:58:39 user nova-compute[72773]: INFO nova.compute.manager [None req-7655c9ba-f264-4a64-854b-48dab9856ee9 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Detaching volume 67f7b170-b2bb-4138-8b4d-51c17965c8c6
Aug 16 22:58:39 user nova-compute[72773]: INFO nova.virt.block_device [None req-7655c9ba-f264-4a64-854b-48dab9856ee9 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Attempting to driver detach volume 67f7b170-b2bb-4138-8b4d-51c17965c8c6 from mountpoint /dev/vdc
Aug 16 22:58:39 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7655c9ba-f264-4a64-854b-48dab9856ee9 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Attempting to detach device vdc from instance 11552ea0-97b9-48ce-b384-6af3e29cc6e6 from the persistent domain config. {{(pid=72773) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 22:58:39 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-7655c9ba-f264-4a64-854b-48dab9856ee9 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:58:39 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:58:39 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 22:58:39 user nova-compute[72773]:   <target dev="vdc" bus="virtio"/>
Aug 16 22:58:39 user nova-compute[72773]:   <serial>67f7b170-b2bb-4138-8b4d-51c17965c8c6</serial>
Aug 16 22:58:39 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 22:58:39 user nova-compute[72773]: </disk>
Aug 16 22:58:39 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:58:39 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-7655c9ba-f264-4a64-854b-48dab9856ee9 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Successfully detached device vdc from instance 11552ea0-97b9-48ce-b384-6af3e29cc6e6 from the persistent domain config.
Aug 16 22:58:39 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7655c9ba-f264-4a64-854b-48dab9856ee9 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 11552ea0-97b9-48ce-b384-6af3e29cc6e6 from the live domain config. {{(pid=72773) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 22:58:39 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-7655c9ba-f264-4a64-854b-48dab9856ee9 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 22:58:39 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:58:39 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 22:58:39 user nova-compute[72773]:   <target dev="vdc" bus="virtio"/>
Aug 16 22:58:39 user nova-compute[72773]:   <serial>67f7b170-b2bb-4138-8b4d-51c17965c8c6</serial>
Aug 16 22:58:39 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 22:58:39 user nova-compute[72773]: </disk>
Aug 16 22:58:39 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Received event <DeviceRemovedEvent: 1692226720.3089528, 11552ea0-97b9-48ce-b384-6af3e29cc6e6 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72773) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7655c9ba-f264-4a64-854b-48dab9856ee9 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 11552ea0-97b9-48ce-b384-6af3e29cc6e6 {{(pid=72773) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 22:58:40 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-7655c9ba-f264-4a64-854b-48dab9856ee9 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Successfully detached device vdc from instance 11552ea0-97b9-48ce-b384-6af3e29cc6e6 from the live domain config.
Aug 16 22:58:40 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7655c9ba-f264-4a64-854b-48dab9856ee9 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7655c9ba-f264-4a64-854b-48dab9856ee9 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CkdWLutm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:58:40 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-7655c9ba-f264-4a64-854b-48dab9856ee9 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:58:40 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-7655c9ba-f264-4a64-854b-48dab9856ee9 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-7655c9ba-f264-4a64-854b-48dab9856ee9 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7655c9ba-f264-4a64-854b-48dab9856ee9 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f8749c-ee6c-4c3b-822f-a3327e6990f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1852e4-5fbd-42f1-a485-ecd2e9f639ad]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7655c9ba-f264-4a64-854b-48dab9856ee9 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6 (non-flash)
Aug 16 22:58:40 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7655c9ba-f264-4a64-854b-48dab9856ee9 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6 (non-flash)
Aug 16 22:58:40 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7655c9ba-f264-4a64-854b-48dab9856ee9 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef5c5a1630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6'): ({'sdc'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-7655c9ba-f264-4a64-854b-48dab9856ee9 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Removing single pathed devices sdc {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c48672e-3920-42b8-906a-bf17a1b441bb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9ae961-7cb2-4398-b302-016b4e135170]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-7655c9ba-f264-4a64-854b-48dab9856ee9 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Flushing IO for device /dev/sdc {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1e0cf1-7381-4fba-a60e-38414d7ec22a]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-7655c9ba-f264-4a64-854b-48dab9856ee9 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7550edb3-2d66-459e-9c55-141a98b1ef02]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-7655c9ba-f264-4a64-854b-48dab9856ee9 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-7655c9ba-f264-4a64-854b-48dab9856ee9 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7655c9ba-f264-4a64-854b-48dab9856ee9 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a77bee-f33a-4a48-8829-4ee8b1166121]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7655c9ba-f264-4a64-854b-48dab9856ee9 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1397eef-3be5-4721-84e7-13581f421be4]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7655c9ba-f264-4a64-854b-48dab9856ee9 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6, portal: 172.16.0.220,3260]
Aug 16 22:58:40 user nova-compute[72773]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6, portal: 172.16.0.220,3260] successful.
Aug 16 22:58:40 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67f7b170-b2bb-4138-8b4d-51c17965c8c6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa43e0c7-8638-4d51-9ac9-8a69f4d0788e]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7655c9ba-f264-4a64-854b-48dab9856ee9 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-7655c9ba-f264-4a64-854b-48dab9856ee9 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7655c9ba-f264-4a64-854b-48dab9856ee9 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] <== disconnect_volume: return (291ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7655c9ba-f264-4a64-854b-48dab9856ee9 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 22:58:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:41 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:41 user nova-compute[72773]: DEBUG nova.objects.instance [None req-7655c9ba-f264-4a64-854b-48dab9856ee9 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lazy-loading 'flavor' on Instance uuid 11552ea0-97b9-48ce-b384-6af3e29cc6e6 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:58:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7655c9ba-f264-4a64-854b-48dab9856ee9 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.642s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:58:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-98e70b73-46b3-494e-9904-f33687951df4 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:58:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-98e70b73-46b3-494e-9904-f33687951df4 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:58:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-98e70b73-46b3-494e-9904-f33687951df4 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:58:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-98e70b73-46b3-494e-9904-f33687951df4 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:58:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-98e70b73-46b3-494e-9904-f33687951df4 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:58:42 user nova-compute[72773]: INFO nova.compute.manager [None req-98e70b73-46b3-494e-9904-f33687951df4 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Terminating instance
Aug 16 22:58:42 user nova-compute[72773]: DEBUG nova.compute.manager [None req-98e70b73-46b3-494e-9904-f33687951df4 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 22:58:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:42 user nova-compute[72773]: DEBUG nova.compute.manager [req-b3b8307c-c622-4dcb-9b12-2183c9b6d767 req-a8a5e9c6-414e-4b8d-8c31-1292f8509544 service nova] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Received event network-vif-unplugged-029f188c-955a-42ef-9d93-39ac195f9000 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:58:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b3b8307c-c622-4dcb-9b12-2183c9b6d767 req-a8a5e9c6-414e-4b8d-8c31-1292f8509544 service nova] Acquiring lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:58:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b3b8307c-c622-4dcb-9b12-2183c9b6d767 req-a8a5e9c6-414e-4b8d-8c31-1292f8509544 service nova] Lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:58:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b3b8307c-c622-4dcb-9b12-2183c9b6d767 req-a8a5e9c6-414e-4b8d-8c31-1292f8509544 service nova] Lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:58:42 user nova-compute[72773]: DEBUG nova.compute.manager [req-b3b8307c-c622-4dcb-9b12-2183c9b6d767 req-a8a5e9c6-414e-4b8d-8c31-1292f8509544 service nova] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] No waiting events found dispatching network-vif-unplugged-029f188c-955a-42ef-9d93-39ac195f9000 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:58:42 user nova-compute[72773]: DEBUG nova.compute.manager [req-b3b8307c-c622-4dcb-9b12-2183c9b6d767 req-a8a5e9c6-414e-4b8d-8c31-1292f8509544 service nova] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Received event network-vif-unplugged-029f188c-955a-42ef-9d93-39ac195f9000 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 22:58:43 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Instance destroyed successfully.
Aug 16 22:58:43 user nova-compute[72773]: DEBUG nova.objects.instance [None req-98e70b73-46b3-494e-9904-f33687951df4 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lazy-loading 'resources' on Instance uuid 11552ea0-97b9-48ce-b384-6af3e29cc6e6 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:58:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-98e70b73-46b3-494e-9904-f33687951df4 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:56:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-477883364',display_name='tempest-AttachVolumeTestJSON-server-477883364',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-477883364',id=45,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSzA2K9VwiYCWokHpru2VxEfDbvCooqM54AiAcZAVkr+649JrLxo35Fb8NpUtA1fNBBY0beBtfDg1/1Vv3zYA02y3nTZS/5JaupzqmCd1VwKfuKUdbXUDL6M9YWdgsIvA==',key_name='tempest-keypair-1884694588',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:56:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6da6170d60c4d41b14c342700a5dd83',ramdisk_id='',reservation_id='r-2r9p7pnp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-317922803',owner_user_name='tempest-AttachVolumeTestJSON-317922803-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:56:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7b76435f64e47169f3ca08aebb8e766',uuid=11552ea0-97b9-48ce-b384-6af3e29cc6e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "029f188c-955a-42ef-9d93-39ac195f9000", "address": "fa:16:3e:bd:8d:bc", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap029f188c-95", "ovs_interfaceid": "029f188c-955a-42ef-9d93-39ac195f9000", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 22:58:43 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-98e70b73-46b3-494e-9904-f33687951df4 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Converting VIF {"id": "029f188c-955a-42ef-9d93-39ac195f9000", "address": "fa:16:3e:bd:8d:bc", "network": {"id": "3348a6ff-bdcc-49e3-bb0a-4839999ec213", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-599116500-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6da6170d60c4d41b14c342700a5dd83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap029f188c-95", "ovs_interfaceid": "029f188c-955a-42ef-9d93-39ac195f9000", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:58:43 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-98e70b73-46b3-494e-9904-f33687951df4 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:8d:bc,bridge_name='br-int',has_traffic_filtering=True,id=029f188c-955a-42ef-9d93-39ac195f9000,network=Network(3348a6ff-bdcc-49e3-bb0a-4839999ec213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap029f188c-95') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:58:43 user nova-compute[72773]: DEBUG os_vif [None req-98e70b73-46b3-494e-9904-f33687951df4 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:8d:bc,bridge_name='br-int',has_traffic_filtering=True,id=029f188c-955a-42ef-9d93-39ac195f9000,network=Network(3348a6ff-bdcc-49e3-bb0a-4839999ec213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap029f188c-95') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 22:58:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap029f188c-95, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:58:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:58:43 user nova-compute[72773]: INFO os_vif [None req-98e70b73-46b3-494e-9904-f33687951df4 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:8d:bc,bridge_name='br-int',has_traffic_filtering=True,id=029f188c-955a-42ef-9d93-39ac195f9000,network=Network(3348a6ff-bdcc-49e3-bb0a-4839999ec213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap029f188c-95')
Aug 16 22:58:43 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-98e70b73-46b3-494e-9904-f33687951df4 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Deleting instance files /opt/stack/data/nova/instances/11552ea0-97b9-48ce-b384-6af3e29cc6e6_del
Aug 16 22:58:43 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-98e70b73-46b3-494e-9904-f33687951df4 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Deletion of /opt/stack/data/nova/instances/11552ea0-97b9-48ce-b384-6af3e29cc6e6_del complete
Aug 16 22:58:43 user nova-compute[72773]: INFO nova.compute.manager [None req-98e70b73-46b3-494e-9904-f33687951df4 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 16 22:58:43 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-98e70b73-46b3-494e-9904-f33687951df4 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 22:58:43 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 22:58:43 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 22:58:44 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:58:44 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Took 0.78 seconds to deallocate network for instance.
Aug 16 22:58:44 user nova-compute[72773]: DEBUG nova.compute.manager [req-c29286a5-0b07-454b-80e6-92f8dcdb1c61 req-4a7f7390-0afe-4734-9afd-79f4d7346786 service nova] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Received event network-vif-deleted-029f188c-955a-42ef-9d93-39ac195f9000 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:58:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-98e70b73-46b3-494e-9904-f33687951df4 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:58:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-98e70b73-46b3-494e-9904-f33687951df4 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:58:44 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-98e70b73-46b3-494e-9904-f33687951df4 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:58:44 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-98e70b73-46b3-494e-9904-f33687951df4 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:58:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-98e70b73-46b3-494e-9904-f33687951df4 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:58:44 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-98e70b73-46b3-494e-9904-f33687951df4 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Deleted allocations for instance 11552ea0-97b9-48ce-b384-6af3e29cc6e6
Aug 16 22:58:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-98e70b73-46b3-494e-9904-f33687951df4 tempest-AttachVolumeTestJSON-317922803 tempest-AttachVolumeTestJSON-317922803-project-member] Lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:58:44 user nova-compute[72773]: DEBUG nova.compute.manager [req-5c6c1b12-d396-433c-b209-b80c80f6bdbe req-c5c4f437-f0ac-4112-8b17-15137d143c16 service nova] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Received event network-vif-plugged-029f188c-955a-42ef-9d93-39ac195f9000 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:58:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5c6c1b12-d396-433c-b209-b80c80f6bdbe req-c5c4f437-f0ac-4112-8b17-15137d143c16 service nova] Acquiring lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:58:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5c6c1b12-d396-433c-b209-b80c80f6bdbe req-c5c4f437-f0ac-4112-8b17-15137d143c16 service nova] Lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:58:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-5c6c1b12-d396-433c-b209-b80c80f6bdbe req-c5c4f437-f0ac-4112-8b17-15137d143c16 service nova] Lock "11552ea0-97b9-48ce-b384-6af3e29cc6e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:58:44 user nova-compute[72773]: DEBUG nova.compute.manager [req-5c6c1b12-d396-433c-b209-b80c80f6bdbe req-c5c4f437-f0ac-4112-8b17-15137d143c16 service nova] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] No waiting events found dispatching network-vif-plugged-029f188c-955a-42ef-9d93-39ac195f9000 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:58:44 user nova-compute[72773]: WARNING nova.compute.manager [req-5c6c1b12-d396-433c-b209-b80c80f6bdbe req-c5c4f437-f0ac-4112-8b17-15137d143c16 service nova] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Received unexpected event network-vif-plugged-029f188c-955a-42ef-9d93-39ac195f9000 for instance with vm_state deleted and task_state None.
Aug 16 22:58:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:58:58 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692226723.14943, 11552ea0-97b9-48ce-b384-6af3e29cc6e6 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:58:58 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] VM Stopped (Lifecycle Event)
Aug 16 22:58:58 user nova-compute[72773]: DEBUG nova.compute.manager [None req-c57d4635-2a01-48ba-a7c5-16b421fd2d32 None None] [instance: 11552ea0-97b9-48ce-b384-6af3e29cc6e6] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:58:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:59:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:59:05 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:59:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:59:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:59:09 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:59:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "dc40aa11-47e4-4f55-8094-82325cecaed3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:59:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "dc40aa11-47e4-4f55-8094-82325cecaed3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:59:09 user nova-compute[72773]: DEBUG nova.compute.manager [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 22:59:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:59:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:59:09 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 22:59:09 user nova-compute[72773]: INFO nova.compute.claims [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Claim successful on node user
Aug 16 22:59:09 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:59:09 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:59:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.229s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:59:09 user nova-compute[72773]: DEBUG nova.compute.manager [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 22:59:09 user nova-compute[72773]: DEBUG nova.compute.manager [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 22:59:09 user nova-compute[72773]: DEBUG nova.network.neutron [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 22:59:09 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 22:59:09 user nova-compute[72773]: DEBUG nova.compute.manager [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 22:59:09 user nova-compute[72773]: INFO nova.virt.block_device [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Booting with volume 53b49290-0253-4600-b8ac-cffd2b758b67 at /dev/vda
Aug 16 22:59:09 user nova-compute[72773]: DEBUG nova.policy [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f12eb2e28904f63baa1ddce4641e180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cd967e4254cfd9b8aee140f640682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 22:59:09 user nova-compute[72773]: DEBUG os_brick.utils [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:59:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:59:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:59:09 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2663c34d-ee7b-4298-b56a-90d2f97f05d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:59:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:59:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:59:10 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e758f67b-3628-41a0-8e21-422576ad0324]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:59:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:59:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:59:10 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b525dbd7-8e34-4ecd-8281-11be0411c2c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:59:10 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b65859-7676-4047-913e-28bc279af713]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:59:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:59:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:59:10 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 22:59:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:59:10 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 22:59:10 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 22:59:10 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[32df862c-a205-4950-b999-72d67434e13f]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:59:10 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 22:59:10 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 22:59:10 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 22:59:10 user nova-compute[72773]: DEBUG os_brick.utils [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:59:10 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Updating existing volume attachment record: 45a31329-7408-4292-8454-74f3f3556864 {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 22:59:10 user nova-compute[72773]: DEBUG nova.network.neutron [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Successfully created port: a83fafa9-f889-4c34-9461-fa01dd2d02f0 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 22:59:11 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:59:11 user nova-compute[72773]: DEBUG nova.network.neutron [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Successfully updated port: a83fafa9-f889-4c34-9461-fa01dd2d02f0 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 22:59:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "refresh_cache-dc40aa11-47e4-4f55-8094-82325cecaed3" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:59:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquired lock "refresh_cache-dc40aa11-47e4-4f55-8094-82325cecaed3" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:59:11 user nova-compute[72773]: DEBUG nova.network.neutron [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 22:59:11 user nova-compute[72773]: DEBUG nova.compute.manager [req-9b47ead0-e076-44a9-b50b-1c7e8158f1ba req-cd2ed493-2826-4e0d-97df-c4f47d7e4bc0 service nova] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Received event network-changed-a83fafa9-f889-4c34-9461-fa01dd2d02f0 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:59:11 user nova-compute[72773]: DEBUG nova.compute.manager [req-9b47ead0-e076-44a9-b50b-1c7e8158f1ba req-cd2ed493-2826-4e0d-97df-c4f47d7e4bc0 service nova] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Refreshing instance network info cache due to event network-changed-a83fafa9-f889-4c34-9461-fa01dd2d02f0. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 22:59:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9b47ead0-e076-44a9-b50b-1c7e8158f1ba req-cd2ed493-2826-4e0d-97df-c4f47d7e4bc0 service nova] Acquiring lock "refresh_cache-dc40aa11-47e4-4f55-8094-82325cecaed3" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:59:11 user nova-compute[72773]: DEBUG nova.network.neutron [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 22:59:11 user nova-compute[72773]: DEBUG nova.network.neutron [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Updating instance_info_cache with network_info: [{"id": "a83fafa9-f889-4c34-9461-fa01dd2d02f0", "address": "fa:16:3e:9d:0c:f6", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83fafa9-f8", "ovs_interfaceid": "a83fafa9-f889-4c34-9461-fa01dd2d02f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:59:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Releasing lock "refresh_cache-dc40aa11-47e4-4f55-8094-82325cecaed3" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:59:11 user nova-compute[72773]: DEBUG nova.compute.manager [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Instance network_info: |[{"id": "a83fafa9-f889-4c34-9461-fa01dd2d02f0", "address": "fa:16:3e:9d:0c:f6", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83fafa9-f8", "ovs_interfaceid": "a83fafa9-f889-4c34-9461-fa01dd2d02f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 22:59:11 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9b47ead0-e076-44a9-b50b-1c7e8158f1ba req-cd2ed493-2826-4e0d-97df-c4f47d7e4bc0 service nova] Acquired lock "refresh_cache-dc40aa11-47e4-4f55-8094-82325cecaed3" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:59:11 user nova-compute[72773]: DEBUG nova.network.neutron [req-9b47ead0-e076-44a9-b50b-1c7e8158f1ba req-cd2ed493-2826-4e0d-97df-c4f47d7e4bc0 service nova] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Refreshing network info cache for port a83fafa9-f889-4c34-9461-fa01dd2d02f0 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 22:59:12 user nova-compute[72773]: DEBUG nova.network.neutron [req-9b47ead0-e076-44a9-b50b-1c7e8158f1ba req-cd2ed493-2826-4e0d-97df-c4f47d7e4bc0 service nova] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Updated VIF entry in instance network info cache for port a83fafa9-f889-4c34-9461-fa01dd2d02f0. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 22:59:12 user nova-compute[72773]: DEBUG nova.network.neutron [req-9b47ead0-e076-44a9-b50b-1c7e8158f1ba req-cd2ed493-2826-4e0d-97df-c4f47d7e4bc0 service nova] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Updating instance_info_cache with network_info: [{"id": "a83fafa9-f889-4c34-9461-fa01dd2d02f0", "address": "fa:16:3e:9d:0c:f6", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83fafa9-f8", "ovs_interfaceid": "a83fafa9-f889-4c34-9461-fa01dd2d02f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:59:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9b47ead0-e076-44a9-b50b-1c7e8158f1ba req-cd2ed493-2826-4e0d-97df-c4f47d7e4bc0 service nova] Releasing lock "refresh_cache-dc40aa11-47e4-4f55-8094-82325cecaed3" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:59:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:59:15 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:59:16 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:59:16 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 22:59:16 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Rebuilding the list of instances to heal {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 22:59:16 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Skipping network cache update for instance because it is Building. {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 16 22:59:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-363f870e-a6d9-4664-9b9c-c343f3548b31" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 22:59:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-363f870e-a6d9-4664-9b9c-c343f3548b31" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 22:59:16 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 22:59:16 user nova-compute[72773]: DEBUG nova.objects.instance [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lazy-loading 'info_cache' on Instance uuid 363f870e-a6d9-4664-9b9c-c343f3548b31 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:59:16 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Updating instance_info_cache with network_info: [{"id": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "address": "fa:16:3e:43:25:e9", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda5c32fa-d8", "ovs_interfaceid": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 22:59:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-363f870e-a6d9-4664-9b9c-c343f3548b31" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 22:59:16 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 22:59:16 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:59:17 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:59:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:59:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:59:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:59:17 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 22:59:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:59:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:59:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:59:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:59:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:59:18 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:59:18 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:59:18 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=8733MB free_disk=25.39360809326172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 22:59:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:59:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:59:18 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 363f870e-a6d9-4664-9b9c-c343f3548b31 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:59:18 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance dc40aa11-47e4-4f55-8094-82325cecaed3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 22:59:18 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 22:59:18 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 22:59:18 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 22:59:18 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 22:59:18 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 22:59:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.237s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG nova.compute.manager [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 22:59:20 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Creating image(s)
Aug 16 22:59:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Did not create local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Ensure instance console log exists: /opt/stack/data/nova/instances/dc40aa11-47e4-4f55-8094-82325cecaed3/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Start _get_guest_xml network_info=[{"id": "a83fafa9-f889-4c34-9461-fa01dd2d02f0", "address": "fa:16:3e:9d:0c:f6", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83fafa9-f8", "ovs_interfaceid": "a83fafa9-f889-4c34-9461-fa01dd2d02f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '45a31329-7408-4292-8454-74f3f3556864', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTfHvFNP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dc40aa11-47e4-4f55-8094-82325cecaed3', 'attached_at': '', 'detached_at': '', 'volume_id': '53b49290-0253-4600-b8ac-cffd2b758b67', 'serial': '53b49290-0253-4600-b8ac-cffd2b758b67'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 22:59:20 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:59:20 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 22:59:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTfHvFNP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 22:59:20 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:59:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:59:20 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 22:59:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 22:59:20 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2e3f50-3ec2-42ad-9946-2fe57605b778]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 22:59:20 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2318b2a-f9be-488a-bc3d-d786bb0acffc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67] added
Aug 16 22:59:20 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e712cfcc-bb8e-43a4-8050-420aa9391bf8]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda22958-289e-45c4-856e-be498820ad63]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qTfHvFNP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qTfHvFNP" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0198a6f-0795-4b21-b225-e0bc3b2fe964]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qTfHvFNP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e82eeb-b937-4aab-8e4d-a1fbbf39281c]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[332e8a87-058d-4d49-aa79-fe683055c786]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 22:59:20 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 22:59:20 user nova-compute[72773]:  {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:59:20 user nova-compute[72773]: WARNING os_brick.initiator.connectors.iscsi [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 22:59:20 user nova-compute[72773]: 
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0a5842-4e14-4d98-b24e-118339800c03]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67, portal: 172.16.0.220,3260]
Aug 16 22:59:20 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67, portal: 172.16.0.220,3260] successful.
Aug 16 22:59:20 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[382825f7-2c6b-4411-8ec6-8486b9d85ce8]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85fa745-c01d-46ed-805c-c7fef55923e9]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 (non-flash)
Aug 16 22:59:20 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 (non-flash)
Aug 16 22:59:20 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01f3e6c-0b87-407e-b605-00def488a238]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 22:59:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTfHvFNP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 22:59:21 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:59:21 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:59:21 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 22:59:21 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 22:59:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 22:59:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '26237326237353964', 'path': '/dev/sdb'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 22:59:21 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237326237353964', 'path': '/dev/sdb'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 22:59:21 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:59:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1344760515',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1344760515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1344760515',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWoAtdvBZRfe6tB1t5V/+l0ubbrC4BW1rPYZWoMn73jnXuA76yJ3hyK8eQpR/Ekj5OlzXkYPYgr0iUxilvQhGqq8DUZmJ6kR89j8Sz5m6434ZOsX+Q1wSxxjsT4JBCdKQ==',key_name='tempest-keypair-122471341',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a51cd967e4254cfd9b8aee140f640682',ramdisk_id='',reservation_id='r-zt59g8a6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1862722655',owner_user_name='tempest-TestVolumeBootPattern-1862722655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:59:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f12eb2e28904f63baa1ddce4641e180',uuid=dc40aa11-47e4-4f55-8094-82325cecaed3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a83fafa9-f889-4c34-9461-fa01dd2d02f0", "address": "fa:16:3e:9d:0c:f6", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83fafa9-f8", "ovs_interfaceid": "a83fafa9-f889-4c34-9461-fa01dd2d02f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 22:59:21 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converting VIF {"id": "a83fafa9-f889-4c34-9461-fa01dd2d02f0", "address": "fa:16:3e:9d:0c:f6", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83fafa9-f8", "ovs_interfaceid": "a83fafa9-f889-4c34-9461-fa01dd2d02f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:59:21 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:0c:f6,bridge_name='br-int',has_traffic_filtering=True,id=a83fafa9-f889-4c34-9461-fa01dd2d02f0,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa83fafa9-f8') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:59:21 user nova-compute[72773]: DEBUG nova.objects.instance [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lazy-loading 'pci_devices' on Instance uuid dc40aa11-47e4-4f55-8094-82325cecaed3 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 22:59:21 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] End _get_guest_xml xml=<domain type="kvm">
Aug 16 22:59:21 user nova-compute[72773]:   <uuid>dc40aa11-47e4-4f55-8094-82325cecaed3</uuid>
Aug 16 22:59:21 user nova-compute[72773]:   <name>instance-0000002f</name>
Aug 16 22:59:21 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 22:59:21 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 22:59:21 user nova-compute[72773]:   <metadata>
Aug 16 22:59:21 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 22:59:21 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 22:59:21 user nova-compute[72773]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1344760515</nova:name>
Aug 16 22:59:21 user nova-compute[72773]:       <nova:creationTime>2023-08-16 22:59:20</nova:creationTime>
Aug 16 22:59:21 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 22:59:21 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 22:59:21 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 22:59:21 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 22:59:21 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 22:59:21 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 22:59:21 user nova-compute[72773]:       </nova:flavor>
Aug 16 22:59:21 user nova-compute[72773]:       <nova:owner>
Aug 16 22:59:21 user nova-compute[72773]:         <nova:user uuid="3f12eb2e28904f63baa1ddce4641e180">tempest-TestVolumeBootPattern-1862722655-project-member</nova:user>
Aug 16 22:59:21 user nova-compute[72773]:         <nova:project uuid="a51cd967e4254cfd9b8aee140f640682">tempest-TestVolumeBootPattern-1862722655</nova:project>
Aug 16 22:59:21 user nova-compute[72773]:       </nova:owner>
Aug 16 22:59:21 user nova-compute[72773]:       <nova:ports>
Aug 16 22:59:21 user nova-compute[72773]:         <nova:port uuid="a83fafa9-f889-4c34-9461-fa01dd2d02f0">
Aug 16 22:59:21 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 22:59:21 user nova-compute[72773]:         </nova:port>
Aug 16 22:59:21 user nova-compute[72773]:       </nova:ports>
Aug 16 22:59:21 user nova-compute[72773]:     </nova:instance>
Aug 16 22:59:21 user nova-compute[72773]:   </metadata>
Aug 16 22:59:21 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 22:59:21 user nova-compute[72773]:     <system>
Aug 16 22:59:21 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 22:59:21 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 22:59:21 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 22:59:21 user nova-compute[72773]:       <entry name="serial">dc40aa11-47e4-4f55-8094-82325cecaed3</entry>
Aug 16 22:59:21 user nova-compute[72773]:       <entry name="uuid">dc40aa11-47e4-4f55-8094-82325cecaed3</entry>
Aug 16 22:59:21 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 22:59:21 user nova-compute[72773]:     </system>
Aug 16 22:59:21 user nova-compute[72773]:   </sysinfo>
Aug 16 22:59:21 user nova-compute[72773]:   <os>
Aug 16 22:59:21 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 22:59:21 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 22:59:21 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 22:59:21 user nova-compute[72773]:   </os>
Aug 16 22:59:21 user nova-compute[72773]:   <features>
Aug 16 22:59:21 user nova-compute[72773]:     <acpi/>
Aug 16 22:59:21 user nova-compute[72773]:     <apic/>
Aug 16 22:59:21 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 22:59:21 user nova-compute[72773]:   </features>
Aug 16 22:59:21 user nova-compute[72773]:   <clock offset="utc">
Aug 16 22:59:21 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 22:59:21 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 22:59:21 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 22:59:21 user nova-compute[72773]:   </clock>
Aug 16 22:59:21 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 22:59:21 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 22:59:21 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 22:59:21 user nova-compute[72773]:   </cpu>
Aug 16 22:59:21 user nova-compute[72773]:   <devices>
Aug 16 22:59:21 user nova-compute[72773]:     <disk type="block" device="disk">
Aug 16 22:59:21 user nova-compute[72773]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 22:59:21 user nova-compute[72773]:       <source dev="/dev/sdb"/>
Aug 16 22:59:21 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 22:59:21 user nova-compute[72773]:       <serial>53b49290-0253-4600-b8ac-cffd2b758b67</serial>
Aug 16 22:59:21 user nova-compute[72773]:     </disk>
Aug 16 22:59:21 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 22:59:21 user nova-compute[72773]:       <mac address="fa:16:3e:9d:0c:f6"/>
Aug 16 22:59:21 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:59:21 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 22:59:21 user nova-compute[72773]:       <target dev="tapa83fafa9-f8"/>
Aug 16 22:59:21 user nova-compute[72773]:     </interface>
Aug 16 22:59:21 user nova-compute[72773]:     <serial type="pty">
Aug 16 22:59:21 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/dc40aa11-47e4-4f55-8094-82325cecaed3/console.log" append="off"/>
Aug 16 22:59:21 user nova-compute[72773]:     </serial>
Aug 16 22:59:21 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 22:59:21 user nova-compute[72773]:     <video>
Aug 16 22:59:21 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 22:59:21 user nova-compute[72773]:     </video>
Aug 16 22:59:21 user nova-compute[72773]:     <rng model="virtio">
Aug 16 22:59:21 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 22:59:21 user nova-compute[72773]:     </rng>
Aug 16 22:59:21 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 22:59:21 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 22:59:21 user nova-compute[72773]:       <stats period="10"/>
Aug 16 22:59:21 user nova-compute[72773]:     </memballoon>
Aug 16 22:59:21 user nova-compute[72773]:   </devices>
Aug 16 22:59:21 user nova-compute[72773]: </domain>
Aug 16 22:59:21 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 22:59:21 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:59:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1344760515',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1344760515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1344760515',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWoAtdvBZRfe6tB1t5V/+l0ubbrC4BW1rPYZWoMn73jnXuA76yJ3hyK8eQpR/Ekj5OlzXkYPYgr0iUxilvQhGqq8DUZmJ6kR89j8Sz5m6434ZOsX+Q1wSxxjsT4JBCdKQ==',key_name='tempest-keypair-122471341',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a51cd967e4254cfd9b8aee140f640682',ramdisk_id='',reservation_id='r-zt59g8a6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1862722655',owner_user_name='tempest-TestVolumeBootPattern-1862722655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T22:59:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f12eb2e28904f63baa1ddce4641e180',uuid=dc40aa11-47e4-4f55-8094-82325cecaed3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a83fafa9-f889-4c34-9461-fa01dd2d02f0", "address": "fa:16:3e:9d:0c:f6", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83fafa9-f8", "ovs_interfaceid": "a83fafa9-f889-4c34-9461-fa01dd2d02f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 22:59:21 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converting VIF {"id": "a83fafa9-f889-4c34-9461-fa01dd2d02f0", "address": "fa:16:3e:9d:0c:f6", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83fafa9-f8", "ovs_interfaceid": "a83fafa9-f889-4c34-9461-fa01dd2d02f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 22:59:21 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:0c:f6,bridge_name='br-int',has_traffic_filtering=True,id=a83fafa9-f889-4c34-9461-fa01dd2d02f0,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa83fafa9-f8') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 22:59:21 user nova-compute[72773]: DEBUG os_vif [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:0c:f6,bridge_name='br-int',has_traffic_filtering=True,id=a83fafa9-f889-4c34-9461-fa01dd2d02f0,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa83fafa9-f8') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 22:59:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:59:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:59:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 22:59:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:59:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa83fafa9-f8, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:59:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa83fafa9-f8, col_values=(('external_ids', {'iface-id': 'a83fafa9-f889-4c34-9461-fa01dd2d02f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:0c:f6', 'vm-uuid': 'dc40aa11-47e4-4f55-8094-82325cecaed3'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 22:59:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:59:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:59:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:59:21 user nova-compute[72773]: INFO os_vif [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:0c:f6,bridge_name='br-int',has_traffic_filtering=True,id=a83fafa9-f889-4c34-9461-fa01dd2d02f0,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa83fafa9-f8')
Aug 16 22:59:21 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 22:59:21 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] No VIF found with MAC fa:16:3e:9d:0c:f6, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 22:59:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:59:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:59:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:59:23 user nova-compute[72773]: DEBUG nova.compute.manager [req-60bd4a25-776b-4f79-b16b-b02bc1ec33cd req-fa525f23-a01f-45c2-8dab-f785624a72a3 service nova] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Received event network-vif-plugged-a83fafa9-f889-4c34-9461-fa01dd2d02f0 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:59:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-60bd4a25-776b-4f79-b16b-b02bc1ec33cd req-fa525f23-a01f-45c2-8dab-f785624a72a3 service nova] Acquiring lock "dc40aa11-47e4-4f55-8094-82325cecaed3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:59:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-60bd4a25-776b-4f79-b16b-b02bc1ec33cd req-fa525f23-a01f-45c2-8dab-f785624a72a3 service nova] Lock "dc40aa11-47e4-4f55-8094-82325cecaed3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:59:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-60bd4a25-776b-4f79-b16b-b02bc1ec33cd req-fa525f23-a01f-45c2-8dab-f785624a72a3 service nova] Lock "dc40aa11-47e4-4f55-8094-82325cecaed3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:59:23 user nova-compute[72773]: DEBUG nova.compute.manager [req-60bd4a25-776b-4f79-b16b-b02bc1ec33cd req-fa525f23-a01f-45c2-8dab-f785624a72a3 service nova] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] No waiting events found dispatching network-vif-plugged-a83fafa9-f889-4c34-9461-fa01dd2d02f0 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:59:23 user nova-compute[72773]: WARNING nova.compute.manager [req-60bd4a25-776b-4f79-b16b-b02bc1ec33cd req-fa525f23-a01f-45c2-8dab-f785624a72a3 service nova] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Received unexpected event network-vif-plugged-a83fafa9-f889-4c34-9461-fa01dd2d02f0 for instance with vm_state building and task_state spawning.
Aug 16 22:59:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:59:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:59:25 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692226765.2246668, dc40aa11-47e4-4f55-8094-82325cecaed3 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:59:25 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] VM Resumed (Lifecycle Event)
Aug 16 22:59:25 user nova-compute[72773]: DEBUG nova.compute.manager [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 22:59:25 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 22:59:25 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Instance spawned successfully.
Aug 16 22:59:25 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 22:59:25 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:59:25 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:59:25 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:59:25 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:59:25 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:59:25 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:59:25 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:59:25 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 22:59:25 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:59:25 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692226765.2277188, dc40aa11-47e4-4f55-8094-82325cecaed3 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 22:59:25 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] VM Started (Lifecycle Event)
Aug 16 22:59:25 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:59:25 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 22:59:25 user nova-compute[72773]: DEBUG nova.compute.manager [req-0b51dbb0-bdee-4c13-bbae-824046ed95b2 req-96b7a5e5-771b-4777-abdb-7a764300b2bd service nova] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Received event network-vif-plugged-a83fafa9-f889-4c34-9461-fa01dd2d02f0 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 22:59:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0b51dbb0-bdee-4c13-bbae-824046ed95b2 req-96b7a5e5-771b-4777-abdb-7a764300b2bd service nova] Acquiring lock "dc40aa11-47e4-4f55-8094-82325cecaed3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 22:59:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0b51dbb0-bdee-4c13-bbae-824046ed95b2 req-96b7a5e5-771b-4777-abdb-7a764300b2bd service nova] Lock "dc40aa11-47e4-4f55-8094-82325cecaed3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 22:59:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0b51dbb0-bdee-4c13-bbae-824046ed95b2 req-96b7a5e5-771b-4777-abdb-7a764300b2bd service nova] Lock "dc40aa11-47e4-4f55-8094-82325cecaed3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:59:25 user nova-compute[72773]: DEBUG nova.compute.manager [req-0b51dbb0-bdee-4c13-bbae-824046ed95b2 req-96b7a5e5-771b-4777-abdb-7a764300b2bd service nova] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] No waiting events found dispatching network-vif-plugged-a83fafa9-f889-4c34-9461-fa01dd2d02f0 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 22:59:25 user nova-compute[72773]: WARNING nova.compute.manager [req-0b51dbb0-bdee-4c13-bbae-824046ed95b2 req-96b7a5e5-771b-4777-abdb-7a764300b2bd service nova] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Received unexpected event network-vif-plugged-a83fafa9-f889-4c34-9461-fa01dd2d02f0 for instance with vm_state building and task_state spawning.
Aug 16 22:59:25 user nova-compute[72773]: INFO nova.compute.manager [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Took 5.01 seconds to spawn the instance on the hypervisor.
Aug 16 22:59:25 user nova-compute[72773]: DEBUG nova.compute.manager [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 22:59:25 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 22:59:25 user nova-compute[72773]: INFO nova.compute.manager [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Took 15.92 seconds to build instance.
Aug 16 22:59:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-f6b6ae6d-762a-43c9-a5bd-20d6577d082c tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "dc40aa11-47e4-4f55-8094-82325cecaed3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.026s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 22:59:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:59:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:59:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:59:36 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 22:59:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:59:41 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:59:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:59:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:59:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:59:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:59:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:59:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 22:59:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:06 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:00:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:00:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "363f870e-a6d9-4664-9b9c-c343f3548b31" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:00:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:00:09 user nova-compute[72773]: DEBUG nova.objects.instance [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lazy-loading 'flavor' on Instance uuid 363f870e-a6d9-4664-9b9c-c343f3548b31 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:00:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:00:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "363f870e-a6d9-4664-9b9c-c343f3548b31" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:00:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:00:09 user nova-compute[72773]: INFO nova.compute.manager [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Attaching volume c6573055-49c0-4591-b1c1-0b3755121014 to /dev/vdb
Aug 16 23:00:09 user nova-compute[72773]: DEBUG os_brick.utils [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 23:00:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:09 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba52abc4-29be-463e-b432-7e49b091529b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:09 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bb8aaf-5ae9-48fa-9e2a-5ee845c3132f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:09 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2ddc12-6f9a-4ae4-8565-03f7dc51c4fd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:09 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecb9ea6-8750-4b2a-a687-9d2ba994dfe2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 23:00:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 23:00:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:09 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 23:00:09 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 23:00:09 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c4666b-975f-4c0e-80eb-c1cd049ceb05]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 23:00:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 23:00:09 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 23:00:09 user nova-compute[72773]: DEBUG os_brick.utils [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 23:00:09 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Updating existing volume attachment record: 911c6a6b-6f72-4d8e-9003-57163e2abc95 {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 23:00:10 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:00:11 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:00:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:00:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:00:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:00:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:00:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:17 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:00:17 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 23:00:17 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Rebuilding the list of instances to heal {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 23:00:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-363f870e-a6d9-4664-9b9c-c343f3548b31" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:00:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-363f870e-a6d9-4664-9b9c-c343f3548b31" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:00:17 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 23:00:17 user nova-compute[72773]: DEBUG nova.objects.instance [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lazy-loading 'info_cache' on Instance uuid 363f870e-a6d9-4664-9b9c-c343f3548b31 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:00:18 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Updating instance_info_cache with network_info: [{"id": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "address": "fa:16:3e:43:25:e9", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda5c32fa-d8", "ovs_interfaceid": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:00:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-363f870e-a6d9-4664-9b9c-c343f3548b31" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:00:18 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 23:00:18 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:00:18 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:00:18 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:00:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:00:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:00:18 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:00:18 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 23:00:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:18 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:18 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 23:00:19 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:00:19 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:00:19 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=8627MB free_disk=25.390758514404297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 23:00:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:00:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:00:19 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 363f870e-a6d9-4664-9b9c-c343f3548b31 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 23:00:19 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance dc40aa11-47e4-4f55-8094-82325cecaed3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 23:00:19 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 23:00:19 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 23:00:19 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:00:19 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:00:19 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 23:00:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASwMcPFl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 23:00:20 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 23:00:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 23:00:20 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 23:00:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 23:00:20 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 23:00:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7241696-823e-40ee-81e7-f59741736d9e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 23:00:20 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0719608c-e94c-4943-a13a-1da699e13890]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014] added
Aug 16 23:00:20 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c7d2fa-7f80-4af2-935c-f64a220db2a3]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[24814012-3690-4c4b-ad28-f587cce79a95]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ASwMcPFl {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ASwMcPFl" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f94cad-7bfc-4325-9a66-dc8212dfeb13]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ASwMcPFl'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd7f9d3-73b8-455d-ae3f-0a4283a303db]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[52214659-4a38-4977-bcc8-e294d57ced00]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 (non-flash)
Aug 16 23:00:20 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 (non-flash)
Aug 16 23:00:20 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[103c2b60-b257-4c7a-a152-8a6e06c3eaa6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014, portal: 172.16.0.220,3260]
Aug 16 23:00:20 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014, portal: 172.16.0.220,3260] successful.
Aug 16 23:00:20 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44d9276-0c8a-4092-ac0d-72655f148dbd]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ea43da-375a-4b28-8618-e0c0976b9e8f]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 (non-flash)
Aug 16 23:00:20 user nova-compute[72773]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 (non-flash)
Aug 16 23:00:20 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 (non-flash)
Aug 16 23:00:20 user nova-compute[72773]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 (non-flash)
Aug 16 23:00:20 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a00cbd6-6f3d-4f61-a744-a1a59824c1fb]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:20 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: None {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 23:00:21 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 23:00:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASwMcPFl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 23:00:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 23:00:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26536633434623038', 'path': '/dev/sdc'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 23:00:21 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536633434623038', 'path': '/dev/sdc'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 23:00:21 user nova-compute[72773]: DEBUG nova.objects.instance [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lazy-loading 'flavor' on Instance uuid 363f870e-a6d9-4664-9b9c-c343f3548b31 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:00:21 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 23:00:21 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 23:00:21 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 23:00:21 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 23:00:21 user nova-compute[72773]:   <serial>c6573055-49c0-4591-b1c1-0b3755121014</serial>
Aug 16 23:00:21 user nova-compute[72773]: </disk>
Aug 16 23:00:21 user nova-compute[72773]:  {{(pid=72773) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 23:00:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:21 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 23:00:21 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 23:00:21 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] No VIF found with MAC fa:16:3e:43:25:e9, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 23:00:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a1ec058a-4eb4-468a-89af-72d858cfd6c5 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.509s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:00:22 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:00:22 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:00:22 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 23:00:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:00:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:33 user nova-compute[72773]: DEBUG nova.compute.manager [req-731b45c5-5ba9-4b8c-bc5d-cb33a4abe460 req-4c83922f-c607-4265-8279-717cbbdb5f40 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Received event network-changed-da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:00:33 user nova-compute[72773]: DEBUG nova.compute.manager [req-731b45c5-5ba9-4b8c-bc5d-cb33a4abe460 req-4c83922f-c607-4265-8279-717cbbdb5f40 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Refreshing instance network info cache due to event network-changed-da5c32fa-d87d-47dc-8c64-1a4858645ade. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 23:00:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-731b45c5-5ba9-4b8c-bc5d-cb33a4abe460 req-4c83922f-c607-4265-8279-717cbbdb5f40 service nova] Acquiring lock "refresh_cache-363f870e-a6d9-4664-9b9c-c343f3548b31" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:00:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-731b45c5-5ba9-4b8c-bc5d-cb33a4abe460 req-4c83922f-c607-4265-8279-717cbbdb5f40 service nova] Acquired lock "refresh_cache-363f870e-a6d9-4664-9b9c-c343f3548b31" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:00:33 user nova-compute[72773]: DEBUG nova.network.neutron [req-731b45c5-5ba9-4b8c-bc5d-cb33a4abe460 req-4c83922f-c607-4265-8279-717cbbdb5f40 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Refreshing network info cache for port da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 23:00:34 user nova-compute[72773]: DEBUG nova.network.neutron [req-731b45c5-5ba9-4b8c-bc5d-cb33a4abe460 req-4c83922f-c607-4265-8279-717cbbdb5f40 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Updated VIF entry in instance network info cache for port da5c32fa-d87d-47dc-8c64-1a4858645ade. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 23:00:34 user nova-compute[72773]: DEBUG nova.network.neutron [req-731b45c5-5ba9-4b8c-bc5d-cb33a4abe460 req-4c83922f-c607-4265-8279-717cbbdb5f40 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Updating instance_info_cache with network_info: [{"id": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "address": "fa:16:3e:43:25:e9", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda5c32fa-d8", "ovs_interfaceid": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:00:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-731b45c5-5ba9-4b8c-bc5d-cb33a4abe460 req-4c83922f-c607-4265-8279-717cbbdb5f40 service nova] Releasing lock "refresh_cache-363f870e-a6d9-4664-9b9c-c343f3548b31" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:00:35 user nova-compute[72773]: DEBUG nova.compute.manager [req-e04613ca-50f5-4399-b398-66607830a5a4 req-7aa45a86-2127-4190-ac4f-397cf2944790 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Received event network-changed-da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:00:35 user nova-compute[72773]: DEBUG nova.compute.manager [req-e04613ca-50f5-4399-b398-66607830a5a4 req-7aa45a86-2127-4190-ac4f-397cf2944790 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Refreshing instance network info cache due to event network-changed-da5c32fa-d87d-47dc-8c64-1a4858645ade. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 23:00:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e04613ca-50f5-4399-b398-66607830a5a4 req-7aa45a86-2127-4190-ac4f-397cf2944790 service nova] Acquiring lock "refresh_cache-363f870e-a6d9-4664-9b9c-c343f3548b31" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:00:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e04613ca-50f5-4399-b398-66607830a5a4 req-7aa45a86-2127-4190-ac4f-397cf2944790 service nova] Acquired lock "refresh_cache-363f870e-a6d9-4664-9b9c-c343f3548b31" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:00:35 user nova-compute[72773]: DEBUG nova.network.neutron [req-e04613ca-50f5-4399-b398-66607830a5a4 req-7aa45a86-2127-4190-ac4f-397cf2944790 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Refreshing network info cache for port da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 23:00:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:36 user nova-compute[72773]: DEBUG nova.network.neutron [req-e04613ca-50f5-4399-b398-66607830a5a4 req-7aa45a86-2127-4190-ac4f-397cf2944790 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Updated VIF entry in instance network info cache for port da5c32fa-d87d-47dc-8c64-1a4858645ade. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 23:00:36 user nova-compute[72773]: DEBUG nova.network.neutron [req-e04613ca-50f5-4399-b398-66607830a5a4 req-7aa45a86-2127-4190-ac4f-397cf2944790 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Updating instance_info_cache with network_info: [{"id": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "address": "fa:16:3e:43:25:e9", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda5c32fa-d8", "ovs_interfaceid": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:00:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e04613ca-50f5-4399-b398-66607830a5a4 req-7aa45a86-2127-4190-ac4f-397cf2944790 service nova] Releasing lock "refresh_cache-363f870e-a6d9-4664-9b9c-c343f3548b31" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:00:36 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:40 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:00:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:00:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:00:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:00:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:00:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:00:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:00:40 user nova-compute[72773]: DEBUG nova.virt.libvirt.imagecache [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Verify base images {{(pid=72773) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 16 23:00:40 user nova-compute[72773]: DEBUG nova.virt.libvirt.imagecache [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72773) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 16 23:00:40 user nova-compute[72773]: DEBUG nova.virt.libvirt.imagecache [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Image id 55396c78-d108-4d39-b9f2-7ba759f49030 yields fingerprint 0dfed614ad2ff93c1fc5c734a13d40bde8266518 {{(pid=72773) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 16 23:00:40 user nova-compute[72773]: INFO nova.virt.libvirt.imagecache [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] image 55396c78-d108-4d39-b9f2-7ba759f49030 at (/opt/stack/data/nova/instances/_base/0dfed614ad2ff93c1fc5c734a13d40bde8266518): checking
Aug 16 23:00:40 user nova-compute[72773]: DEBUG nova.virt.libvirt.imagecache [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] image 55396c78-d108-4d39-b9f2-7ba759f49030 at (/opt/stack/data/nova/instances/_base/0dfed614ad2ff93c1fc5c734a13d40bde8266518): image is in use {{(pid=72773) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 16 23:00:40 user nova-compute[72773]: DEBUG nova.virt.libvirt.imagecache [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] dc40aa11-47e4-4f55-8094-82325cecaed3 is a valid instance name {{(pid=72773) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 16 23:00:40 user nova-compute[72773]: DEBUG nova.virt.libvirt.imagecache [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] 363f870e-a6d9-4664-9b9c-c343f3548b31 is a valid instance name {{(pid=72773) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 16 23:00:40 user nova-compute[72773]: DEBUG nova.virt.libvirt.imagecache [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] 363f870e-a6d9-4664-9b9c-c343f3548b31 has a disk file {{(pid=72773) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 16 23:00:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:40 user nova-compute[72773]: DEBUG nova.virt.libvirt.imagecache [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 363f870e-a6d9-4664-9b9c-c343f3548b31 is backed by 0dfed614ad2ff93c1fc5c734a13d40bde8266518 {{(pid=72773) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 16 23:00:40 user nova-compute[72773]: WARNING nova.virt.libvirt.imagecache [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Unknown base file: /opt/stack/data/nova/instances/_base/06a1866ee7918873e677d6d728d1385e21ba0f18
Aug 16 23:00:40 user nova-compute[72773]: WARNING nova.virt.libvirt.imagecache [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Unknown base file: /opt/stack/data/nova/instances/_base/f0c0069c3c98713e72e1c1a0d04a94d87c3526d3
Aug 16 23:00:40 user nova-compute[72773]: WARNING nova.virt.libvirt.imagecache [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Unknown base file: /opt/stack/data/nova/instances/_base/83bf6137b50f2656dc5bb4401cfa67393d062e4d
Aug 16 23:00:40 user nova-compute[72773]: WARNING nova.virt.libvirt.imagecache [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Unknown base file: /opt/stack/data/nova/instances/_base/085bd8ad901e45dc23b33542fe35a78ff43c5f0a
Aug 16 23:00:40 user nova-compute[72773]: WARNING nova.virt.libvirt.imagecache [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Unknown base file: /opt/stack/data/nova/instances/_base/653fcf975985dfeae77909d2c081423d4b1d0d21
Aug 16 23:00:40 user nova-compute[72773]: WARNING nova.virt.libvirt.imagecache [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Unknown base file: /opt/stack/data/nova/instances/_base/d12b9dea1355878c9993ea3318dabe2f1b626dbe
Aug 16 23:00:40 user nova-compute[72773]: WARNING nova.virt.libvirt.imagecache [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Unknown base file: /opt/stack/data/nova/instances/_base/2d6dba68d0e5e8e46c780821637dacd24f834fcf
Aug 16 23:00:40 user nova-compute[72773]: WARNING nova.virt.libvirt.imagecache [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Unknown base file: /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380
Aug 16 23:00:40 user nova-compute[72773]: INFO nova.virt.libvirt.imagecache [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Active base files: /opt/stack/data/nova/instances/_base/0dfed614ad2ff93c1fc5c734a13d40bde8266518
Aug 16 23:00:40 user nova-compute[72773]: INFO nova.virt.libvirt.imagecache [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Removable base files: /opt/stack/data/nova/instances/_base/06a1866ee7918873e677d6d728d1385e21ba0f18 /opt/stack/data/nova/instances/_base/f0c0069c3c98713e72e1c1a0d04a94d87c3526d3 /opt/stack/data/nova/instances/_base/83bf6137b50f2656dc5bb4401cfa67393d062e4d /opt/stack/data/nova/instances/_base/085bd8ad901e45dc23b33542fe35a78ff43c5f0a /opt/stack/data/nova/instances/_base/653fcf975985dfeae77909d2c081423d4b1d0d21 /opt/stack/data/nova/instances/_base/d12b9dea1355878c9993ea3318dabe2f1b626dbe /opt/stack/data/nova/instances/_base/2d6dba68d0e5e8e46c780821637dacd24f834fcf /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380
Aug 16 23:00:40 user nova-compute[72773]: INFO nova.virt.libvirt.imagecache [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/06a1866ee7918873e677d6d728d1385e21ba0f18
Aug 16 23:00:40 user nova-compute[72773]: INFO nova.virt.libvirt.imagecache [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f0c0069c3c98713e72e1c1a0d04a94d87c3526d3
Aug 16 23:00:40 user nova-compute[72773]: INFO nova.virt.libvirt.imagecache [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/83bf6137b50f2656dc5bb4401cfa67393d062e4d
Aug 16 23:00:40 user nova-compute[72773]: INFO nova.virt.libvirt.imagecache [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/085bd8ad901e45dc23b33542fe35a78ff43c5f0a
Aug 16 23:00:40 user nova-compute[72773]: INFO nova.virt.libvirt.imagecache [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/653fcf975985dfeae77909d2c081423d4b1d0d21
Aug 16 23:00:40 user nova-compute[72773]: INFO nova.virt.libvirt.imagecache [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d12b9dea1355878c9993ea3318dabe2f1b626dbe
Aug 16 23:00:40 user nova-compute[72773]: INFO nova.virt.libvirt.imagecache [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2d6dba68d0e5e8e46c780821637dacd24f834fcf
Aug 16 23:00:40 user nova-compute[72773]: INFO nova.virt.libvirt.imagecache [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380
Aug 16 23:00:40 user nova-compute[72773]: DEBUG nova.virt.libvirt.imagecache [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Verification complete {{(pid=72773) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 16 23:00:40 user nova-compute[72773]: DEBUG nova.virt.libvirt.imagecache [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Verify swap images {{(pid=72773) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 16 23:00:40 user nova-compute[72773]: DEBUG nova.virt.libvirt.imagecache [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Verify ephemeral images {{(pid=72773) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 16 23:00:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:41 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "363f870e-a6d9-4664-9b9c-c343f3548b31" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:00:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:00:41 user nova-compute[72773]: INFO nova.compute.manager [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Rebooting instance
Aug 16 23:00:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "refresh_cache-363f870e-a6d9-4664-9b9c-c343f3548b31" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:00:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquired lock "refresh_cache-363f870e-a6d9-4664-9b9c-c343f3548b31" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:00:41 user nova-compute[72773]: DEBUG nova.network.neutron [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 23:00:42 user nova-compute[72773]: DEBUG nova.network.neutron [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Updating instance_info_cache with network_info: [{"id": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "address": "fa:16:3e:43:25:e9", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda5c32fa-d8", "ovs_interfaceid": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:00:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Releasing lock "refresh_cache-363f870e-a6d9-4664-9b9c-c343f3548b31" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:00:42 user nova-compute[72773]: DEBUG nova.compute.manager [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 23:00:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:42 user nova-compute[72773]: DEBUG nova.compute.manager [req-3ddadd02-01e1-47c1-bfdc-1ba0a0b7e399 req-3bc605f3-6855-4051-8c55-acadacb22f9f service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Received event network-vif-unplugged-da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:00:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3ddadd02-01e1-47c1-bfdc-1ba0a0b7e399 req-3bc605f3-6855-4051-8c55-acadacb22f9f service nova] Acquiring lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:00:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3ddadd02-01e1-47c1-bfdc-1ba0a0b7e399 req-3bc605f3-6855-4051-8c55-acadacb22f9f service nova] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:00:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-3ddadd02-01e1-47c1-bfdc-1ba0a0b7e399 req-3bc605f3-6855-4051-8c55-acadacb22f9f service nova] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:00:42 user nova-compute[72773]: DEBUG nova.compute.manager [req-3ddadd02-01e1-47c1-bfdc-1ba0a0b7e399 req-3bc605f3-6855-4051-8c55-acadacb22f9f service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] No waiting events found dispatching network-vif-unplugged-da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:00:42 user nova-compute[72773]: WARNING nova.compute.manager [req-3ddadd02-01e1-47c1-bfdc-1ba0a0b7e399 req-3bc605f3-6855-4051-8c55-acadacb22f9f service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Received unexpected event network-vif-unplugged-da5c32fa-d87d-47dc-8c64-1a4858645ade for instance with vm_state active and task_state reboot_started_hard.
Aug 16 23:00:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:43 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Instance destroyed successfully.
Aug 16 23:00:43 user nova-compute[72773]: DEBUG nova.objects.instance [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lazy-loading 'resources' on Instance uuid 363f870e-a6d9-4664-9b9c-c343f3548b31 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:58:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1929886723',display_name='tempest-TestMinimumBasicScenario-server-1929886723',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1929886723',id=46,image_ref='55396c78-d108-4d39-b9f2-7ba759f49030',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI402WRvzhHoWPlxJnK+49US+Dx0HFSoQpX0AVquPP6MN6mleC061OydIxKJZzm2AkNdqosEj7vZy2cxiyzg4zIOJkhRtfytxqslKlLgcdQwsAvlZWqlzYIUpZ5DKe1TIw==',key_name='tempest-TestMinimumBasicScenario-127360055',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:58:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de13176691174b7eab7cb53a49df2933',ramdisk_id='',reservation_id='r-544u47jf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='55396c78-d108-4d39-b9f2-7ba759f49030',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1869730972',owner_user_name='tempest-TestMinimumBasicScenario-1869730972-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T23:00:42Z,user_data=None,user_id='4d71f078c09c449ca7747a74d5bfb138',uuid=363f870e-a6d9-4664-9b9c-c343f3548b31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "address": "fa:16:3e:43:25:e9", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda5c32fa-d8", "ovs_interfaceid": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Converting VIF {"id": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "address": "fa:16:3e:43:25:e9", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda5c32fa-d8", "ovs_interfaceid": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:25:e9,bridge_name='br-int',has_traffic_filtering=True,id=da5c32fa-d87d-47dc-8c64-1a4858645ade,network=Network(206eb708-434c-424b-86c4-5f958178361d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda5c32fa-d8') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_vif [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:25:e9,bridge_name='br-int',has_traffic_filtering=True,id=da5c32fa-d87d-47dc-8c64-1a4858645ade,network=Network(206eb708-434c-424b-86c4-5f958178361d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda5c32fa-d8') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda5c32fa-d8, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:00:43 user nova-compute[72773]: INFO os_vif [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:25:e9,bridge_name='br-int',has_traffic_filtering=True,id=da5c32fa-d87d-47dc-8c64-1a4858645ade,network=Network(206eb708-434c-424b-86c4-5f958178361d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda5c32fa-d8')
Aug 16 23:00:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASwMcPFl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 23:00:43 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[85774576-71e9-4ee8-ba4f-b7e4f70a46bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0194302f-37ca-42c5-a9f0-ab48ff5d9ce8]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 (non-flash)
Aug 16 23:00:43 user nova-compute[72773]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 (non-flash)
Aug 16 23:00:43 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 (non-flash)
Aug 16 23:00:43 user nova-compute[72773]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 (non-flash)
Aug 16 23:00:43 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef802ba0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014'): ({'sdc'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Removing single pathed devices sdc {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a703e566-c682-4016-ac9c-d77a4bbdb205]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.031s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b06cd0e-2c1a-47c0-87a4-4594de4c7c9f]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Flushing IO for device /dev/sdc {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2877e50a-86f3-40cf-ac71-bba396c5d87d]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2c6caa-678e-46c7-b314-314de9656cce]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6ac864-9cfd-44d5-9acb-9abe120b973e]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d316f2f-c606-496b-a4fa-ec01ad6892f2]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014, portal: 172.16.0.220,3260]
Aug 16 23:00:43 user nova-compute[72773]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014, portal: 172.16.0.220,3260] successful.
Aug 16 23:00:43 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa7585f-d6f1-4e38-9502-b16daab0c416]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] <== disconnect_volume: return (284ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Start _get_guest_xml network_info=[{"id": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "address": "fa:16:3e:43:25:e9", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda5c32fa-d8", "ovs_interfaceid": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=55396c78-d108-4d39-b9f2-7ba759f49030,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '55396c78-d108-4d39-b9f2-7ba759f49030'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '911c6a6b-6f72-4d8e-9003-57163e2abc95', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASwMcPFl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '363f870e-a6d9-4664-9b9c-c343f3548b31', 'attached_at': '', 'detached_at': '', 'volume_id': 'c6573055-49c0-4591-b1c1-0b3755121014', 'serial': 'c6573055-49c0-4591-b1c1-0b3755121014'}, 'mount_device': '/dev/vdb', 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 23:00:43 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:00:43 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:00:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=55396c78-d108-4d39-b9f2-7ba759f49030,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG nova.objects.instance [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lazy-loading 'vcpu_model' on Instance uuid 363f870e-a6d9-4664-9b9c-c343f3548b31 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASwMcPFl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 23:00:43 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 23:00:43 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 23:00:43 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e28359-269f-46cd-8807-5d0d51431857]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 23:00:43 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cae1f15-04c3-45b6-b022-178084766688]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014] added
Aug 16 23:00:43 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7bfb38-ee6d-4d96-b5b7-94a99d6e176c]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed4a30b-f4fe-4e95-9cbe-4adac3ed8b20]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ASwMcPFl {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ASwMcPFl" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c647df6-2110-47a3-b394-a2587df1cc0c]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ASwMcPFl'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0452b695-05b0-4fe7-a104-59d7d44bb4cd]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d31ad00-873e-4163-95ee-3abfac6da07a]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 (non-flash)
Aug 16 23:00:43 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 (non-flash)
Aug 16 23:00:43 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[98218833-8ce3-452b-aa08-e5a1b2b19ae6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014, portal: 172.16.0.220,3260]
Aug 16 23:00:43 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014, portal: 172.16.0.220,3260] successful.
Aug 16 23:00:43 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1114d709-fb35-4549-ac22-005a725a3629]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5385f424-ca62-42cb-9f5f-51766f41b540]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 (non-flash)
Aug 16 23:00:43 user nova-compute[72773]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 (non-flash)
Aug 16 23:00:43 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 (non-flash)
Aug 16 23:00:43 user nova-compute[72773]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 (non-flash)
Aug 16 23:00:43 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 23:00:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:44 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:44 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce9eac0-2639-419a-90dc-b79a215929b0]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:00:44 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 23:00:44 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASwMcPFl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 23:00:44 user nova-compute[72773]: DEBUG nova.compute.manager [req-97d0bbd6-d750-46de-b118-449a9f6296f7 req-e213714c-e072-4a07-a250-9c57978ae377 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Received event network-vif-plugged-da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:00:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-97d0bbd6-d750-46de-b118-449a9f6296f7 req-e213714c-e072-4a07-a250-9c57978ae377 service nova] Acquiring lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:00:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-97d0bbd6-d750-46de-b118-449a9f6296f7 req-e213714c-e072-4a07-a250-9c57978ae377 service nova] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:00:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-97d0bbd6-d750-46de-b118-449a9f6296f7 req-e213714c-e072-4a07-a250-9c57978ae377 service nova] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:00:44 user nova-compute[72773]: DEBUG nova.compute.manager [req-97d0bbd6-d750-46de-b118-449a9f6296f7 req-e213714c-e072-4a07-a250-9c57978ae377 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] No waiting events found dispatching network-vif-plugged-da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:00:44 user nova-compute[72773]: WARNING nova.compute.manager [req-97d0bbd6-d750-46de-b118-449a9f6296f7 req-e213714c-e072-4a07-a250-9c57978ae377 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Received unexpected event network-vif-plugged-da5c32fa-d87d-47dc-8c64-1a4858645ade for instance with vm_state active and task_state reboot_started_hard.
Aug 16 23:00:44 user nova-compute[72773]: DEBUG nova.compute.manager [req-97d0bbd6-d750-46de-b118-449a9f6296f7 req-e213714c-e072-4a07-a250-9c57978ae377 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Received event network-vif-plugged-da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:00:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-97d0bbd6-d750-46de-b118-449a9f6296f7 req-e213714c-e072-4a07-a250-9c57978ae377 service nova] Acquiring lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:00:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-97d0bbd6-d750-46de-b118-449a9f6296f7 req-e213714c-e072-4a07-a250-9c57978ae377 service nova] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:00:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-97d0bbd6-d750-46de-b118-449a9f6296f7 req-e213714c-e072-4a07-a250-9c57978ae377 service nova] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:00:44 user nova-compute[72773]: DEBUG nova.compute.manager [req-97d0bbd6-d750-46de-b118-449a9f6296f7 req-e213714c-e072-4a07-a250-9c57978ae377 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] No waiting events found dispatching network-vif-plugged-da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:00:44 user nova-compute[72773]: WARNING nova.compute.manager [req-97d0bbd6-d750-46de-b118-449a9f6296f7 req-e213714c-e072-4a07-a250-9c57978ae377 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Received unexpected event network-vif-plugged-da5c32fa-d87d-47dc-8c64-1a4858645ade for instance with vm_state active and task_state reboot_started_hard.
Aug 16 23:00:44 user nova-compute[72773]: DEBUG nova.compute.manager [req-97d0bbd6-d750-46de-b118-449a9f6296f7 req-e213714c-e072-4a07-a250-9c57978ae377 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Received event network-vif-plugged-da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:00:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-97d0bbd6-d750-46de-b118-449a9f6296f7 req-e213714c-e072-4a07-a250-9c57978ae377 service nova] Acquiring lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:00:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-97d0bbd6-d750-46de-b118-449a9f6296f7 req-e213714c-e072-4a07-a250-9c57978ae377 service nova] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:00:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-97d0bbd6-d750-46de-b118-449a9f6296f7 req-e213714c-e072-4a07-a250-9c57978ae377 service nova] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:00:44 user nova-compute[72773]: DEBUG nova.compute.manager [req-97d0bbd6-d750-46de-b118-449a9f6296f7 req-e213714c-e072-4a07-a250-9c57978ae377 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] No waiting events found dispatching network-vif-plugged-da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:00:44 user nova-compute[72773]: WARNING nova.compute.manager [req-97d0bbd6-d750-46de-b118-449a9f6296f7 req-e213714c-e072-4a07-a250-9c57978ae377 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Received unexpected event network-vif-plugged-da5c32fa-d87d-47dc-8c64-1a4858645ade for instance with vm_state active and task_state reboot_started_hard.
Aug 16 23:00:44 user nova-compute[72773]: DEBUG nova.compute.manager [req-97d0bbd6-d750-46de-b118-449a9f6296f7 req-e213714c-e072-4a07-a250-9c57978ae377 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Received event network-vif-unplugged-da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:00:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-97d0bbd6-d750-46de-b118-449a9f6296f7 req-e213714c-e072-4a07-a250-9c57978ae377 service nova] Acquiring lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:00:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-97d0bbd6-d750-46de-b118-449a9f6296f7 req-e213714c-e072-4a07-a250-9c57978ae377 service nova] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:00:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-97d0bbd6-d750-46de-b118-449a9f6296f7 req-e213714c-e072-4a07-a250-9c57978ae377 service nova] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:00:44 user nova-compute[72773]: DEBUG nova.compute.manager [req-97d0bbd6-d750-46de-b118-449a9f6296f7 req-e213714c-e072-4a07-a250-9c57978ae377 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] No waiting events found dispatching network-vif-unplugged-da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:00:44 user nova-compute[72773]: WARNING nova.compute.manager [req-97d0bbd6-d750-46de-b118-449a9f6296f7 req-e213714c-e072-4a07-a250-9c57978ae377 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Received unexpected event network-vif-unplugged-da5c32fa-d87d-47dc-8c64-1a4858645ade for instance with vm_state active and task_state reboot_started_hard.
Aug 16 23:00:44 user nova-compute[72773]: DEBUG nova.compute.manager [req-97d0bbd6-d750-46de-b118-449a9f6296f7 req-e213714c-e072-4a07-a250-9c57978ae377 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Received event network-vif-plugged-da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:00:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-97d0bbd6-d750-46de-b118-449a9f6296f7 req-e213714c-e072-4a07-a250-9c57978ae377 service nova] Acquiring lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:00:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-97d0bbd6-d750-46de-b118-449a9f6296f7 req-e213714c-e072-4a07-a250-9c57978ae377 service nova] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:00:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-97d0bbd6-d750-46de-b118-449a9f6296f7 req-e213714c-e072-4a07-a250-9c57978ae377 service nova] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:00:44 user nova-compute[72773]: DEBUG nova.compute.manager [req-97d0bbd6-d750-46de-b118-449a9f6296f7 req-e213714c-e072-4a07-a250-9c57978ae377 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] No waiting events found dispatching network-vif-plugged-da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:00:44 user nova-compute[72773]: WARNING nova.compute.manager [req-97d0bbd6-d750-46de-b118-449a9f6296f7 req-e213714c-e072-4a07-a250-9c57978ae377 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Received unexpected event network-vif-plugged-da5c32fa-d87d-47dc-8c64-1a4858645ade for instance with vm_state active and task_state reboot_started_hard.
Aug 16 23:00:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 23:00:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26536633434623038', 'path': '/dev/sdc'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 23:00:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536633434623038', 'path': '/dev/sdc'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 23:00:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:58:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1929886723',display_name='tempest-TestMinimumBasicScenario-server-1929886723',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1929886723',id=46,image_ref='55396c78-d108-4d39-b9f2-7ba759f49030',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI402WRvzhHoWPlxJnK+49US+Dx0HFSoQpX0AVquPP6MN6mleC061OydIxKJZzm2AkNdqosEj7vZy2cxiyzg4zIOJkhRtfytxqslKlLgcdQwsAvlZWqlzYIUpZ5DKe1TIw==',key_name='tempest-TestMinimumBasicScenario-127360055',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:58:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de13176691174b7eab7cb53a49df2933',ramdisk_id='',reservation_id='r-544u47jf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='55396c78-d108-4d39-b9f2-7ba759f49030',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1869730972',owner_user_name='tempest-TestMinimumBasicScenario-1869730972-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T23:00:42Z,user_data=None,user_id='4d71f078c09c449ca7747a74d5bfb138',uuid=363f870e-a6d9-4664-9b9c-c343f3548b31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "address": "fa:16:3e:43:25:e9", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda5c32fa-d8", "ovs_interfaceid": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 23:00:45 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Converting VIF {"id": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "address": "fa:16:3e:43:25:e9", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda5c32fa-d8", "ovs_interfaceid": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 23:00:45 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:25:e9,bridge_name='br-int',has_traffic_filtering=True,id=da5c32fa-d87d-47dc-8c64-1a4858645ade,network=Network(206eb708-434c-424b-86c4-5f958178361d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda5c32fa-d8') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 23:00:45 user nova-compute[72773]: DEBUG nova.objects.instance [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lazy-loading 'pci_devices' on Instance uuid 363f870e-a6d9-4664-9b9c-c343f3548b31 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:00:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] End _get_guest_xml xml=<domain type="kvm">
Aug 16 23:00:45 user nova-compute[72773]:   <uuid>363f870e-a6d9-4664-9b9c-c343f3548b31</uuid>
Aug 16 23:00:45 user nova-compute[72773]:   <name>instance-0000002e</name>
Aug 16 23:00:45 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 23:00:45 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 23:00:45 user nova-compute[72773]:   <metadata>
Aug 16 23:00:45 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 23:00:45 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 23:00:45 user nova-compute[72773]:       <nova:name>tempest-TestMinimumBasicScenario-server-1929886723</nova:name>
Aug 16 23:00:45 user nova-compute[72773]:       <nova:creationTime>2023-08-16 23:00:43</nova:creationTime>
Aug 16 23:00:45 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 23:00:45 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 23:00:45 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 23:00:45 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 23:00:45 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 23:00:45 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 23:00:45 user nova-compute[72773]:       </nova:flavor>
Aug 16 23:00:45 user nova-compute[72773]:       <nova:owner>
Aug 16 23:00:45 user nova-compute[72773]:         <nova:user uuid="4d71f078c09c449ca7747a74d5bfb138">tempest-TestMinimumBasicScenario-1869730972-project-member</nova:user>
Aug 16 23:00:45 user nova-compute[72773]:         <nova:project uuid="de13176691174b7eab7cb53a49df2933">tempest-TestMinimumBasicScenario-1869730972</nova:project>
Aug 16 23:00:45 user nova-compute[72773]:       </nova:owner>
Aug 16 23:00:45 user nova-compute[72773]:       <nova:root type="image" uuid="55396c78-d108-4d39-b9f2-7ba759f49030"/>
Aug 16 23:00:45 user nova-compute[72773]:       <nova:ports>
Aug 16 23:00:45 user nova-compute[72773]:         <nova:port uuid="da5c32fa-d87d-47dc-8c64-1a4858645ade">
Aug 16 23:00:45 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 23:00:45 user nova-compute[72773]:         </nova:port>
Aug 16 23:00:45 user nova-compute[72773]:       </nova:ports>
Aug 16 23:00:45 user nova-compute[72773]:     </nova:instance>
Aug 16 23:00:45 user nova-compute[72773]:   </metadata>
Aug 16 23:00:45 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 23:00:45 user nova-compute[72773]:     <system>
Aug 16 23:00:45 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 23:00:45 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 23:00:45 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 23:00:45 user nova-compute[72773]:       <entry name="serial">363f870e-a6d9-4664-9b9c-c343f3548b31</entry>
Aug 16 23:00:45 user nova-compute[72773]:       <entry name="uuid">363f870e-a6d9-4664-9b9c-c343f3548b31</entry>
Aug 16 23:00:45 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 23:00:45 user nova-compute[72773]:     </system>
Aug 16 23:00:45 user nova-compute[72773]:   </sysinfo>
Aug 16 23:00:45 user nova-compute[72773]:   <os>
Aug 16 23:00:45 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 23:00:45 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 23:00:45 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 23:00:45 user nova-compute[72773]:   </os>
Aug 16 23:00:45 user nova-compute[72773]:   <features>
Aug 16 23:00:45 user nova-compute[72773]:     <acpi/>
Aug 16 23:00:45 user nova-compute[72773]:     <apic/>
Aug 16 23:00:45 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 23:00:45 user nova-compute[72773]:   </features>
Aug 16 23:00:45 user nova-compute[72773]:   <clock offset="utc">
Aug 16 23:00:45 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 23:00:45 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 23:00:45 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 23:00:45 user nova-compute[72773]:   </clock>
Aug 16 23:00:45 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 23:00:45 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 23:00:45 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 23:00:45 user nova-compute[72773]:   </cpu>
Aug 16 23:00:45 user nova-compute[72773]:   <devices>
Aug 16 23:00:45 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 23:00:45 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 23:00:45 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk"/>
Aug 16 23:00:45 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 23:00:45 user nova-compute[72773]:     </disk>
Aug 16 23:00:45 user nova-compute[72773]:     <disk type="block" device="disk">
Aug 16 23:00:45 user nova-compute[72773]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 23:00:45 user nova-compute[72773]:       <source dev="/dev/sdc"/>
Aug 16 23:00:45 user nova-compute[72773]:       <target dev="vdb" bus="virtio"/>
Aug 16 23:00:45 user nova-compute[72773]:       <serial>c6573055-49c0-4591-b1c1-0b3755121014</serial>
Aug 16 23:00:45 user nova-compute[72773]:     </disk>
Aug 16 23:00:45 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 23:00:45 user nova-compute[72773]:       <mac address="fa:16:3e:43:25:e9"/>
Aug 16 23:00:45 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 23:00:45 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 23:00:45 user nova-compute[72773]:       <target dev="tapda5c32fa-d8"/>
Aug 16 23:00:45 user nova-compute[72773]:     </interface>
Aug 16 23:00:45 user nova-compute[72773]:     <serial type="pty">
Aug 16 23:00:45 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/console.log" append="off"/>
Aug 16 23:00:45 user nova-compute[72773]:     </serial>
Aug 16 23:00:45 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 23:00:45 user nova-compute[72773]:     <video>
Aug 16 23:00:45 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 23:00:45 user nova-compute[72773]:     </video>
Aug 16 23:00:45 user nova-compute[72773]:     <rng model="virtio">
Aug 16 23:00:45 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 23:00:45 user nova-compute[72773]:     </rng>
Aug 16 23:00:45 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 23:00:45 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 23:00:45 user nova-compute[72773]:       <stats period="10"/>
Aug 16 23:00:45 user nova-compute[72773]:     </memballoon>
Aug 16 23:00:45 user nova-compute[72773]:   </devices>
Aug 16 23:00:45 user nova-compute[72773]: </domain>
Aug 16 23:00:45 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 23:00:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 23:00:45 user nova-compute[72773]: DEBUG nova.objects.instance [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lazy-loading 'trusted_certs' on Instance uuid 363f870e-a6d9-4664-9b9c-c343f3548b31 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:00:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0dfed614ad2ff93c1fc5c734a13d40bde8266518 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0dfed614ad2ff93c1fc5c734a13d40bde8266518 --force-share --output=json" returned: 0 in 0.174s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:45 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Checking if we can resize image /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 23:00:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:00:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:00:45 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Cannot resize image /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 23:00:45 user nova-compute[72773]: DEBUG nova.objects.instance [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lazy-loading 'migration_context' on Instance uuid 363f870e-a6d9-4664-9b9c-c343f3548b31 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:00:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:58:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1929886723',display_name='tempest-TestMinimumBasicScenario-server-1929886723',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1929886723',id=46,image_ref='55396c78-d108-4d39-b9f2-7ba759f49030',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI402WRvzhHoWPlxJnK+49US+Dx0HFSoQpX0AVquPP6MN6mleC061OydIxKJZzm2AkNdqosEj7vZy2cxiyzg4zIOJkhRtfytxqslKlLgcdQwsAvlZWqlzYIUpZ5DKe1TIw==',key_name='tempest-TestMinimumBasicScenario-127360055',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:58:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='de13176691174b7eab7cb53a49df2933',ramdisk_id='',reservation_id='r-544u47jf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='55396c78-d108-4d39-b9f2-7ba759f49030',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1869730972',owner_user_name='tempest-TestMinimumBasicScenario-1869730972-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T23:00:42Z,user_data=None,user_id='4d71f078c09c449ca7747a74d5bfb138',uuid=363f870e-a6d9-4664-9b9c-c343f3548b31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "address": "fa:16:3e:43:25:e9", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda5c32fa-d8", "ovs_interfaceid": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 23:00:45 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Converting VIF {"id": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "address": "fa:16:3e:43:25:e9", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda5c32fa-d8", "ovs_interfaceid": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 23:00:45 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:25:e9,bridge_name='br-int',has_traffic_filtering=True,id=da5c32fa-d87d-47dc-8c64-1a4858645ade,network=Network(206eb708-434c-424b-86c4-5f958178361d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda5c32fa-d8') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 23:00:45 user nova-compute[72773]: DEBUG os_vif [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:25:e9,bridge_name='br-int',has_traffic_filtering=True,id=da5c32fa-d87d-47dc-8c64-1a4858645ade,network=Network(206eb708-434c-424b-86c4-5f958178361d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda5c32fa-d8') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 23:00:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 23:00:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 23:00:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda5c32fa-d8, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 23:00:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapda5c32fa-d8, col_values=(('external_ids', {'iface-id': 'da5c32fa-d87d-47dc-8c64-1a4858645ade', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:25:e9', 'vm-uuid': '363f870e-a6d9-4664-9b9c-c343f3548b31'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 23:00:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:00:45 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:45 user nova-compute[72773]: INFO os_vif [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:25:e9,bridge_name='br-int',has_traffic_filtering=True,id=da5c32fa-d87d-47dc-8c64-1a4858645ade,network=Network(206eb708-434c-424b-86c4-5f958178361d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda5c32fa-d8')
Aug 16 23:00:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:47 user nova-compute[72773]: DEBUG nova.compute.manager [req-2424abc7-e232-472d-a4f3-5e09e4ecaa83 req-eb85d4e8-8f96-4a37-a9c1-3976c300b1c6 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Received event network-vif-plugged-da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:00:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2424abc7-e232-472d-a4f3-5e09e4ecaa83 req-eb85d4e8-8f96-4a37-a9c1-3976c300b1c6 service nova] Acquiring lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:00:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2424abc7-e232-472d-a4f3-5e09e4ecaa83 req-eb85d4e8-8f96-4a37-a9c1-3976c300b1c6 service nova] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:00:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2424abc7-e232-472d-a4f3-5e09e4ecaa83 req-eb85d4e8-8f96-4a37-a9c1-3976c300b1c6 service nova] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:00:47 user nova-compute[72773]: DEBUG nova.compute.manager [req-2424abc7-e232-472d-a4f3-5e09e4ecaa83 req-eb85d4e8-8f96-4a37-a9c1-3976c300b1c6 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] No waiting events found dispatching network-vif-plugged-da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:00:47 user nova-compute[72773]: WARNING nova.compute.manager [req-2424abc7-e232-472d-a4f3-5e09e4ecaa83 req-eb85d4e8-8f96-4a37-a9c1-3976c300b1c6 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Received unexpected event network-vif-plugged-da5c32fa-d87d-47dc-8c64-1a4858645ade for instance with vm_state active and task_state reboot_started_hard.
Aug 16 23:00:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:49 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Removed pending event for 363f870e-a6d9-4664-9b9c-c343f3548b31 due to event {{(pid=72773) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 23:00:49 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692226849.3019183, 363f870e-a6d9-4664-9b9c-c343f3548b31 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 23:00:49 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] VM Resumed (Lifecycle Event)
Aug 16 23:00:49 user nova-compute[72773]: DEBUG nova.compute.manager [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 23:00:49 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Instance rebooted successfully.
Aug 16 23:00:49 user nova-compute[72773]: DEBUG nova.compute.manager [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 23:00:49 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 23:00:49 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 23:00:49 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 16 23:00:49 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692226849.3046825, 363f870e-a6d9-4664-9b9c-c343f3548b31 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 23:00:49 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] VM Started (Lifecycle Event)
Aug 16 23:00:49 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 23:00:49 user nova-compute[72773]: DEBUG nova.compute.manager [req-e017824a-49b9-4fa3-9046-fcaf170733ee req-453dae33-5dbd-4f44-a9e6-185b18aaebbe service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Received event network-vif-plugged-da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:00:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e017824a-49b9-4fa3-9046-fcaf170733ee req-453dae33-5dbd-4f44-a9e6-185b18aaebbe service nova] Acquiring lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:00:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e017824a-49b9-4fa3-9046-fcaf170733ee req-453dae33-5dbd-4f44-a9e6-185b18aaebbe service nova] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:00:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e017824a-49b9-4fa3-9046-fcaf170733ee req-453dae33-5dbd-4f44-a9e6-185b18aaebbe service nova] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:00:49 user nova-compute[72773]: DEBUG nova.compute.manager [req-e017824a-49b9-4fa3-9046-fcaf170733ee req-453dae33-5dbd-4f44-a9e6-185b18aaebbe service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] No waiting events found dispatching network-vif-plugged-da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:00:49 user nova-compute[72773]: WARNING nova.compute.manager [req-e017824a-49b9-4fa3-9046-fcaf170733ee req-453dae33-5dbd-4f44-a9e6-185b18aaebbe service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Received unexpected event network-vif-plugged-da5c32fa-d87d-47dc-8c64-1a4858645ade for instance with vm_state active and task_state None.
Aug 16 23:00:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-da6b0a5e-7edc-44ee-8f5f-5fb91e9ffb7c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.540s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:00:49 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 23:00:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:00:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:01:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:01:01 user nova-compute[72773]: DEBUG nova.compute.manager [req-a8e0dfb4-8969-4124-a157-334d408d3600 req-2d33adf9-20c6-43dc-b86c-6985a727236a service nova] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Received event network-changed-a83fafa9-f889-4c34-9461-fa01dd2d02f0 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:01:01 user nova-compute[72773]: DEBUG nova.compute.manager [req-a8e0dfb4-8969-4124-a157-334d408d3600 req-2d33adf9-20c6-43dc-b86c-6985a727236a service nova] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Refreshing instance network info cache due to event network-changed-a83fafa9-f889-4c34-9461-fa01dd2d02f0. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 23:01:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a8e0dfb4-8969-4124-a157-334d408d3600 req-2d33adf9-20c6-43dc-b86c-6985a727236a service nova] Acquiring lock "refresh_cache-dc40aa11-47e4-4f55-8094-82325cecaed3" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:01:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a8e0dfb4-8969-4124-a157-334d408d3600 req-2d33adf9-20c6-43dc-b86c-6985a727236a service nova] Acquired lock "refresh_cache-dc40aa11-47e4-4f55-8094-82325cecaed3" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:01:01 user nova-compute[72773]: DEBUG nova.network.neutron [req-a8e0dfb4-8969-4124-a157-334d408d3600 req-2d33adf9-20c6-43dc-b86c-6985a727236a service nova] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Refreshing network info cache for port a83fafa9-f889-4c34-9461-fa01dd2d02f0 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 23:01:01 user nova-compute[72773]: DEBUG nova.network.neutron [req-a8e0dfb4-8969-4124-a157-334d408d3600 req-2d33adf9-20c6-43dc-b86c-6985a727236a service nova] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Updated VIF entry in instance network info cache for port a83fafa9-f889-4c34-9461-fa01dd2d02f0. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 23:01:01 user nova-compute[72773]: DEBUG nova.network.neutron [req-a8e0dfb4-8969-4124-a157-334d408d3600 req-2d33adf9-20c6-43dc-b86c-6985a727236a service nova] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Updating instance_info_cache with network_info: [{"id": "a83fafa9-f889-4c34-9461-fa01dd2d02f0", "address": "fa:16:3e:9d:0c:f6", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83fafa9-f8", "ovs_interfaceid": "a83fafa9-f889-4c34-9461-fa01dd2d02f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:01:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a8e0dfb4-8969-4124-a157-334d408d3600 req-2d33adf9-20c6-43dc-b86c-6985a727236a service nova] Releasing lock "refresh_cache-dc40aa11-47e4-4f55-8094-82325cecaed3" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:01:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:01:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:01:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:01:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:01:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:01:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:01:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:01:07 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:01:10 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:01:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:01:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:01:13 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:01:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "2ebcf309-653e-4cc0-8e56-70592b70da8a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:01:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "2ebcf309-653e-4cc0-8e56-70592b70da8a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:01:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 23:01:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:01:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:01:14 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 23:01:14 user nova-compute[72773]: INFO nova.compute.claims [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Claim successful on node user
Aug 16 23:01:14 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:01:14 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:01:14 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.229s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:01:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 23:01:14 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 23:01:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 23:01:14 user nova-compute[72773]: DEBUG nova.network.neutron [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 23:01:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 23:01:14 user nova-compute[72773]: INFO nova.virt.block_device [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Booting with volume snapshot 59cd872c-edd0-400f-91ec-9510f40711ad at /dev/vda
Aug 16 23:01:14 user nova-compute[72773]: DEBUG nova.policy [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f12eb2e28904f63baa1ddce4641e180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cd967e4254cfd9b8aee140f640682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 23:01:15 user nova-compute[72773]: DEBUG nova.network.neutron [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Successfully created port: e8a47645-d43c-44d5-b377-323443f6ef46 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 23:01:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:01:15 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:01:16 user nova-compute[72773]: DEBUG nova.network.neutron [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Successfully updated port: e8a47645-d43c-44d5-b377-323443f6ef46 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 23:01:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "refresh_cache-2ebcf309-653e-4cc0-8e56-70592b70da8a" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:01:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquired lock "refresh_cache-2ebcf309-653e-4cc0-8e56-70592b70da8a" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:01:16 user nova-compute[72773]: DEBUG nova.network.neutron [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 23:01:16 user nova-compute[72773]: DEBUG nova.network.neutron [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 23:01:16 user nova-compute[72773]: DEBUG nova.compute.manager [req-6073fb18-5971-4cd6-a32c-68f13cc38332 req-f5303c43-8b2a-4459-8d48-c5165abda70c service nova] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Received event network-changed-e8a47645-d43c-44d5-b377-323443f6ef46 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:01:16 user nova-compute[72773]: DEBUG nova.compute.manager [req-6073fb18-5971-4cd6-a32c-68f13cc38332 req-f5303c43-8b2a-4459-8d48-c5165abda70c service nova] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Refreshing instance network info cache due to event network-changed-e8a47645-d43c-44d5-b377-323443f6ef46. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 23:01:16 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6073fb18-5971-4cd6-a32c-68f13cc38332 req-f5303c43-8b2a-4459-8d48-c5165abda70c service nova] Acquiring lock "refresh_cache-2ebcf309-653e-4cc0-8e56-70592b70da8a" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:01:17 user nova-compute[72773]: DEBUG nova.network.neutron [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Updating instance_info_cache with network_info: [{"id": "e8a47645-d43c-44d5-b377-323443f6ef46", "address": "fa:16:3e:c3:9c:0f", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a47645-d4", "ovs_interfaceid": "e8a47645-d43c-44d5-b377-323443f6ef46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:01:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Releasing lock "refresh_cache-2ebcf309-653e-4cc0-8e56-70592b70da8a" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:01:17 user nova-compute[72773]: DEBUG nova.compute.manager [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Instance network_info: |[{"id": "e8a47645-d43c-44d5-b377-323443f6ef46", "address": "fa:16:3e:c3:9c:0f", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a47645-d4", "ovs_interfaceid": "e8a47645-d43c-44d5-b377-323443f6ef46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 23:01:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6073fb18-5971-4cd6-a32c-68f13cc38332 req-f5303c43-8b2a-4459-8d48-c5165abda70c service nova] Acquired lock "refresh_cache-2ebcf309-653e-4cc0-8e56-70592b70da8a" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:01:17 user nova-compute[72773]: DEBUG nova.network.neutron [req-6073fb18-5971-4cd6-a32c-68f13cc38332 req-f5303c43-8b2a-4459-8d48-c5165abda70c service nova] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Refreshing network info cache for port e8a47645-d43c-44d5-b377-323443f6ef46 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 23:01:17 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:01:17 user nova-compute[72773]: DEBUG nova.network.neutron [req-6073fb18-5971-4cd6-a32c-68f13cc38332 req-f5303c43-8b2a-4459-8d48-c5165abda70c service nova] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Updated VIF entry in instance network info cache for port e8a47645-d43c-44d5-b377-323443f6ef46. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 23:01:17 user nova-compute[72773]: DEBUG nova.network.neutron [req-6073fb18-5971-4cd6-a32c-68f13cc38332 req-f5303c43-8b2a-4459-8d48-c5165abda70c service nova] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Updating instance_info_cache with network_info: [{"id": "e8a47645-d43c-44d5-b377-323443f6ef46", "address": "fa:16:3e:c3:9c:0f", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a47645-d4", "ovs_interfaceid": "e8a47645-d43c-44d5-b377-323443f6ef46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:01:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6073fb18-5971-4cd6-a32c-68f13cc38332 req-f5303c43-8b2a-4459-8d48-c5165abda70c service nova] Releasing lock "refresh_cache-2ebcf309-653e-4cc0-8e56-70592b70da8a" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:01:18 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:01:19 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:01:19 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 23:01:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-dc40aa11-47e4-4f55-8094-82325cecaed3" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:01:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-dc40aa11-47e4-4f55-8094-82325cecaed3" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:01:19 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 23:01:19 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Updating instance_info_cache with network_info: [{"id": "a83fafa9-f889-4c34-9461-fa01dd2d02f0", "address": "fa:16:3e:9d:0c:f6", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83fafa9-f8", "ovs_interfaceid": "a83fafa9-f889-4c34-9461-fa01dd2d02f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:01:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-dc40aa11-47e4-4f55-8094-82325cecaed3" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:01:19 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 23:01:19 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:01:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:01:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:01:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:01:20 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 23:01:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:01:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:01:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:01:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:01:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 23:01:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 23:01:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:01:20 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:01:20 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:01:20 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=8598MB free_disk=25.378311157226562GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 23:01:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:01:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:01:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:01:21 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 363f870e-a6d9-4664-9b9c-c343f3548b31 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 23:01:21 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance dc40aa11-47e4-4f55-8094-82325cecaed3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 23:01:21 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 2ebcf309-653e-4cc0-8e56-70592b70da8a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 23:01:21 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 23:01:21 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 23:01:21 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Refreshing inventories for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 23:01:21 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Updating ProviderTree inventory for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 23:01:21 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Updating inventory in ProviderTree for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 23:01:21 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Refreshing aggregate associations for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e, aggregates: None {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 23:01:21 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Refreshing trait associations for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 23:01:21 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:01:21 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:01:21 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 23:01:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.471s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:01:23 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:01:23 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:01:23 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:01:23 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 23:01:23 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:01:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:01:26 user nova-compute[72773]: DEBUG os_brick.utils [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 23:01:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:01:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:01:26 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46f648a-c8e7-4eea-af6a-34a326747638]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:01:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:01:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:01:26 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fd7819-4941-4096-9af2-b0c913b3f650]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:01:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:01:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:01:26 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c81061f-e73c-4731-9291-a2fa3c7500c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:01:26 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e3ab14-f557-46e2-9b14-e18a4f426b39]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:01:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:01:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 23:01:26 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 23:01:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:01:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 23:01:26 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 23:01:26 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ab32e2-b20c-46c0-90f4-11fd8c65b65e]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:01:26 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 23:01:26 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 23:01:26 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 23:01:26 user nova-compute[72773]: DEBUG os_brick.utils [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 23:01:26 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Updating existing volume attachment record: 477bac5c-6aa4-4490-b4c3-efd6a1b412db {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 23:01:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:01:31 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:01:31 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Cleaning up deleted instances with incomplete migration  {{(pid=72773) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 23:01:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:01:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:01:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:01:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:01:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:01:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:01:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:01:36 user nova-compute[72773]: DEBUG nova.compute.manager [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 23:01:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 23:01:36 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Creating image(s)
Aug 16 23:01:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Did not create local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 23:01:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Ensure instance console log exists: /opt/stack/data/nova/instances/2ebcf309-653e-4cc0-8e56-70592b70da8a/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 23:01:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:01:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:01:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:01:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Start _get_guest_xml network_info=[{"id": "e8a47645-d43c-44d5-b377-323443f6ef46", "address": "fa:16:3e:c3:9c:0f", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a47645-d4", "ovs_interfaceid": "e8a47645-d43c-44d5-b377-323443f6ef46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-16T23:01:03Z,direct_url=<?>,disk_format='qcow2',id=cfe5ab92-2ec9-426a-bc9d-f94e98fd2245,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1842419066',owner='a51cd967e4254cfd9b8aee140f640682',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-16T23:01:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '477bac5c-6aa4-4490-b4c3-efd6a1b412db', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HiDcOWsm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2ebcf309-653e-4cc0-8e56-70592b70da8a', 'attached_at': '', 'detached_at': '', 'volume_id': '9f7ec364-c3d4-4996-9c3b-02be4fc94cca', 'serial': '9f7ec364-c3d4-4996-9c3b-02be4fc94cca'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 23:01:36 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:01:36 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:01:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 23:01:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 23:01:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 23:01:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 23:01:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 23:01:36 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-16T23:01:03Z,direct_url=<?>,disk_format='qcow2',id=cfe5ab92-2ec9-426a-bc9d-f94e98fd2245,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1842419066',owner='a51cd967e4254cfd9b8aee140f640682',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-16T23:01:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 23:01:36 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 23:01:36 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 23:01:36 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 23:01:36 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 23:01:36 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 23:01:36 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 23:01:36 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 23:01:36 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 23:01:36 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 23:01:36 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 23:01:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 23:01:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HiDcOWsm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 23:01:36 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 23:01:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 23:01:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 23:01:36 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 23:01:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 23:01:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 23:01:36 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 23:01:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:01:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:01:36 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[092726a5-5bef-4cd8-8b1a-eacbba74b850]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:01:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 23:01:36 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:01:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:01:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:01:36 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a786fc-56bd-4109-9bff-3580f33dfe27]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:01:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca] added
Aug 16 23:01:36 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:01:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bff82c9-34cd-46c0-b4fc-7c0478631579]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[59040c15-34b1-4393-8a63-0e29342ff3f0]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HiDcOWsm {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HiDcOWsm" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c4bd40-fb13-41d1-8ffa-e9ef1588f0a0]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HiDcOWsm'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[af012ca6-c88c-4424-ac42-481e2309f286]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7d18d1-98b6-4e80-97be-5f6782f736a8]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 (non-flash)
Aug 16 23:01:37 user nova-compute[72773]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 (non-flash)
Aug 16 23:01:37 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 (non-flash)
Aug 16 23:01:37 user nova-compute[72773]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 (non-flash)
Aug 16 23:01:37 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d44698a-c12b-4bd1-a3ba-9dc05989f8f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca, portal: 172.16.0.220,3260]
Aug 16 23:01:37 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca, portal: 172.16.0.220,3260] successful.
Aug 16 23:01:37 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d63e2d-89b5-4ad6-a2d6-100f271acb0e]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1cd32c-7a8f-490d-99d7-3b062ca51790]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 (non-flash)
Aug 16 23:01:37 user nova-compute[72773]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 (non-flash)
Aug 16 23:01:37 user nova-compute[72773]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca (non-flash)
Aug 16 23:01:37 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 (non-flash)
Aug 16 23:01:37 user nova-compute[72773]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 (non-flash)
Aug 16 23:01:37 user nova-compute[72773]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca (non-flash)
Aug 16 23:01:37 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] HCTL ('35', '-', '-', 0) found on session 59 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf1de26-d50c-40f2-a1d3-ade9bc5874b5]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:01:37 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Searching for a device in session 59 and hctl ['35', '*', '*', 0] yield: None {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 23:01:38 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Searching for a device in session 59 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 23:01:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HiDcOWsm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 23:01:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 23:01:38 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23561653564623137', 'path': '/dev/sdd'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 23:01:38 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561653564623137', 'path': '/dev/sdd'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 23:01:38 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T23:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1085067416',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1085067416',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1085067416',id=48,image_ref='cfe5ab92-2ec9-426a-bc9d-f94e98fd2245',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEgVyo3kYOnShFk/EPnq9qd/wTQU+/NFe9tH9h20UxppUrkQgOVZtnud3hTIHnLHkQrgHnE565vqUwPZOIirrfvv9OmS9x+aZedFTkDg7h7/mWdEbjpDRgl666nHgP3Pg==',key_name='tempest-keypair-312695082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a51cd967e4254cfd9b8aee140f640682',ramdisk_id='',reservation_id='r-gl4ylu0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1862722655',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1862722655-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1862722655',owner_user_name='tempest-TestVolumeBootPattern-1862722655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T23:01:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f12eb2e28904f63baa1ddce4641e180',uuid=2ebcf309-653e-4cc0-8e56-70592b70da8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8a47645-d43c-44d5-b377-323443f6ef46", "address": "fa:16:3e:c3:9c:0f", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a47645-d4", "ovs_interfaceid": "e8a47645-d43c-44d5-b377-323443f6ef46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 23:01:38 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converting VIF {"id": "e8a47645-d43c-44d5-b377-323443f6ef46", "address": "fa:16:3e:c3:9c:0f", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a47645-d4", "ovs_interfaceid": "e8a47645-d43c-44d5-b377-323443f6ef46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 23:01:38 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:9c:0f,bridge_name='br-int',has_traffic_filtering=True,id=e8a47645-d43c-44d5-b377-323443f6ef46,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a47645-d4') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 23:01:38 user nova-compute[72773]: DEBUG nova.objects.instance [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ebcf309-653e-4cc0-8e56-70592b70da8a {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:01:38 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] End _get_guest_xml xml=<domain type="kvm">
Aug 16 23:01:38 user nova-compute[72773]:   <uuid>2ebcf309-653e-4cc0-8e56-70592b70da8a</uuid>
Aug 16 23:01:38 user nova-compute[72773]:   <name>instance-00000030</name>
Aug 16 23:01:38 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 23:01:38 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 23:01:38 user nova-compute[72773]:   <metadata>
Aug 16 23:01:38 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 23:01:38 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 23:01:38 user nova-compute[72773]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1085067416</nova:name>
Aug 16 23:01:38 user nova-compute[72773]:       <nova:creationTime>2023-08-16 23:01:36</nova:creationTime>
Aug 16 23:01:38 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 23:01:38 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 23:01:38 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 23:01:38 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 23:01:38 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 23:01:38 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 23:01:38 user nova-compute[72773]:       </nova:flavor>
Aug 16 23:01:38 user nova-compute[72773]:       <nova:owner>
Aug 16 23:01:38 user nova-compute[72773]:         <nova:user uuid="3f12eb2e28904f63baa1ddce4641e180">tempest-TestVolumeBootPattern-1862722655-project-member</nova:user>
Aug 16 23:01:38 user nova-compute[72773]:         <nova:project uuid="a51cd967e4254cfd9b8aee140f640682">tempest-TestVolumeBootPattern-1862722655</nova:project>
Aug 16 23:01:38 user nova-compute[72773]:       </nova:owner>
Aug 16 23:01:38 user nova-compute[72773]:       <nova:root type="image" uuid="cfe5ab92-2ec9-426a-bc9d-f94e98fd2245"/>
Aug 16 23:01:38 user nova-compute[72773]:       <nova:ports>
Aug 16 23:01:38 user nova-compute[72773]:         <nova:port uuid="e8a47645-d43c-44d5-b377-323443f6ef46">
Aug 16 23:01:38 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 23:01:38 user nova-compute[72773]:         </nova:port>
Aug 16 23:01:38 user nova-compute[72773]:       </nova:ports>
Aug 16 23:01:38 user nova-compute[72773]:     </nova:instance>
Aug 16 23:01:38 user nova-compute[72773]:   </metadata>
Aug 16 23:01:38 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 23:01:38 user nova-compute[72773]:     <system>
Aug 16 23:01:38 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 23:01:38 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 23:01:38 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 23:01:38 user nova-compute[72773]:       <entry name="serial">2ebcf309-653e-4cc0-8e56-70592b70da8a</entry>
Aug 16 23:01:38 user nova-compute[72773]:       <entry name="uuid">2ebcf309-653e-4cc0-8e56-70592b70da8a</entry>
Aug 16 23:01:38 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 23:01:38 user nova-compute[72773]:     </system>
Aug 16 23:01:38 user nova-compute[72773]:   </sysinfo>
Aug 16 23:01:38 user nova-compute[72773]:   <os>
Aug 16 23:01:38 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 23:01:38 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 23:01:38 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 23:01:38 user nova-compute[72773]:   </os>
Aug 16 23:01:38 user nova-compute[72773]:   <features>
Aug 16 23:01:38 user nova-compute[72773]:     <acpi/>
Aug 16 23:01:38 user nova-compute[72773]:     <apic/>
Aug 16 23:01:38 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 23:01:38 user nova-compute[72773]:   </features>
Aug 16 23:01:38 user nova-compute[72773]:   <clock offset="utc">
Aug 16 23:01:38 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 23:01:38 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 23:01:38 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 23:01:38 user nova-compute[72773]:   </clock>
Aug 16 23:01:38 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 23:01:38 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 23:01:38 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 23:01:38 user nova-compute[72773]:   </cpu>
Aug 16 23:01:38 user nova-compute[72773]:   <devices>
Aug 16 23:01:38 user nova-compute[72773]:     <disk type="block" device="disk">
Aug 16 23:01:38 user nova-compute[72773]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 23:01:38 user nova-compute[72773]:       <source dev="/dev/sdd"/>
Aug 16 23:01:38 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 23:01:38 user nova-compute[72773]:       <serial>9f7ec364-c3d4-4996-9c3b-02be4fc94cca</serial>
Aug 16 23:01:38 user nova-compute[72773]:     </disk>
Aug 16 23:01:38 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 23:01:38 user nova-compute[72773]:       <mac address="fa:16:3e:c3:9c:0f"/>
Aug 16 23:01:38 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 23:01:38 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 23:01:38 user nova-compute[72773]:       <target dev="tape8a47645-d4"/>
Aug 16 23:01:38 user nova-compute[72773]:     </interface>
Aug 16 23:01:38 user nova-compute[72773]:     <serial type="pty">
Aug 16 23:01:38 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/2ebcf309-653e-4cc0-8e56-70592b70da8a/console.log" append="off"/>
Aug 16 23:01:38 user nova-compute[72773]:     </serial>
Aug 16 23:01:38 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 23:01:38 user nova-compute[72773]:     <video>
Aug 16 23:01:38 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 23:01:38 user nova-compute[72773]:     </video>
Aug 16 23:01:38 user nova-compute[72773]:     <rng model="virtio">
Aug 16 23:01:38 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 23:01:38 user nova-compute[72773]:     </rng>
Aug 16 23:01:38 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 23:01:38 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 23:01:38 user nova-compute[72773]:       <stats period="10"/>
Aug 16 23:01:38 user nova-compute[72773]:     </memballoon>
Aug 16 23:01:38 user nova-compute[72773]:   </devices>
Aug 16 23:01:38 user nova-compute[72773]: </domain>
Aug 16 23:01:38 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 23:01:38 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T23:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1085067416',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1085067416',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1085067416',id=48,image_ref='cfe5ab92-2ec9-426a-bc9d-f94e98fd2245',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEgVyo3kYOnShFk/EPnq9qd/wTQU+/NFe9tH9h20UxppUrkQgOVZtnud3hTIHnLHkQrgHnE565vqUwPZOIirrfvv9OmS9x+aZedFTkDg7h7/mWdEbjpDRgl666nHgP3Pg==',key_name='tempest-keypair-312695082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a51cd967e4254cfd9b8aee140f640682',ramdisk_id='',reservation_id='r-gl4ylu0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1862722655',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1862722655-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1862722655',owner_user_name='tempest-TestVolumeBootPattern-1862722655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T23:01:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f12eb2e28904f63baa1ddce4641e180',uuid=2ebcf309-653e-4cc0-8e56-70592b70da8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8a47645-d43c-44d5-b377-323443f6ef46", "address": "fa:16:3e:c3:9c:0f", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a47645-d4", "ovs_interfaceid": "e8a47645-d43c-44d5-b377-323443f6ef46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 23:01:38 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converting VIF {"id": "e8a47645-d43c-44d5-b377-323443f6ef46", "address": "fa:16:3e:c3:9c:0f", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a47645-d4", "ovs_interfaceid": "e8a47645-d43c-44d5-b377-323443f6ef46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 23:01:38 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:9c:0f,bridge_name='br-int',has_traffic_filtering=True,id=e8a47645-d43c-44d5-b377-323443f6ef46,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a47645-d4') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 23:01:38 user nova-compute[72773]: DEBUG os_vif [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:9c:0f,bridge_name='br-int',has_traffic_filtering=True,id=e8a47645-d43c-44d5-b377-323443f6ef46,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a47645-d4') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 23:01:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:01:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 23:01:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 23:01:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:01:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8a47645-d4, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 23:01:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape8a47645-d4, col_values=(('external_ids', {'iface-id': 'e8a47645-d43c-44d5-b377-323443f6ef46', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:9c:0f', 'vm-uuid': '2ebcf309-653e-4cc0-8e56-70592b70da8a'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 23:01:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:01:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:01:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:01:38 user nova-compute[72773]: INFO os_vif [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:9c:0f,bridge_name='br-int',has_traffic_filtering=True,id=e8a47645-d43c-44d5-b377-323443f6ef46,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a47645-d4')
Aug 16 23:01:38 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 23:01:38 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] No VIF found with MAC fa:16:3e:c3:9c:0f, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 23:01:38 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:01:38 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Cleaning up deleted instances {{(pid=72773) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 23:01:38 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] There are 0 instances to clean {{(pid=72773) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 23:01:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:01:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:01:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:01:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:01:39 user nova-compute[72773]: DEBUG nova.compute.manager [req-e60107c0-3aa5-40ee-b2a7-87e2e1445093 req-94bf0dda-fc82-47d0-a5bf-5cf6d8096f4b service nova] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Received event network-vif-plugged-e8a47645-d43c-44d5-b377-323443f6ef46 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:01:39 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e60107c0-3aa5-40ee-b2a7-87e2e1445093 req-94bf0dda-fc82-47d0-a5bf-5cf6d8096f4b service nova] Acquiring lock "2ebcf309-653e-4cc0-8e56-70592b70da8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:01:39 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e60107c0-3aa5-40ee-b2a7-87e2e1445093 req-94bf0dda-fc82-47d0-a5bf-5cf6d8096f4b service nova] Lock "2ebcf309-653e-4cc0-8e56-70592b70da8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:01:39 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-e60107c0-3aa5-40ee-b2a7-87e2e1445093 req-94bf0dda-fc82-47d0-a5bf-5cf6d8096f4b service nova] Lock "2ebcf309-653e-4cc0-8e56-70592b70da8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:01:39 user nova-compute[72773]: DEBUG nova.compute.manager [req-e60107c0-3aa5-40ee-b2a7-87e2e1445093 req-94bf0dda-fc82-47d0-a5bf-5cf6d8096f4b service nova] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] No waiting events found dispatching network-vif-plugged-e8a47645-d43c-44d5-b377-323443f6ef46 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:01:39 user nova-compute[72773]: WARNING nova.compute.manager [req-e60107c0-3aa5-40ee-b2a7-87e2e1445093 req-94bf0dda-fc82-47d0-a5bf-5cf6d8096f4b service nova] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Received unexpected event network-vif-plugged-e8a47645-d43c-44d5-b377-323443f6ef46 for instance with vm_state building and task_state spawning.
Aug 16 23:01:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:01:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:01:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:01:41 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692226901.7073708, 2ebcf309-653e-4cc0-8e56-70592b70da8a => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 23:01:41 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] VM Resumed (Lifecycle Event)
Aug 16 23:01:41 user nova-compute[72773]: DEBUG nova.compute.manager [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 23:01:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 23:01:41 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Instance spawned successfully.
Aug 16 23:01:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 23:01:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 23:01:41 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 23:01:41 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 23:01:41 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 23:01:41 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 23:01:41 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692226901.7106953, 2ebcf309-653e-4cc0-8e56-70592b70da8a => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 23:01:41 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] VM Started (Lifecycle Event)
Aug 16 23:01:41 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 23:01:41 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 23:01:41 user nova-compute[72773]: INFO nova.compute.manager [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Took 4.91 seconds to spawn the instance on the hypervisor.
Aug 16 23:01:41 user nova-compute[72773]: DEBUG nova.compute.manager [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 23:01:41 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 23:01:41 user nova-compute[72773]: INFO nova.compute.manager [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Took 27.64 seconds to build instance.
Aug 16 23:01:41 user nova-compute[72773]: DEBUG nova.compute.manager [req-2317dd43-54de-4895-998f-5e58daf37f81 req-920ef316-5b89-4fe4-9579-95faaebf90b4 service nova] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Received event network-vif-plugged-e8a47645-d43c-44d5-b377-323443f6ef46 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:01:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2317dd43-54de-4895-998f-5e58daf37f81 req-920ef316-5b89-4fe4-9579-95faaebf90b4 service nova] Acquiring lock "2ebcf309-653e-4cc0-8e56-70592b70da8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:01:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2317dd43-54de-4895-998f-5e58daf37f81 req-920ef316-5b89-4fe4-9579-95faaebf90b4 service nova] Lock "2ebcf309-653e-4cc0-8e56-70592b70da8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:01:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2317dd43-54de-4895-998f-5e58daf37f81 req-920ef316-5b89-4fe4-9579-95faaebf90b4 service nova] Lock "2ebcf309-653e-4cc0-8e56-70592b70da8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:01:41 user nova-compute[72773]: DEBUG nova.compute.manager [req-2317dd43-54de-4895-998f-5e58daf37f81 req-920ef316-5b89-4fe4-9579-95faaebf90b4 service nova] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] No waiting events found dispatching network-vif-plugged-e8a47645-d43c-44d5-b377-323443f6ef46 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:01:41 user nova-compute[72773]: WARNING nova.compute.manager [req-2317dd43-54de-4895-998f-5e58daf37f81 req-920ef316-5b89-4fe4-9579-95faaebf90b4 service nova] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Received unexpected event network-vif-plugged-e8a47645-d43c-44d5-b377-323443f6ef46 for instance with vm_state active and task_state None.
Aug 16 23:01:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-c9d23e1c-8932-4ed5-8214-9be3a07bdf6e tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "2ebcf309-653e-4cc0-8e56-70592b70da8a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.763s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:01:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:01:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:01:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:01:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:01:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:02:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:02:02 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_power_states {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:02:02 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Triggering sync for uuid 363f870e-a6d9-4664-9b9c-c343f3548b31 {{(pid=72773) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 23:02:02 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Triggering sync for uuid dc40aa11-47e4-4f55-8094-82325cecaed3 {{(pid=72773) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 23:02:02 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Triggering sync for uuid 2ebcf309-653e-4cc0-8e56-70592b70da8a {{(pid=72773) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 23:02:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "363f870e-a6d9-4664-9b9c-c343f3548b31" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:02:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:02:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "dc40aa11-47e4-4f55-8094-82325cecaed3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:02:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "dc40aa11-47e4-4f55-8094-82325cecaed3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:02:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "2ebcf309-653e-4cc0-8e56-70592b70da8a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:02:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "2ebcf309-653e-4cc0-8e56-70592b70da8a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:02:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:02:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "dc40aa11-47e4-4f55-8094-82325cecaed3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:02:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "2ebcf309-653e-4cc0-8e56-70592b70da8a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:02:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:02:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:02:07 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:02:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:02:10 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:02:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:02:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:02:14 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:02:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:02:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:02:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:02:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:02:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:02:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:02:18 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:02:19 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:02:19 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 23:02:19 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Rebuilding the list of instances to heal {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 23:02:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-363f870e-a6d9-4664-9b9c-c343f3548b31" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:02:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-363f870e-a6d9-4664-9b9c-c343f3548b31" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:02:19 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 23:02:19 user nova-compute[72773]: DEBUG nova.objects.instance [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lazy-loading 'info_cache' on Instance uuid 363f870e-a6d9-4664-9b9c-c343f3548b31 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:02:20 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Updating instance_info_cache with network_info: [{"id": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "address": "fa:16:3e:43:25:e9", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda5c32fa-d8", "ovs_interfaceid": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:02:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-363f870e-a6d9-4664-9b9c-c343f3548b31" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:02:20 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 23:02:20 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:02:20 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:02:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:02:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:02:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:02:20 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 23:02:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:02:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:02:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:02:20 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:02:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 23:02:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 23:02:20 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 23:02:21 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:02:21 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:02:21 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=8544MB free_disk=25.376155853271484GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 23:02:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:02:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:02:21 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 363f870e-a6d9-4664-9b9c-c343f3548b31 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 23:02:21 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance dc40aa11-47e4-4f55-8094-82325cecaed3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 23:02:21 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 2ebcf309-653e-4cc0-8e56-70592b70da8a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 23:02:21 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 23:02:21 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 23:02:21 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:02:21 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:02:21 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 23:02:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:02:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:02:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:02:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:02:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:02:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:02:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:02:23 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:02:23 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 23:02:25 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:02:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:02:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:02:34 user nova-compute[72773]: DEBUG nova.compute.manager [req-0be9ad97-48d1-4e6a-97ed-5221f8fec5ec req-1125d304-9e2f-48fb-8ce5-2589c3645422 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Received event network-changed-da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:02:34 user nova-compute[72773]: DEBUG nova.compute.manager [req-0be9ad97-48d1-4e6a-97ed-5221f8fec5ec req-1125d304-9e2f-48fb-8ce5-2589c3645422 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Refreshing instance network info cache due to event network-changed-da5c32fa-d87d-47dc-8c64-1a4858645ade. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 23:02:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0be9ad97-48d1-4e6a-97ed-5221f8fec5ec req-1125d304-9e2f-48fb-8ce5-2589c3645422 service nova] Acquiring lock "refresh_cache-363f870e-a6d9-4664-9b9c-c343f3548b31" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:02:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0be9ad97-48d1-4e6a-97ed-5221f8fec5ec req-1125d304-9e2f-48fb-8ce5-2589c3645422 service nova] Acquired lock "refresh_cache-363f870e-a6d9-4664-9b9c-c343f3548b31" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:02:34 user nova-compute[72773]: DEBUG nova.network.neutron [req-0be9ad97-48d1-4e6a-97ed-5221f8fec5ec req-1125d304-9e2f-48fb-8ce5-2589c3645422 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Refreshing network info cache for port da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 23:02:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:02:35 user nova-compute[72773]: DEBUG nova.network.neutron [req-0be9ad97-48d1-4e6a-97ed-5221f8fec5ec req-1125d304-9e2f-48fb-8ce5-2589c3645422 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Updated VIF entry in instance network info cache for port da5c32fa-d87d-47dc-8c64-1a4858645ade. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 23:02:35 user nova-compute[72773]: DEBUG nova.network.neutron [req-0be9ad97-48d1-4e6a-97ed-5221f8fec5ec req-1125d304-9e2f-48fb-8ce5-2589c3645422 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Updating instance_info_cache with network_info: [{"id": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "address": "fa:16:3e:43:25:e9", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda5c32fa-d8", "ovs_interfaceid": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:02:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0be9ad97-48d1-4e6a-97ed-5221f8fec5ec req-1125d304-9e2f-48fb-8ce5-2589c3645422 service nova] Releasing lock "refresh_cache-363f870e-a6d9-4664-9b9c-c343f3548b31" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:02:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7d937fb2-ffb8-4095-9121-760846c73873 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "363f870e-a6d9-4664-9b9c-c343f3548b31" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:02:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7d937fb2-ffb8-4095-9121-760846c73873 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:02:35 user nova-compute[72773]: INFO nova.compute.manager [None req-7d937fb2-ffb8-4095-9121-760846c73873 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Detaching volume c6573055-49c0-4591-b1c1-0b3755121014
Aug 16 23:02:35 user nova-compute[72773]: INFO nova.virt.block_device [None req-7d937fb2-ffb8-4095-9121-760846c73873 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Attempting to driver detach volume c6573055-49c0-4591-b1c1-0b3755121014 from mountpoint /dev/vdb
Aug 16 23:02:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7d937fb2-ffb8-4095-9121-760846c73873 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Attempting to detach device vdb from instance 363f870e-a6d9-4664-9b9c-c343f3548b31 from the persistent domain config. {{(pid=72773) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 23:02:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-7d937fb2-ffb8-4095-9121-760846c73873 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 23:02:35 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 23:02:35 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 23:02:35 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 23:02:35 user nova-compute[72773]:   <serial>c6573055-49c0-4591-b1c1-0b3755121014</serial>
Aug 16 23:02:35 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 23:02:35 user nova-compute[72773]: </disk>
Aug 16 23:02:35 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 23:02:35 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-7d937fb2-ffb8-4095-9121-760846c73873 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Successfully detached device vdb from instance 363f870e-a6d9-4664-9b9c-c343f3548b31 from the persistent domain config.
Aug 16 23:02:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7d937fb2-ffb8-4095-9121-760846c73873 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 363f870e-a6d9-4664-9b9c-c343f3548b31 from the live domain config. {{(pid=72773) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 23:02:35 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-7d937fb2-ffb8-4095-9121-760846c73873 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 23:02:35 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 23:02:35 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 23:02:35 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 23:02:35 user nova-compute[72773]:   <serial>c6573055-49c0-4591-b1c1-0b3755121014</serial>
Aug 16 23:02:35 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 23:02:35 user nova-compute[72773]: </disk>
Aug 16 23:02:35 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 23:02:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Received event <DeviceRemovedEvent: 1692226956.1890852, 363f870e-a6d9-4664-9b9c-c343f3548b31 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72773) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7d937fb2-ffb8-4095-9121-760846c73873 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 363f870e-a6d9-4664-9b9c-c343f3548b31 {{(pid=72773) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 23:02:36 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-7d937fb2-ffb8-4095-9121-760846c73873 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Successfully detached device vdb from instance 363f870e-a6d9-4664-9b9c-c343f3548b31 from the live domain config.
Aug 16 23:02:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d937fb2-ffb8-4095-9121-760846c73873 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d937fb2-ffb8-4095-9121-760846c73873 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASwMcPFl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 23:02:36 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-7d937fb2-ffb8-4095-9121-760846c73873 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 23:02:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-7d937fb2-ffb8-4095-9121-760846c73873 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-7d937fb2-ffb8-4095-9121-760846c73873 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d937fb2-ffb8-4095-9121-760846c73873 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b2ebc9-064a-4273-a53f-8b57a7ce8f49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d7791c-8985-4579-8c27-e7dd8517d9d0]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d937fb2-ffb8-4095-9121-760846c73873 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 (non-flash)
Aug 16 23:02:36 user nova-compute[72773]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 (non-flash)
Aug 16 23:02:36 user nova-compute[72773]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca (non-flash)
Aug 16 23:02:36 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d937fb2-ffb8-4095-9121-760846c73873 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 (non-flash)
Aug 16 23:02:36 user nova-compute[72773]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 (non-flash)
Aug 16 23:02:36 user nova-compute[72773]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca (non-flash)
Aug 16 23:02:36 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d937fb2-ffb8-4095-9121-760846c73873 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef802b81f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014'): ({'sdc'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-7d937fb2-ffb8-4095-9121-760846c73873 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Removing single pathed devices sdc {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7946de7f-b6e1-4bf2-925e-73baed33d9e7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2064df-9c54-415a-b12f-9476887c9647]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-7d937fb2-ffb8-4095-9121-760846c73873 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Flushing IO for device /dev/sdc {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[411e5487-8ffe-4042-b8fa-9f85a2d7988f]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-7d937fb2-ffb8-4095-9121-760846c73873 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.029s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5a44e3-f572-4f02-99c5-2474aa9d9c87]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-7d937fb2-ffb8-4095-9121-760846c73873 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-7d937fb2-ffb8-4095-9121-760846c73873 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d937fb2-ffb8-4095-9121-760846c73873 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff9461b-7dd8-4a8c-8b75-3f9785902f3c]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d937fb2-ffb8-4095-9121-760846c73873 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6bdca1-0415-4785-a441-206261d5c382]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d937fb2-ffb8-4095-9121-760846c73873 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014, portal: 172.16.0.220,3260]
Aug 16 23:02:36 user nova-compute[72773]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014, portal: 172.16.0.220,3260] successful.
Aug 16 23:02:36 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6573055-49c0-4591-b1c1-0b3755121014 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[006a33a9-286d-47b6-acad-af6d2aa2cdf6]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d937fb2-ffb8-4095-9121-760846c73873 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-7d937fb2-ffb8-4095-9121-760846c73873 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d937fb2-ffb8-4095-9121-760846c73873 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] <== disconnect_volume: return (263ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d937fb2-ffb8-4095-9121-760846c73873 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG nova.compute.manager [req-df9c358b-3165-43e9-bc74-265db865b806 req-861bfcdf-7d8e-474a-94ad-c08ae0d90e78 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Received event network-changed-da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG nova.compute.manager [req-df9c358b-3165-43e9-bc74-265db865b806 req-861bfcdf-7d8e-474a-94ad-c08ae0d90e78 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Refreshing instance network info cache due to event network-changed-da5c32fa-d87d-47dc-8c64-1a4858645ade. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-df9c358b-3165-43e9-bc74-265db865b806 req-861bfcdf-7d8e-474a-94ad-c08ae0d90e78 service nova] Acquiring lock "refresh_cache-363f870e-a6d9-4664-9b9c-c343f3548b31" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-df9c358b-3165-43e9-bc74-265db865b806 req-861bfcdf-7d8e-474a-94ad-c08ae0d90e78 service nova] Acquired lock "refresh_cache-363f870e-a6d9-4664-9b9c-c343f3548b31" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG nova.network.neutron [req-df9c358b-3165-43e9-bc74-265db865b806 req-861bfcdf-7d8e-474a-94ad-c08ae0d90e78 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Refreshing network info cache for port da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG nova.network.neutron [req-df9c358b-3165-43e9-bc74-265db865b806 req-861bfcdf-7d8e-474a-94ad-c08ae0d90e78 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Updated VIF entry in instance network info cache for port da5c32fa-d87d-47dc-8c64-1a4858645ade. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 23:02:36 user nova-compute[72773]: DEBUG nova.network.neutron [req-df9c358b-3165-43e9-bc74-265db865b806 req-861bfcdf-7d8e-474a-94ad-c08ae0d90e78 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Updating instance_info_cache with network_info: [{"id": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "address": "fa:16:3e:43:25:e9", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda5c32fa-d8", "ovs_interfaceid": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:02:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-df9c358b-3165-43e9-bc74-265db865b806 req-861bfcdf-7d8e-474a-94ad-c08ae0d90e78 service nova] Releasing lock "refresh_cache-363f870e-a6d9-4664-9b9c-c343f3548b31" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:02:37 user nova-compute[72773]: DEBUG nova.objects.instance [None req-7d937fb2-ffb8-4095-9121-760846c73873 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lazy-loading 'flavor' on Instance uuid 363f870e-a6d9-4664-9b9c-c343f3548b31 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:02:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7d937fb2-ffb8-4095-9121-760846c73873 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.635s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:02:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:02:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:02:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:02:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:02:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:02:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:02:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:02:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:02:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:02:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:03:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:03:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:03:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:03:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:03:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:03:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:03:05 user nova-compute[72773]: DEBUG nova.compute.manager [req-d694ad77-8d6b-4a1c-ac49-61350045a320 req-caaaa752-1e6e-440c-8544-03ec619e298f service nova] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Received event network-changed-e8a47645-d43c-44d5-b377-323443f6ef46 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:03:05 user nova-compute[72773]: DEBUG nova.compute.manager [req-d694ad77-8d6b-4a1c-ac49-61350045a320 req-caaaa752-1e6e-440c-8544-03ec619e298f service nova] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Refreshing instance network info cache due to event network-changed-e8a47645-d43c-44d5-b377-323443f6ef46. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 23:03:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d694ad77-8d6b-4a1c-ac49-61350045a320 req-caaaa752-1e6e-440c-8544-03ec619e298f service nova] Acquiring lock "refresh_cache-2ebcf309-653e-4cc0-8e56-70592b70da8a" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:03:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d694ad77-8d6b-4a1c-ac49-61350045a320 req-caaaa752-1e6e-440c-8544-03ec619e298f service nova] Acquired lock "refresh_cache-2ebcf309-653e-4cc0-8e56-70592b70da8a" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:03:05 user nova-compute[72773]: DEBUG nova.network.neutron [req-d694ad77-8d6b-4a1c-ac49-61350045a320 req-caaaa752-1e6e-440c-8544-03ec619e298f service nova] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Refreshing network info cache for port e8a47645-d43c-44d5-b377-323443f6ef46 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 23:03:05 user nova-compute[72773]: DEBUG nova.network.neutron [req-d694ad77-8d6b-4a1c-ac49-61350045a320 req-caaaa752-1e6e-440c-8544-03ec619e298f service nova] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Updated VIF entry in instance network info cache for port e8a47645-d43c-44d5-b377-323443f6ef46. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 23:03:05 user nova-compute[72773]: DEBUG nova.network.neutron [req-d694ad77-8d6b-4a1c-ac49-61350045a320 req-caaaa752-1e6e-440c-8544-03ec619e298f service nova] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Updating instance_info_cache with network_info: [{"id": "e8a47645-d43c-44d5-b377-323443f6ef46", "address": "fa:16:3e:c3:9c:0f", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a47645-d4", "ovs_interfaceid": "e8a47645-d43c-44d5-b377-323443f6ef46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:03:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d694ad77-8d6b-4a1c-ac49-61350045a320 req-caaaa752-1e6e-440c-8544-03ec619e298f service nova] Releasing lock "refresh_cache-2ebcf309-653e-4cc0-8e56-70592b70da8a" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:03:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "2ebcf309-653e-4cc0-8e56-70592b70da8a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:03:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "2ebcf309-653e-4cc0-8e56-70592b70da8a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:03:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "2ebcf309-653e-4cc0-8e56-70592b70da8a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:03:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "2ebcf309-653e-4cc0-8e56-70592b70da8a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:03:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "2ebcf309-653e-4cc0-8e56-70592b70da8a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:03:05 user nova-compute[72773]: INFO nova.compute.manager [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Terminating instance
Aug 16 23:03:05 user nova-compute[72773]: DEBUG nova.compute.manager [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 23:03:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:03:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:03:05 user nova-compute[72773]: DEBUG nova.compute.manager [req-4167281c-0be6-4edc-a68e-327303ef458b req-c76f554d-da67-4a17-8a27-fbc51fb2d24f service nova] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Received event network-vif-unplugged-e8a47645-d43c-44d5-b377-323443f6ef46 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:03:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4167281c-0be6-4edc-a68e-327303ef458b req-c76f554d-da67-4a17-8a27-fbc51fb2d24f service nova] Acquiring lock "2ebcf309-653e-4cc0-8e56-70592b70da8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:03:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4167281c-0be6-4edc-a68e-327303ef458b req-c76f554d-da67-4a17-8a27-fbc51fb2d24f service nova] Lock "2ebcf309-653e-4cc0-8e56-70592b70da8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:03:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4167281c-0be6-4edc-a68e-327303ef458b req-c76f554d-da67-4a17-8a27-fbc51fb2d24f service nova] Lock "2ebcf309-653e-4cc0-8e56-70592b70da8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:03:05 user nova-compute[72773]: DEBUG nova.compute.manager [req-4167281c-0be6-4edc-a68e-327303ef458b req-c76f554d-da67-4a17-8a27-fbc51fb2d24f service nova] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] No waiting events found dispatching network-vif-unplugged-e8a47645-d43c-44d5-b377-323443f6ef46 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:03:05 user nova-compute[72773]: DEBUG nova.compute.manager [req-4167281c-0be6-4edc-a68e-327303ef458b req-c76f554d-da67-4a17-8a27-fbc51fb2d24f service nova] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Received event network-vif-unplugged-e8a47645-d43c-44d5-b377-323443f6ef46 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 23:03:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:03:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:03:06 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Instance destroyed successfully.
Aug 16 23:03:06 user nova-compute[72773]: DEBUG nova.objects.instance [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lazy-loading 'resources' on Instance uuid 2ebcf309-653e-4cc0-8e56-70592b70da8a {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T23:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1085067416',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1085067416',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1085067416',id=48,image_ref='cfe5ab92-2ec9-426a-bc9d-f94e98fd2245',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEgVyo3kYOnShFk/EPnq9qd/wTQU+/NFe9tH9h20UxppUrkQgOVZtnud3hTIHnLHkQrgHnE565vqUwPZOIirrfvv9OmS9x+aZedFTkDg7h7/mWdEbjpDRgl666nHgP3Pg==',key_name='tempest-keypair-312695082',keypairs=<?>,launch_index=0,launched_at=2023-08-16T23:01:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a51cd967e4254cfd9b8aee140f640682',ramdisk_id='',reservation_id='r-gl4ylu0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1862722655',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1862722655-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1862722655',owner_user_name='tempest-TestVolumeBootPattern-1862722655-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T23:01:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f12eb2e28904f63baa1ddce4641e180',uuid=2ebcf309-653e-4cc0-8e56-70592b70da8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8a47645-d43c-44d5-b377-323443f6ef46", "address": "fa:16:3e:c3:9c:0f", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a47645-d4", "ovs_interfaceid": "e8a47645-d43c-44d5-b377-323443f6ef46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converting VIF {"id": "e8a47645-d43c-44d5-b377-323443f6ef46", "address": "fa:16:3e:c3:9c:0f", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a47645-d4", "ovs_interfaceid": "e8a47645-d43c-44d5-b377-323443f6ef46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:9c:0f,bridge_name='br-int',has_traffic_filtering=True,id=e8a47645-d43c-44d5-b377-323443f6ef46,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a47645-d4') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG os_vif [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:9c:0f,bridge_name='br-int',has_traffic_filtering=True,id=e8a47645-d43c-44d5-b377-323443f6ef46,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a47645-d4') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8a47645-d4, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:03:06 user nova-compute[72773]: INFO os_vif [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:9c:0f,bridge_name='br-int',has_traffic_filtering=True,id=e8a47645-d43c-44d5-b377-323443f6ef46,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a47645-d4')
Aug 16 23:03:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HiDcOWsm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 23:03:06 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 23:03:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea82b8c-9904-4560-b886-7b39534cfcc2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da1cd4f-8db9-448a-9f03-e1f2cef37021]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 (non-flash)
Aug 16 23:03:06 user nova-compute[72773]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca (non-flash)
Aug 16 23:03:06 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 (non-flash)
Aug 16 23:03:06 user nova-compute[72773]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca (non-flash)
Aug 16 23:03:06 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef80208040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca'): ({'sdd'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Removing single pathed devices sdd {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d094793b-dd55-45b8-a865-4c8a5281b16c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea5975e-1a9f-4bbb-9142-28b4c6269d5e]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Flushing IO for device /dev/sdd {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79296b2-4b65-4492-a4f4-f144143eb9cb]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1540a5-fdab-4eaf-9003-282586140c85]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] SCSI volumes sdd have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb2165f-e7b6-4d80-8138-cb4beb39d1ee]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f20133-3b9b-4713-ae6a-04c8efb85587]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca, portal: 172.16.0.220,3260]
Aug 16 23:03:06 user nova-compute[72773]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca, portal: 172.16.0.220,3260] successful.
Aug 16 23:03:06 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f7ec364-c3d4-4996-9c3b-02be4fc94cca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d3125a-7982-481a-9266-42c3fbffe42f]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] <== disconnect_volume: return (295ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 23:03:06 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Deleting instance files /opt/stack/data/nova/instances/2ebcf309-653e-4cc0-8e56-70592b70da8a_del
Aug 16 23:03:06 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Deletion of /opt/stack/data/nova/instances/2ebcf309-653e-4cc0-8e56-70592b70da8a_del complete
Aug 16 23:03:06 user nova-compute[72773]: INFO nova.compute.manager [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 16 23:03:06 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 23:03:06 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 23:03:07 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:03:07 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Took 0.81 seconds to deallocate network for instance.
Aug 16 23:03:07 user nova-compute[72773]: DEBUG nova.compute.manager [req-913204d9-6fd4-4337-bef7-2622119479a5 req-53a6dec4-3567-4b72-954f-c1a4b8cc1640 service nova] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Received event network-vif-deleted-e8a47645-d43c-44d5-b377-323443f6ef46 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:03:07 user nova-compute[72773]: INFO nova.compute.manager [req-913204d9-6fd4-4337-bef7-2622119479a5 req-53a6dec4-3567-4b72-954f-c1a4b8cc1640 service nova] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Neutron deleted interface e8a47645-d43c-44d5-b377-323443f6ef46; detaching it from the instance and deleting it from the info cache
Aug 16 23:03:07 user nova-compute[72773]: DEBUG nova.network.neutron [req-913204d9-6fd4-4337-bef7-2622119479a5 req-53a6dec4-3567-4b72-954f-c1a4b8cc1640 service nova] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:03:07 user nova-compute[72773]: DEBUG nova.compute.manager [req-913204d9-6fd4-4337-bef7-2622119479a5 req-53a6dec4-3567-4b72-954f-c1a4b8cc1640 service nova] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Detach interface failed, port_id=e8a47645-d43c-44d5-b377-323443f6ef46, reason: Instance 2ebcf309-653e-4cc0-8e56-70592b70da8a could not be found. {{(pid=72773) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 23:03:07 user nova-compute[72773]: DEBUG nova.compute.manager [req-aac92a0a-009c-4550-af0b-8bccd8079b2b req-cd40a9bb-3411-4e94-a790-8f34f3bdf67a service nova] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Received event network-vif-plugged-e8a47645-d43c-44d5-b377-323443f6ef46 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:03:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-aac92a0a-009c-4550-af0b-8bccd8079b2b req-cd40a9bb-3411-4e94-a790-8f34f3bdf67a service nova] Acquiring lock "2ebcf309-653e-4cc0-8e56-70592b70da8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:03:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-aac92a0a-009c-4550-af0b-8bccd8079b2b req-cd40a9bb-3411-4e94-a790-8f34f3bdf67a service nova] Lock "2ebcf309-653e-4cc0-8e56-70592b70da8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:03:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-aac92a0a-009c-4550-af0b-8bccd8079b2b req-cd40a9bb-3411-4e94-a790-8f34f3bdf67a service nova] Lock "2ebcf309-653e-4cc0-8e56-70592b70da8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:03:07 user nova-compute[72773]: DEBUG nova.compute.manager [req-aac92a0a-009c-4550-af0b-8bccd8079b2b req-cd40a9bb-3411-4e94-a790-8f34f3bdf67a service nova] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] No waiting events found dispatching network-vif-plugged-e8a47645-d43c-44d5-b377-323443f6ef46 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:03:07 user nova-compute[72773]: WARNING nova.compute.manager [req-aac92a0a-009c-4550-af0b-8bccd8079b2b req-cd40a9bb-3411-4e94-a790-8f34f3bdf67a service nova] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Received unexpected event network-vif-plugged-e8a47645-d43c-44d5-b377-323443f6ef46 for instance with vm_state active and task_state deleting.
Aug 16 23:03:08 user nova-compute[72773]: INFO nova.compute.manager [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Took 0.81 seconds to detach 1 volumes for instance.
Aug 16 23:03:08 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:03:08 user nova-compute[72773]: DEBUG nova.compute.manager [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Deleting volume: 9f7ec364-c3d4-4996-9c3b-02be4fc94cca {{(pid=72773) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 23:03:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:03:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:03:08 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:03:08 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:03:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:03:08 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Deleted allocations for instance 2ebcf309-653e-4cc0-8e56-70592b70da8a
Aug 16 23:03:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8bc62be4-4d30-45ae-a4be-6828ba5136fa tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "2ebcf309-653e-4cc0-8e56-70592b70da8a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.177s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:03:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:03:12 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:03:16 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:03:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:03:18 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:03:19 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:03:19 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 23:03:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-dc40aa11-47e4-4f55-8094-82325cecaed3" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:03:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-dc40aa11-47e4-4f55-8094-82325cecaed3" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:03:19 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 23:03:19 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Updating instance_info_cache with network_info: [{"id": "a83fafa9-f889-4c34-9461-fa01dd2d02f0", "address": "fa:16:3e:9d:0c:f6", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83fafa9-f8", "ovs_interfaceid": "a83fafa9-f889-4c34-9461-fa01dd2d02f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:03:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-dc40aa11-47e4-4f55-8094-82325cecaed3" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:03:20 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 23:03:21 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692226986.3710759, 2ebcf309-653e-4cc0-8e56-70592b70da8a => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 23:03:21 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] VM Stopped (Lifecycle Event)
Aug 16 23:03:21 user nova-compute[72773]: DEBUG nova.compute.manager [None req-297c2036-2ea7-4195-a6dc-c5fda99e0367 None None] [instance: 2ebcf309-653e-4cc0-8e56-70592b70da8a] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 23:03:21 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:03:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:03:22 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:03:22 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 23:03:22 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:03:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:03:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:03:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:03:22 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 23:03:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:03:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:03:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:03:22 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:03:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 23:03:23 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:03:23 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:03:23 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=8677MB free_disk=25.375038146972656GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 23:03:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:03:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:03:23 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 363f870e-a6d9-4664-9b9c-c343f3548b31 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 23:03:23 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance dc40aa11-47e4-4f55-8094-82325cecaed3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 23:03:23 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 23:03:23 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 23:03:23 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:03:23 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:03:23 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 23:03:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:03:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:03:28 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:03:28 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:03:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:03:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e50fa8e0-3f44-4c26-9469-78c832ac2fa4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "363f870e-a6d9-4664-9b9c-c343f3548b31" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:03:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e50fa8e0-3f44-4c26-9469-78c832ac2fa4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:03:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e50fa8e0-3f44-4c26-9469-78c832ac2fa4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:03:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e50fa8e0-3f44-4c26-9469-78c832ac2fa4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:03:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e50fa8e0-3f44-4c26-9469-78c832ac2fa4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:03:32 user nova-compute[72773]: INFO nova.compute.manager [None req-e50fa8e0-3f44-4c26-9469-78c832ac2fa4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Terminating instance
Aug 16 23:03:32 user nova-compute[72773]: DEBUG nova.compute.manager [None req-e50fa8e0-3f44-4c26-9469-78c832ac2fa4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 23:03:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:03:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:03:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:03:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:03:32 user nova-compute[72773]: DEBUG nova.compute.manager [req-74bce9ab-de54-44ca-90a8-2794f9ba8658 req-8e5b3f84-f804-45e8-a387-4a618021d11d service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Received event network-vif-unplugged-da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:03:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-74bce9ab-de54-44ca-90a8-2794f9ba8658 req-8e5b3f84-f804-45e8-a387-4a618021d11d service nova] Acquiring lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:03:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-74bce9ab-de54-44ca-90a8-2794f9ba8658 req-8e5b3f84-f804-45e8-a387-4a618021d11d service nova] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:03:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-74bce9ab-de54-44ca-90a8-2794f9ba8658 req-8e5b3f84-f804-45e8-a387-4a618021d11d service nova] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:03:32 user nova-compute[72773]: DEBUG nova.compute.manager [req-74bce9ab-de54-44ca-90a8-2794f9ba8658 req-8e5b3f84-f804-45e8-a387-4a618021d11d service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] No waiting events found dispatching network-vif-unplugged-da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:03:32 user nova-compute[72773]: DEBUG nova.compute.manager [req-74bce9ab-de54-44ca-90a8-2794f9ba8658 req-8e5b3f84-f804-45e8-a387-4a618021d11d service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Received event network-vif-unplugged-da5c32fa-d87d-47dc-8c64-1a4858645ade for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 23:03:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:03:33 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Instance destroyed successfully.
Aug 16 23:03:33 user nova-compute[72773]: DEBUG nova.objects.instance [None req-e50fa8e0-3f44-4c26-9469-78c832ac2fa4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lazy-loading 'resources' on Instance uuid 363f870e-a6d9-4664-9b9c-c343f3548b31 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:03:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-e50fa8e0-3f44-4c26-9469-78c832ac2fa4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:58:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1929886723',display_name='tempest-TestMinimumBasicScenario-server-1929886723',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1929886723',id=46,image_ref='55396c78-d108-4d39-b9f2-7ba759f49030',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI402WRvzhHoWPlxJnK+49US+Dx0HFSoQpX0AVquPP6MN6mleC061OydIxKJZzm2AkNdqosEj7vZy2cxiyzg4zIOJkhRtfytxqslKlLgcdQwsAvlZWqlzYIUpZ5DKe1TIw==',key_name='tempest-TestMinimumBasicScenario-127360055',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:58:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de13176691174b7eab7cb53a49df2933',ramdisk_id='',reservation_id='r-544u47jf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='55396c78-d108-4d39-b9f2-7ba759f49030',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1869730972',owner_user_name='tempest-TestMinimumBasicScenario-1869730972-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T23:00:49Z,user_data=None,user_id='4d71f078c09c449ca7747a74d5bfb138',uuid=363f870e-a6d9-4664-9b9c-c343f3548b31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "address": "fa:16:3e:43:25:e9", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda5c32fa-d8", "ovs_interfaceid": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 23:03:33 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-e50fa8e0-3f44-4c26-9469-78c832ac2fa4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Converting VIF {"id": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "address": "fa:16:3e:43:25:e9", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda5c32fa-d8", "ovs_interfaceid": "da5c32fa-d87d-47dc-8c64-1a4858645ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 23:03:33 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-e50fa8e0-3f44-4c26-9469-78c832ac2fa4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:25:e9,bridge_name='br-int',has_traffic_filtering=True,id=da5c32fa-d87d-47dc-8c64-1a4858645ade,network=Network(206eb708-434c-424b-86c4-5f958178361d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda5c32fa-d8') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 23:03:33 user nova-compute[72773]: DEBUG os_vif [None req-e50fa8e0-3f44-4c26-9469-78c832ac2fa4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:25:e9,bridge_name='br-int',has_traffic_filtering=True,id=da5c32fa-d87d-47dc-8c64-1a4858645ade,network=Network(206eb708-434c-424b-86c4-5f958178361d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda5c32fa-d8') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 23:03:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:03:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda5c32fa-d8, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 23:03:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:03:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:03:33 user nova-compute[72773]: INFO os_vif [None req-e50fa8e0-3f44-4c26-9469-78c832ac2fa4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:25:e9,bridge_name='br-int',has_traffic_filtering=True,id=da5c32fa-d87d-47dc-8c64-1a4858645ade,network=Network(206eb708-434c-424b-86c4-5f958178361d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda5c32fa-d8')
Aug 16 23:03:33 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-e50fa8e0-3f44-4c26-9469-78c832ac2fa4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Deleting instance files /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31_del
Aug 16 23:03:33 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-e50fa8e0-3f44-4c26-9469-78c832ac2fa4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Deletion of /opt/stack/data/nova/instances/363f870e-a6d9-4664-9b9c-c343f3548b31_del complete
Aug 16 23:03:33 user nova-compute[72773]: INFO nova.compute.manager [None req-e50fa8e0-3f44-4c26-9469-78c832ac2fa4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 16 23:03:33 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-e50fa8e0-3f44-4c26-9469-78c832ac2fa4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 23:03:33 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 23:03:33 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 23:03:34 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:03:34 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Took 0.68 seconds to deallocate network for instance.
Aug 16 23:03:34 user nova-compute[72773]: DEBUG nova.compute.manager [req-29d23706-7700-4ecc-a1c7-9b7d305ec1c1 req-bbce9adb-beec-4384-a0e2-0f51b492f5d7 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Received event network-vif-deleted-da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:03:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e50fa8e0-3f44-4c26-9469-78c832ac2fa4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:03:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e50fa8e0-3f44-4c26-9469-78c832ac2fa4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:03:34 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-e50fa8e0-3f44-4c26-9469-78c832ac2fa4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:03:34 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-e50fa8e0-3f44-4c26-9469-78c832ac2fa4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:03:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e50fa8e0-3f44-4c26-9469-78c832ac2fa4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:03:34 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-e50fa8e0-3f44-4c26-9469-78c832ac2fa4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Deleted allocations for instance 363f870e-a6d9-4664-9b9c-c343f3548b31
Aug 16 23:03:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e50fa8e0-3f44-4c26-9469-78c832ac2fa4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.888s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:03:35 user nova-compute[72773]: DEBUG nova.compute.manager [req-ba596e47-3eff-4fc6-bc12-2c581b457249 req-aeb19b32-b004-4714-96dd-6c3b35bcf583 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Received event network-vif-plugged-da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:03:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ba596e47-3eff-4fc6-bc12-2c581b457249 req-aeb19b32-b004-4714-96dd-6c3b35bcf583 service nova] Acquiring lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:03:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ba596e47-3eff-4fc6-bc12-2c581b457249 req-aeb19b32-b004-4714-96dd-6c3b35bcf583 service nova] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:03:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-ba596e47-3eff-4fc6-bc12-2c581b457249 req-aeb19b32-b004-4714-96dd-6c3b35bcf583 service nova] Lock "363f870e-a6d9-4664-9b9c-c343f3548b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:03:35 user nova-compute[72773]: DEBUG nova.compute.manager [req-ba596e47-3eff-4fc6-bc12-2c581b457249 req-aeb19b32-b004-4714-96dd-6c3b35bcf583 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] No waiting events found dispatching network-vif-plugged-da5c32fa-d87d-47dc-8c64-1a4858645ade {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:03:35 user nova-compute[72773]: WARNING nova.compute.manager [req-ba596e47-3eff-4fc6-bc12-2c581b457249 req-aeb19b32-b004-4714-96dd-6c3b35bcf583 service nova] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Received unexpected event network-vif-plugged-da5c32fa-d87d-47dc-8c64-1a4858645ade for instance with vm_state deleted and task_state None.
Aug 16 23:03:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:03:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:03:48 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692227013.3824406, 363f870e-a6d9-4664-9b9c-c343f3548b31 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 23:03:48 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] VM Stopped (Lifecycle Event)
Aug 16 23:03:48 user nova-compute[72773]: DEBUG nova.compute.manager [None req-97219390-ed3a-4331-8bb6-b2c0d54435d0 None None] [instance: 363f870e-a6d9-4664-9b9c-c343f3548b31] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 23:03:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:03:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:03:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:03:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:03:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:03:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:03:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:03:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:04:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "dc40aa11-47e4-4f55-8094-82325cecaed3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:04:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "dc40aa11-47e4-4f55-8094-82325cecaed3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:04:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "dc40aa11-47e4-4f55-8094-82325cecaed3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:04:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "dc40aa11-47e4-4f55-8094-82325cecaed3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:04:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "dc40aa11-47e4-4f55-8094-82325cecaed3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:04:02 user nova-compute[72773]: INFO nova.compute.manager [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Terminating instance
Aug 16 23:04:02 user nova-compute[72773]: DEBUG nova.compute.manager [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 23:04:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:04:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:04:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:04:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:04:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:04:02 user nova-compute[72773]: DEBUG nova.compute.manager [req-4ea6027d-7da3-4044-9d99-78459d365ff7 req-97724c08-8605-4380-8c81-ed430de92bff service nova] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Received event network-vif-unplugged-a83fafa9-f889-4c34-9461-fa01dd2d02f0 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:04:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4ea6027d-7da3-4044-9d99-78459d365ff7 req-97724c08-8605-4380-8c81-ed430de92bff service nova] Acquiring lock "dc40aa11-47e4-4f55-8094-82325cecaed3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:04:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4ea6027d-7da3-4044-9d99-78459d365ff7 req-97724c08-8605-4380-8c81-ed430de92bff service nova] Lock "dc40aa11-47e4-4f55-8094-82325cecaed3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:04:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4ea6027d-7da3-4044-9d99-78459d365ff7 req-97724c08-8605-4380-8c81-ed430de92bff service nova] Lock "dc40aa11-47e4-4f55-8094-82325cecaed3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:04:02 user nova-compute[72773]: DEBUG nova.compute.manager [req-4ea6027d-7da3-4044-9d99-78459d365ff7 req-97724c08-8605-4380-8c81-ed430de92bff service nova] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] No waiting events found dispatching network-vif-unplugged-a83fafa9-f889-4c34-9461-fa01dd2d02f0 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:04:02 user nova-compute[72773]: DEBUG nova.compute.manager [req-4ea6027d-7da3-4044-9d99-78459d365ff7 req-97724c08-8605-4380-8c81-ed430de92bff service nova] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Received event network-vif-unplugged-a83fafa9-f889-4c34-9461-fa01dd2d02f0 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 23:04:03 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Instance destroyed successfully.
Aug 16 23:04:03 user nova-compute[72773]: DEBUG nova.objects.instance [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lazy-loading 'resources' on Instance uuid dc40aa11-47e4-4f55-8094-82325cecaed3 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T22:59:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1344760515',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1344760515',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1344760515',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWoAtdvBZRfe6tB1t5V/+l0ubbrC4BW1rPYZWoMn73jnXuA76yJ3hyK8eQpR/Ekj5OlzXkYPYgr0iUxilvQhGqq8DUZmJ6kR89j8Sz5m6434ZOsX+Q1wSxxjsT4JBCdKQ==',key_name='tempest-keypair-122471341',keypairs=<?>,launch_index=0,launched_at=2023-08-16T22:59:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a51cd967e4254cfd9b8aee140f640682',ramdisk_id='',reservation_id='r-zt59g8a6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1862722655',owner_user_name='tempest-TestVolumeBootPattern-1862722655-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T22:59:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f12eb2e28904f63baa1ddce4641e180',uuid=dc40aa11-47e4-4f55-8094-82325cecaed3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a83fafa9-f889-4c34-9461-fa01dd2d02f0", "address": "fa:16:3e:9d:0c:f6", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83fafa9-f8", "ovs_interfaceid": "a83fafa9-f889-4c34-9461-fa01dd2d02f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converting VIF {"id": "a83fafa9-f889-4c34-9461-fa01dd2d02f0", "address": "fa:16:3e:9d:0c:f6", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83fafa9-f8", "ovs_interfaceid": "a83fafa9-f889-4c34-9461-fa01dd2d02f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:0c:f6,bridge_name='br-int',has_traffic_filtering=True,id=a83fafa9-f889-4c34-9461-fa01dd2d02f0,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa83fafa9-f8') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG os_vif [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:0c:f6,bridge_name='br-int',has_traffic_filtering=True,id=a83fafa9-f889-4c34-9461-fa01dd2d02f0,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa83fafa9-f8') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa83fafa9-f8, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:04:03 user nova-compute[72773]: INFO os_vif [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:0c:f6,bridge_name='br-int',has_traffic_filtering=True,id=a83fafa9-f889-4c34-9461-fa01dd2d02f0,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa83fafa9-f8')
Aug 16 23:04:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTfHvFNP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 23:04:03 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 23:04:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4389d6a-4e54-484a-a9d4-5f74194304ad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c515693-67ae-4cb8-9c57-c41e38ae174f]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 (non-flash)
Aug 16 23:04:03 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 (non-flash)
Aug 16 23:04:03 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef5c585990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67'): ({'sdb'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Removing single pathed devices sdb {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d34964-17aa-46d4-bc3f-4de6853bedaa]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16315a8-4f95-48b7-807b-a6eb73667150]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Flushing IO for device /dev/sdb {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f19419-c20a-42f5-ad7a-df8ac096169b]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[23624d22-8425-4abb-9302-ad84ba2595dd]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] SCSI volumes sdb have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26237326237353964', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_bfda7193', '/dev/disk/by-id/scsi-1SCST_BIObfda7193-b72b759d9f19bb98') {{(pid=83955) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8b5828-0c0d-4bd0-a5de-acab5476ca3f]: (4, None) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f4ab82-4fba-4bea-802c-13181353bb81]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a348e3-5c54-408a-975c-4d98d103cbb2]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67, portal: 172.16.0.220,3260]
Aug 16 23:04:03 user nova-compute[72773]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67, portal: 172.16.0.220,3260] successful.
Aug 16 23:04:03 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b49290-0253-4600-b8ac-cffd2b758b67 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[406a2e8b-727d-4a56-95c1-f641e54d24d7]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] <== disconnect_volume: return (290ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 23:04:03 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Deleting instance files /opt/stack/data/nova/instances/dc40aa11-47e4-4f55-8094-82325cecaed3_del
Aug 16 23:04:03 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Deletion of /opt/stack/data/nova/instances/dc40aa11-47e4-4f55-8094-82325cecaed3_del complete
Aug 16 23:04:03 user nova-compute[72773]: INFO nova.compute.manager [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 16 23:04:03 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 23:04:03 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 23:04:04 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:04:04 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Took 1.09 seconds to deallocate network for instance.
Aug 16 23:04:04 user nova-compute[72773]: DEBUG nova.compute.manager [req-d98b952b-f6bd-4dfe-92bd-9a7ca155ce36 req-0cbcdd74-61c6-4531-8953-01b28c5cd59c service nova] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Received event network-vif-plugged-a83fafa9-f889-4c34-9461-fa01dd2d02f0 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:04:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d98b952b-f6bd-4dfe-92bd-9a7ca155ce36 req-0cbcdd74-61c6-4531-8953-01b28c5cd59c service nova] Acquiring lock "dc40aa11-47e4-4f55-8094-82325cecaed3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:04:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d98b952b-f6bd-4dfe-92bd-9a7ca155ce36 req-0cbcdd74-61c6-4531-8953-01b28c5cd59c service nova] Lock "dc40aa11-47e4-4f55-8094-82325cecaed3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:04:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d98b952b-f6bd-4dfe-92bd-9a7ca155ce36 req-0cbcdd74-61c6-4531-8953-01b28c5cd59c service nova] Lock "dc40aa11-47e4-4f55-8094-82325cecaed3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:04:04 user nova-compute[72773]: DEBUG nova.compute.manager [req-d98b952b-f6bd-4dfe-92bd-9a7ca155ce36 req-0cbcdd74-61c6-4531-8953-01b28c5cd59c service nova] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] No waiting events found dispatching network-vif-plugged-a83fafa9-f889-4c34-9461-fa01dd2d02f0 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:04:04 user nova-compute[72773]: WARNING nova.compute.manager [req-d98b952b-f6bd-4dfe-92bd-9a7ca155ce36 req-0cbcdd74-61c6-4531-8953-01b28c5cd59c service nova] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Received unexpected event network-vif-plugged-a83fafa9-f889-4c34-9461-fa01dd2d02f0 for instance with vm_state active and task_state deleting.
Aug 16 23:04:04 user nova-compute[72773]: DEBUG nova.compute.manager [req-d98b952b-f6bd-4dfe-92bd-9a7ca155ce36 req-0cbcdd74-61c6-4531-8953-01b28c5cd59c service nova] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Received event network-vif-deleted-a83fafa9-f889-4c34-9461-fa01dd2d02f0 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:04:05 user nova-compute[72773]: INFO nova.compute.manager [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Took 0.77 seconds to detach 1 volumes for instance.
Aug 16 23:04:05 user nova-compute[72773]: DEBUG nova.compute.manager [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Deleting volume: 53b49290-0253-4600-b8ac-cffd2b758b67 {{(pid=72773) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 23:04:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:04:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:04:05 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:04:05 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:04:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.216s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:04:05 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Deleted allocations for instance dc40aa11-47e4-4f55-8094-82325cecaed3
Aug 16 23:04:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4a87103d-aad8-41ea-b991-dea54818836f tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "dc40aa11-47e4-4f55-8094-82325cecaed3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.438s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:04:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:04:09 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:04:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:04:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:04:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:04:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:04:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:04:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:04:14 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:04:18 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692227043.1437488, dc40aa11-47e4-4f55-8094-82325cecaed3 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 23:04:18 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] VM Stopped (Lifecycle Event)
Aug 16 23:04:18 user nova-compute[72773]: DEBUG nova.compute.manager [None req-d7b01f45-3f8f-417e-b38c-e32294c69e45 None None] [instance: dc40aa11-47e4-4f55-8094-82325cecaed3] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 23:04:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:04:18 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:04:19 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:04:21 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:04:21 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 23:04:21 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Didn't find any instances for network info cache update. {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 23:04:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:04:23 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:04:23 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:04:23 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 23:04:24 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:04:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:04:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:04:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:04:24 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 23:04:24 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:04:24 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:04:24 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=8912MB free_disk=25.441787719726562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 23:04:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:04:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:04:24 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 23:04:24 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 23:04:24 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:04:24 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:04:24 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 23:04:24 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:04:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "2f05f5de-bf0b-4034-a755-a5f526a7b893" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:04:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "2f05f5de-bf0b-4034-a755-a5f526a7b893" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:04:26 user nova-compute[72773]: DEBUG nova.compute.manager [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 23:04:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:04:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:04:26 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 23:04:26 user nova-compute[72773]: INFO nova.compute.claims [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Claim successful on node user
Aug 16 23:04:26 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:04:26 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:04:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.178s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:04:26 user nova-compute[72773]: DEBUG nova.compute.manager [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 23:04:26 user nova-compute[72773]: DEBUG nova.compute.manager [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 23:04:26 user nova-compute[72773]: DEBUG nova.network.neutron [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 23:04:26 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 23:04:26 user nova-compute[72773]: DEBUG nova.compute.manager [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 23:04:26 user nova-compute[72773]: DEBUG nova.compute.manager [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 23:04:26 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 23:04:26 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Creating image(s)
Aug 16 23:04:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f05f5de-bf0b-4034-a755-a5f526a7b893/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:04:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "/opt/stack/data/nova/instances/2f05f5de-bf0b-4034-a755-a5f526a7b893/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:04:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "/opt/stack/data/nova/instances/2f05f5de-bf0b-4034-a755-a5f526a7b893/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:04:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "a01baf45110e83479ff5f192693bae6e73184c57" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:04:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "a01baf45110e83479ff5f192693bae6e73184c57" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:04:26 user nova-compute[72773]: DEBUG nova.policy [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d71f078c09c449ca7747a74d5bfb138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de13176691174b7eab7cb53a49df2933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 23:04:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a01baf45110e83479ff5f192693bae6e73184c57.part --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:04:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a01baf45110e83479ff5f192693bae6e73184c57.part --force-share --output=json" returned: 0 in 0.190s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:04:27 user nova-compute[72773]: DEBUG nova.virt.images [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] 6783777a-68fc-4e6d-89dd-68928fda3795 was qcow2, converting to raw {{(pid=72773) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 23:04:27 user nova-compute[72773]: DEBUG nova.privsep.utils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72773) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 23:04:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a01baf45110e83479ff5f192693bae6e73184c57.part /opt/stack/data/nova/instances/_base/a01baf45110e83479ff5f192693bae6e73184c57.converted {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:04:27 user nova-compute[72773]: DEBUG nova.network.neutron [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Successfully created port: fbfbc293-8e8d-42cb-a48b-acbb18db85e1 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 23:04:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a01baf45110e83479ff5f192693bae6e73184c57.part /opt/stack/data/nova/instances/_base/a01baf45110e83479ff5f192693bae6e73184c57.converted" returned: 0 in 0.303s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:04:27 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a01baf45110e83479ff5f192693bae6e73184c57.converted --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:04:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a01baf45110e83479ff5f192693bae6e73184c57.converted --force-share --output=json" returned: 0 in 0.192s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:04:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "a01baf45110e83479ff5f192693bae6e73184c57" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.196s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:04:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a01baf45110e83479ff5f192693bae6e73184c57 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:04:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:04:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a01baf45110e83479ff5f192693bae6e73184c57 --force-share --output=json" returned: 0 in 0.190s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:04:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "a01baf45110e83479ff5f192693bae6e73184c57" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:04:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "a01baf45110e83479ff5f192693bae6e73184c57" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:04:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a01baf45110e83479ff5f192693bae6e73184c57 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:04:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a01baf45110e83479ff5f192693bae6e73184c57 --force-share --output=json" returned: 0 in 0.221s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:04:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a01baf45110e83479ff5f192693bae6e73184c57,backing_fmt=raw /opt/stack/data/nova/instances/2f05f5de-bf0b-4034-a755-a5f526a7b893/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:04:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a01baf45110e83479ff5f192693bae6e73184c57,backing_fmt=raw /opt/stack/data/nova/instances/2f05f5de-bf0b-4034-a755-a5f526a7b893/disk 1073741824" returned: 0 in 0.049s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:04:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "a01baf45110e83479ff5f192693bae6e73184c57" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:04:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a01baf45110e83479ff5f192693bae6e73184c57 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:04:28 user nova-compute[72773]: DEBUG nova.network.neutron [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Successfully updated port: fbfbc293-8e8d-42cb-a48b-acbb18db85e1 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 23:04:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "refresh_cache-2f05f5de-bf0b-4034-a755-a5f526a7b893" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:04:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquired lock "refresh_cache-2f05f5de-bf0b-4034-a755-a5f526a7b893" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:04:28 user nova-compute[72773]: DEBUG nova.network.neutron [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 23:04:28 user nova-compute[72773]: DEBUG nova.compute.manager [req-980a1076-c6fb-4fb1-ba52-9eabcf9eba8e req-8e2334fa-000c-4d45-bd23-21da553386df service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Received event network-changed-fbfbc293-8e8d-42cb-a48b-acbb18db85e1 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:04:28 user nova-compute[72773]: DEBUG nova.compute.manager [req-980a1076-c6fb-4fb1-ba52-9eabcf9eba8e req-8e2334fa-000c-4d45-bd23-21da553386df service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Refreshing instance network info cache due to event network-changed-fbfbc293-8e8d-42cb-a48b-acbb18db85e1. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 23:04:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-980a1076-c6fb-4fb1-ba52-9eabcf9eba8e req-8e2334fa-000c-4d45-bd23-21da553386df service nova] Acquiring lock "refresh_cache-2f05f5de-bf0b-4034-a755-a5f526a7b893" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:04:28 user nova-compute[72773]: DEBUG nova.network.neutron [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 23:04:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a01baf45110e83479ff5f192693bae6e73184c57 --force-share --output=json" returned: 0 in 0.187s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:04:28 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f05f5de-bf0b-4034-a755-a5f526a7b893/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 23:04:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f05f5de-bf0b-4034-a755-a5f526a7b893/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:04:28 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f05f5de-bf0b-4034-a755-a5f526a7b893/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:04:28 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Cannot resize image /opt/stack/data/nova/instances/2f05f5de-bf0b-4034-a755-a5f526a7b893/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 23:04:28 user nova-compute[72773]: DEBUG nova.objects.instance [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lazy-loading 'migration_context' on Instance uuid 2f05f5de-bf0b-4034-a755-a5f526a7b893 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:04:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 23:04:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Ensure instance console log exists: /opt/stack/data/nova/instances/2f05f5de-bf0b-4034-a755-a5f526a7b893/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 23:04:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:04:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:04:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:04:28 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG nova.network.neutron [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Updating instance_info_cache with network_info: [{"id": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "address": "fa:16:3e:6b:1d:44", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbfbc293-8e", "ovs_interfaceid": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Releasing lock "refresh_cache-2f05f5de-bf0b-4034-a755-a5f526a7b893" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Instance network_info: |[{"id": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "address": "fa:16:3e:6b:1d:44", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbfbc293-8e", "ovs_interfaceid": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-980a1076-c6fb-4fb1-ba52-9eabcf9eba8e req-8e2334fa-000c-4d45-bd23-21da553386df service nova] Acquired lock "refresh_cache-2f05f5de-bf0b-4034-a755-a5f526a7b893" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG nova.network.neutron [req-980a1076-c6fb-4fb1-ba52-9eabcf9eba8e req-8e2334fa-000c-4d45-bd23-21da553386df service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Refreshing network info cache for port fbfbc293-8e8d-42cb-a48b-acbb18db85e1 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Start _get_guest_xml network_info=[{"id": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "address": "fa:16:3e:6b:1d:44", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbfbc293-8e", "ovs_interfaceid": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T23:04:24Z,direct_url=<?>,disk_format='qcow2',id=6783777a-68fc-4e6d-89dd-68928fda3795,min_disk=0,min_ram=0,name='tempest-scenario-img--1624275940',owner='de13176691174b7eab7cb53a49df2933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T23:04:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '6783777a-68fc-4e6d-89dd-68928fda3795'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 23:04:29 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:04:29 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:04:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T23:04:24Z,direct_url=<?>,disk_format='qcow2',id=6783777a-68fc-4e6d-89dd-68928fda3795,min_disk=0,min_ram=0,name='tempest-scenario-img--1624275940',owner='de13176691174b7eab7cb53a49df2933',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T23:04:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T23:04:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-453993895',display_name='tempest-TestMinimumBasicScenario-server-453993895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-453993895',id=49,image_ref='6783777a-68fc-4e6d-89dd-68928fda3795',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUV7FQulcTeSGbSdFwxTCqodoEZ+8sBBrvn1GuL4aEuKQ0KQiKfhOZQ9ne0gqbcIfrYg9mvfdF4csttr0nrB42mU5qtOj+7t0t2b7/AXqi5W723TnkW5sUn8KyaSB7Gjg==',key_name='tempest-TestMinimumBasicScenario-460007714',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de13176691174b7eab7cb53a49df2933',ramdisk_id='',reservation_id='r-xw7b1qfq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6783777a-68fc-4e6d-89dd-68928fda3795',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1869730972',owner_user_name='tempest-TestMinimumBasicScenario-1869730972-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T23:04:27Z,user_data=None,user_id='4d71f078c09c449ca7747a74d5bfb138',uuid=2f05f5de-bf0b-4034-a755-a5f526a7b893,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "address": "fa:16:3e:6b:1d:44", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbfbc293-8e", "ovs_interfaceid": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Converting VIF {"id": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "address": "fa:16:3e:6b:1d:44", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbfbc293-8e", "ovs_interfaceid": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:1d:44,bridge_name='br-int',has_traffic_filtering=True,id=fbfbc293-8e8d-42cb-a48b-acbb18db85e1,network=Network(206eb708-434c-424b-86c4-5f958178361d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbfbc293-8e') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG nova.objects.instance [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f05f5de-bf0b-4034-a755-a5f526a7b893 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] End _get_guest_xml xml=<domain type="kvm">
Aug 16 23:04:29 user nova-compute[72773]:   <uuid>2f05f5de-bf0b-4034-a755-a5f526a7b893</uuid>
Aug 16 23:04:29 user nova-compute[72773]:   <name>instance-00000031</name>
Aug 16 23:04:29 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 23:04:29 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 23:04:29 user nova-compute[72773]:   <metadata>
Aug 16 23:04:29 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 23:04:29 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 23:04:29 user nova-compute[72773]:       <nova:name>tempest-TestMinimumBasicScenario-server-453993895</nova:name>
Aug 16 23:04:29 user nova-compute[72773]:       <nova:creationTime>2023-08-16 23:04:29</nova:creationTime>
Aug 16 23:04:29 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 23:04:29 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 23:04:29 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 23:04:29 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 23:04:29 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 23:04:29 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 23:04:29 user nova-compute[72773]:       </nova:flavor>
Aug 16 23:04:29 user nova-compute[72773]:       <nova:owner>
Aug 16 23:04:29 user nova-compute[72773]:         <nova:user uuid="4d71f078c09c449ca7747a74d5bfb138">tempest-TestMinimumBasicScenario-1869730972-project-member</nova:user>
Aug 16 23:04:29 user nova-compute[72773]:         <nova:project uuid="de13176691174b7eab7cb53a49df2933">tempest-TestMinimumBasicScenario-1869730972</nova:project>
Aug 16 23:04:29 user nova-compute[72773]:       </nova:owner>
Aug 16 23:04:29 user nova-compute[72773]:       <nova:root type="image" uuid="6783777a-68fc-4e6d-89dd-68928fda3795"/>
Aug 16 23:04:29 user nova-compute[72773]:       <nova:ports>
Aug 16 23:04:29 user nova-compute[72773]:         <nova:port uuid="fbfbc293-8e8d-42cb-a48b-acbb18db85e1">
Aug 16 23:04:29 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 23:04:29 user nova-compute[72773]:         </nova:port>
Aug 16 23:04:29 user nova-compute[72773]:       </nova:ports>
Aug 16 23:04:29 user nova-compute[72773]:     </nova:instance>
Aug 16 23:04:29 user nova-compute[72773]:   </metadata>
Aug 16 23:04:29 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 23:04:29 user nova-compute[72773]:     <system>
Aug 16 23:04:29 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 23:04:29 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 23:04:29 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 23:04:29 user nova-compute[72773]:       <entry name="serial">2f05f5de-bf0b-4034-a755-a5f526a7b893</entry>
Aug 16 23:04:29 user nova-compute[72773]:       <entry name="uuid">2f05f5de-bf0b-4034-a755-a5f526a7b893</entry>
Aug 16 23:04:29 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 23:04:29 user nova-compute[72773]:     </system>
Aug 16 23:04:29 user nova-compute[72773]:   </sysinfo>
Aug 16 23:04:29 user nova-compute[72773]:   <os>
Aug 16 23:04:29 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 23:04:29 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 23:04:29 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 23:04:29 user nova-compute[72773]:   </os>
Aug 16 23:04:29 user nova-compute[72773]:   <features>
Aug 16 23:04:29 user nova-compute[72773]:     <acpi/>
Aug 16 23:04:29 user nova-compute[72773]:     <apic/>
Aug 16 23:04:29 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 23:04:29 user nova-compute[72773]:   </features>
Aug 16 23:04:29 user nova-compute[72773]:   <clock offset="utc">
Aug 16 23:04:29 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 23:04:29 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 23:04:29 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 23:04:29 user nova-compute[72773]:   </clock>
Aug 16 23:04:29 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 23:04:29 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 23:04:29 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 23:04:29 user nova-compute[72773]:   </cpu>
Aug 16 23:04:29 user nova-compute[72773]:   <devices>
Aug 16 23:04:29 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 23:04:29 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 23:04:29 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/2f05f5de-bf0b-4034-a755-a5f526a7b893/disk"/>
Aug 16 23:04:29 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 23:04:29 user nova-compute[72773]:     </disk>
Aug 16 23:04:29 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 23:04:29 user nova-compute[72773]:       <mac address="fa:16:3e:6b:1d:44"/>
Aug 16 23:04:29 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 23:04:29 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 23:04:29 user nova-compute[72773]:       <target dev="tapfbfbc293-8e"/>
Aug 16 23:04:29 user nova-compute[72773]:     </interface>
Aug 16 23:04:29 user nova-compute[72773]:     <serial type="pty">
Aug 16 23:04:29 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/2f05f5de-bf0b-4034-a755-a5f526a7b893/console.log" append="off"/>
Aug 16 23:04:29 user nova-compute[72773]:     </serial>
Aug 16 23:04:29 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 23:04:29 user nova-compute[72773]:     <video>
Aug 16 23:04:29 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 23:04:29 user nova-compute[72773]:     </video>
Aug 16 23:04:29 user nova-compute[72773]:     <rng model="virtio">
Aug 16 23:04:29 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 23:04:29 user nova-compute[72773]:     </rng>
Aug 16 23:04:29 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 23:04:29 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 23:04:29 user nova-compute[72773]:       <stats period="10"/>
Aug 16 23:04:29 user nova-compute[72773]:     </memballoon>
Aug 16 23:04:29 user nova-compute[72773]:   </devices>
Aug 16 23:04:29 user nova-compute[72773]: </domain>
Aug 16 23:04:29 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T23:04:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-453993895',display_name='tempest-TestMinimumBasicScenario-server-453993895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-453993895',id=49,image_ref='6783777a-68fc-4e6d-89dd-68928fda3795',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUV7FQulcTeSGbSdFwxTCqodoEZ+8sBBrvn1GuL4aEuKQ0KQiKfhOZQ9ne0gqbcIfrYg9mvfdF4csttr0nrB42mU5qtOj+7t0t2b7/AXqi5W723TnkW5sUn8KyaSB7Gjg==',key_name='tempest-TestMinimumBasicScenario-460007714',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de13176691174b7eab7cb53a49df2933',ramdisk_id='',reservation_id='r-xw7b1qfq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6783777a-68fc-4e6d-89dd-68928fda3795',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1869730972',owner_user_name='tempest-TestMinimumBasicScenario-1869730972-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T23:04:27Z,user_data=None,user_id='4d71f078c09c449ca7747a74d5bfb138',uuid=2f05f5de-bf0b-4034-a755-a5f526a7b893,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "address": "fa:16:3e:6b:1d:44", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbfbc293-8e", "ovs_interfaceid": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Converting VIF {"id": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "address": "fa:16:3e:6b:1d:44", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbfbc293-8e", "ovs_interfaceid": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:1d:44,bridge_name='br-int',has_traffic_filtering=True,id=fbfbc293-8e8d-42cb-a48b-acbb18db85e1,network=Network(206eb708-434c-424b-86c4-5f958178361d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbfbc293-8e') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG os_vif [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:1d:44,bridge_name='br-int',has_traffic_filtering=True,id=fbfbc293-8e8d-42cb-a48b-acbb18db85e1,network=Network(206eb708-434c-424b-86c4-5f958178361d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbfbc293-8e') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfbfbc293-8e, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfbfbc293-8e, col_values=(('external_ids', {'iface-id': 'fbfbc293-8e8d-42cb-a48b-acbb18db85e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:1d:44', 'vm-uuid': '2f05f5de-bf0b-4034-a755-a5f526a7b893'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:04:29 user nova-compute[72773]: INFO os_vif [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:1d:44,bridge_name='br-int',has_traffic_filtering=True,id=fbfbc293-8e8d-42cb-a48b-acbb18db85e1,network=Network(206eb708-434c-424b-86c4-5f958178361d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbfbc293-8e')
Aug 16 23:04:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] No VIF found with MAC fa:16:3e:6b:1d:44, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG nova.network.neutron [req-980a1076-c6fb-4fb1-ba52-9eabcf9eba8e req-8e2334fa-000c-4d45-bd23-21da553386df service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Updated VIF entry in instance network info cache for port fbfbc293-8e8d-42cb-a48b-acbb18db85e1. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG nova.network.neutron [req-980a1076-c6fb-4fb1-ba52-9eabcf9eba8e req-8e2334fa-000c-4d45-bd23-21da553386df service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Updating instance_info_cache with network_info: [{"id": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "address": "fa:16:3e:6b:1d:44", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbfbc293-8e", "ovs_interfaceid": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:04:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-980a1076-c6fb-4fb1-ba52-9eabcf9eba8e req-8e2334fa-000c-4d45-bd23-21da553386df service nova] Releasing lock "refresh_cache-2f05f5de-bf0b-4034-a755-a5f526a7b893" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:04:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:04:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:04:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:04:30 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:04:30 user nova-compute[72773]: DEBUG nova.compute.manager [req-c26ec21c-8641-4b41-9dba-5a2c7bec8954 req-99ee6a31-fd6c-435d-83d8-46cc16a1817e service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Received event network-vif-plugged-fbfbc293-8e8d-42cb-a48b-acbb18db85e1 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:04:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c26ec21c-8641-4b41-9dba-5a2c7bec8954 req-99ee6a31-fd6c-435d-83d8-46cc16a1817e service nova] Acquiring lock "2f05f5de-bf0b-4034-a755-a5f526a7b893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:04:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c26ec21c-8641-4b41-9dba-5a2c7bec8954 req-99ee6a31-fd6c-435d-83d8-46cc16a1817e service nova] Lock "2f05f5de-bf0b-4034-a755-a5f526a7b893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:04:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c26ec21c-8641-4b41-9dba-5a2c7bec8954 req-99ee6a31-fd6c-435d-83d8-46cc16a1817e service nova] Lock "2f05f5de-bf0b-4034-a755-a5f526a7b893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:04:30 user nova-compute[72773]: DEBUG nova.compute.manager [req-c26ec21c-8641-4b41-9dba-5a2c7bec8954 req-99ee6a31-fd6c-435d-83d8-46cc16a1817e service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] No waiting events found dispatching network-vif-plugged-fbfbc293-8e8d-42cb-a48b-acbb18db85e1 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:04:30 user nova-compute[72773]: WARNING nova.compute.manager [req-c26ec21c-8641-4b41-9dba-5a2c7bec8954 req-99ee6a31-fd6c-435d-83d8-46cc16a1817e service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Received unexpected event network-vif-plugged-fbfbc293-8e8d-42cb-a48b-acbb18db85e1 for instance with vm_state building and task_state spawning.
Aug 16 23:04:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:04:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:04:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:04:32 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692227072.5963786, 2f05f5de-bf0b-4034-a755-a5f526a7b893 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 23:04:32 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] VM Resumed (Lifecycle Event)
Aug 16 23:04:32 user nova-compute[72773]: DEBUG nova.compute.manager [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 23:04:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 23:04:32 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Instance spawned successfully.
Aug 16 23:04:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 23:04:32 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 23:04:32 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 23:04:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 23:04:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 23:04:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 23:04:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 23:04:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 23:04:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 23:04:32 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 23:04:32 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692227072.5977995, 2f05f5de-bf0b-4034-a755-a5f526a7b893 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 23:04:32 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] VM Started (Lifecycle Event)
Aug 16 23:04:32 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 23:04:32 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 23:04:32 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 23:04:32 user nova-compute[72773]: INFO nova.compute.manager [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Took 5.80 seconds to spawn the instance on the hypervisor.
Aug 16 23:04:32 user nova-compute[72773]: DEBUG nova.compute.manager [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 23:04:32 user nova-compute[72773]: DEBUG nova.compute.manager [req-6f21c536-1abc-406c-80df-48c03a70bc22 req-cc154ca8-f20e-4447-9605-8aa30e495347 service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Received event network-vif-plugged-fbfbc293-8e8d-42cb-a48b-acbb18db85e1 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:04:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6f21c536-1abc-406c-80df-48c03a70bc22 req-cc154ca8-f20e-4447-9605-8aa30e495347 service nova] Acquiring lock "2f05f5de-bf0b-4034-a755-a5f526a7b893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:04:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6f21c536-1abc-406c-80df-48c03a70bc22 req-cc154ca8-f20e-4447-9605-8aa30e495347 service nova] Lock "2f05f5de-bf0b-4034-a755-a5f526a7b893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:04:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6f21c536-1abc-406c-80df-48c03a70bc22 req-cc154ca8-f20e-4447-9605-8aa30e495347 service nova] Lock "2f05f5de-bf0b-4034-a755-a5f526a7b893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:04:32 user nova-compute[72773]: DEBUG nova.compute.manager [req-6f21c536-1abc-406c-80df-48c03a70bc22 req-cc154ca8-f20e-4447-9605-8aa30e495347 service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] No waiting events found dispatching network-vif-plugged-fbfbc293-8e8d-42cb-a48b-acbb18db85e1 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:04:32 user nova-compute[72773]: WARNING nova.compute.manager [req-6f21c536-1abc-406c-80df-48c03a70bc22 req-cc154ca8-f20e-4447-9605-8aa30e495347 service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Received unexpected event network-vif-plugged-fbfbc293-8e8d-42cb-a48b-acbb18db85e1 for instance with vm_state building and task_state spawning.
Aug 16 23:04:32 user nova-compute[72773]: INFO nova.compute.manager [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Took 6.28 seconds to build instance.
Aug 16 23:04:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-b44e041b-2023-4f6e-87be-6cbc8a6d508c tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "2f05f5de-bf0b-4034-a755-a5f526a7b893" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.496s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:04:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:04:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:04:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:04:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:04:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:04:50 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:04:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:04:54 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:04:55 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:04:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:05:00 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:05:04 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:05:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:05:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "7cd37206-86ce-47b6-ab17-3143f4184180" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:05:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "7cd37206-86ce-47b6-ab17-3143f4184180" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:05:06 user nova-compute[72773]: DEBUG nova.compute.manager [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 23:05:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:05:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:05:06 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 23:05:06 user nova-compute[72773]: INFO nova.compute.claims [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Claim successful on node user
Aug 16 23:05:06 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:05:06 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:05:06 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.200s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:05:06 user nova-compute[72773]: DEBUG nova.compute.manager [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 23:05:06 user nova-compute[72773]: DEBUG nova.compute.manager [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 23:05:06 user nova-compute[72773]: DEBUG nova.network.neutron [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 23:05:06 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 23:05:06 user nova-compute[72773]: DEBUG nova.compute.manager [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 23:05:06 user nova-compute[72773]: INFO nova.virt.block_device [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Booting with volume 6ac9c546-e347-4191-8fdc-6c30f8bba640 at /dev/vda
Aug 16 23:05:06 user nova-compute[72773]: DEBUG nova.policy [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f12eb2e28904f63baa1ddce4641e180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cd967e4254cfd9b8aee140f640682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 23:05:06 user nova-compute[72773]: DEBUG os_brick.utils [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 23:05:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:05:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:05:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4395e5e5-7d72-4397-b473-4150443d2cef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:05:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:05:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:05:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73a304b-1656-40a8-9b81-acf9d0cb11de]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:05:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:05:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:05:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fc8d58-5d1a-45e5-b862-1f14935adcb8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:05:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[27889c05-809c-4681-a841-c96644e74bc0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:05:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:05:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 23:05:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 23:05:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:05:06 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 23:05:06 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 23:05:06 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c47966a-ed79-40b8-b881-ed8c946fdcb4]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:05:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 23:05:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 23:05:06 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 23:05:06 user nova-compute[72773]: DEBUG os_brick.utils [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 23:05:06 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Updating existing volume attachment record: c249343c-5b85-4524-8db1-a5907450155e {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 23:05:07 user nova-compute[72773]: DEBUG nova.network.neutron [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Successfully created port: d39a116b-5c47-40c3-a387-91d23997f573 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 23:05:08 user nova-compute[72773]: DEBUG nova.network.neutron [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Successfully updated port: d39a116b-5c47-40c3-a387-91d23997f573 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 23:05:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "refresh_cache-7cd37206-86ce-47b6-ab17-3143f4184180" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:05:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquired lock "refresh_cache-7cd37206-86ce-47b6-ab17-3143f4184180" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:05:08 user nova-compute[72773]: DEBUG nova.network.neutron [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 23:05:08 user nova-compute[72773]: DEBUG nova.compute.manager [req-fe6885cb-25e5-4a6c-b8b2-ef24dbd140a1 req-5e26533a-e8e6-4371-b95c-bc218bddf520 service nova] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Received event network-changed-d39a116b-5c47-40c3-a387-91d23997f573 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:05:08 user nova-compute[72773]: DEBUG nova.compute.manager [req-fe6885cb-25e5-4a6c-b8b2-ef24dbd140a1 req-5e26533a-e8e6-4371-b95c-bc218bddf520 service nova] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Refreshing instance network info cache due to event network-changed-d39a116b-5c47-40c3-a387-91d23997f573. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 23:05:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fe6885cb-25e5-4a6c-b8b2-ef24dbd140a1 req-5e26533a-e8e6-4371-b95c-bc218bddf520 service nova] Acquiring lock "refresh_cache-7cd37206-86ce-47b6-ab17-3143f4184180" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:05:08 user nova-compute[72773]: DEBUG nova.network.neutron [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 23:05:08 user nova-compute[72773]: DEBUG nova.network.neutron [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Updating instance_info_cache with network_info: [{"id": "d39a116b-5c47-40c3-a387-91d23997f573", "address": "fa:16:3e:a7:89:96", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd39a116b-5c", "ovs_interfaceid": "d39a116b-5c47-40c3-a387-91d23997f573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:05:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Releasing lock "refresh_cache-7cd37206-86ce-47b6-ab17-3143f4184180" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:05:08 user nova-compute[72773]: DEBUG nova.compute.manager [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Instance network_info: |[{"id": "d39a116b-5c47-40c3-a387-91d23997f573", "address": "fa:16:3e:a7:89:96", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd39a116b-5c", "ovs_interfaceid": "d39a116b-5c47-40c3-a387-91d23997f573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 23:05:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fe6885cb-25e5-4a6c-b8b2-ef24dbd140a1 req-5e26533a-e8e6-4371-b95c-bc218bddf520 service nova] Acquired lock "refresh_cache-7cd37206-86ce-47b6-ab17-3143f4184180" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:05:08 user nova-compute[72773]: DEBUG nova.network.neutron [req-fe6885cb-25e5-4a6c-b8b2-ef24dbd140a1 req-5e26533a-e8e6-4371-b95c-bc218bddf520 service nova] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Refreshing network info cache for port d39a116b-5c47-40c3-a387-91d23997f573 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 23:05:08 user nova-compute[72773]: DEBUG nova.network.neutron [req-fe6885cb-25e5-4a6c-b8b2-ef24dbd140a1 req-5e26533a-e8e6-4371-b95c-bc218bddf520 service nova] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Updated VIF entry in instance network info cache for port d39a116b-5c47-40c3-a387-91d23997f573. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 23:05:08 user nova-compute[72773]: DEBUG nova.network.neutron [req-fe6885cb-25e5-4a6c-b8b2-ef24dbd140a1 req-5e26533a-e8e6-4371-b95c-bc218bddf520 service nova] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Updating instance_info_cache with network_info: [{"id": "d39a116b-5c47-40c3-a387-91d23997f573", "address": "fa:16:3e:a7:89:96", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd39a116b-5c", "ovs_interfaceid": "d39a116b-5c47-40c3-a387-91d23997f573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:05:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fe6885cb-25e5-4a6c-b8b2-ef24dbd140a1 req-5e26533a-e8e6-4371-b95c-bc218bddf520 service nova] Releasing lock "refresh_cache-7cd37206-86ce-47b6-ab17-3143f4184180" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:05:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:05:10 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:05:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:05:15 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG nova.compute.manager [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 23:05:17 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Creating image(s)
Aug 16 23:05:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Did not create local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Ensure instance console log exists: /opt/stack/data/nova/instances/7cd37206-86ce-47b6-ab17-3143f4184180/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Start _get_guest_xml network_info=[{"id": "d39a116b-5c47-40c3-a387-91d23997f573", "address": "fa:16:3e:a7:89:96", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd39a116b-5c", "ovs_interfaceid": "d39a116b-5c47-40c3-a387-91d23997f573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c249343c-5b85-4524-8db1-a5907450155e', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JrAZRElQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7cd37206-86ce-47b6-ab17-3143f4184180', 'attached_at': '', 'detached_at': '', 'volume_id': '6ac9c546-e347-4191-8fdc-6c30f8bba640', 'serial': '6ac9c546-e347-4191-8fdc-6c30f8bba640'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 23:05:17 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:05:17 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:05:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JrAZRElQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 23:05:17 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 23:05:17 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 23:05:17 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 23:05:17 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 23:05:17 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[905a268f-7172-4f61-b6e2-9f72ed5bb417]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 23:05:17 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2d67fc-819e-4653-aca7-273c1256d264]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640] added
Aug 16 23:05:17 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.060s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3411f7df-9733-4038-8866-289b83247e82]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[29be7e9a-89d9-412b-82f6-1104bd35d16f]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JrAZRElQ {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JrAZRElQ" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19c4c21-4f43-4454-a56b-4514472f0654]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JrAZRElQ'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2400d8-4fac-4805-b4d6-a64f6e39e04c]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec94f77d-f82a-41b6-a6ec-801531ea2cc5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 23:05:17 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 23:05:17 user nova-compute[72773]:  {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 23:05:17 user nova-compute[72773]: WARNING os_brick.initiator.connectors.iscsi [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 23:05:17 user nova-compute[72773]: 
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b73649-bb2e-48d0-8622-ea55883ac54f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640, portal: 172.16.0.220,3260]
Aug 16 23:05:17 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640, portal: 172.16.0.220,3260] successful.
Aug 16 23:05:17 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b30303-3fd6-4c71-955b-4ed0fce9d769]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3a73e3-fe3c-408f-aea7-857460950cfa]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 (non-flash)
Aug 16 23:05:17 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 (non-flash)
Aug 16 23:05:17 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b3e18d-2c8f-4da0-931e-dc4d87481f39]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 23:05:17 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JrAZRElQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 23:05:18 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:05:18 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 23:05:18 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '26435636331613166', 'path': '/dev/sdb'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 23:05:18 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435636331613166', 'path': '/dev/sdb'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 23:05:18 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T23:05:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-744339351',display_name='tempest-TestVolumeBootPattern-server-744339351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-744339351',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL02+v69rOIm3d3DTbZyuQdTDm7FnOwFLT+9aenwjm8psvyRLcpRR7jJ6qjZ+VoOb17oLOwBBPT4Y5q77K4hElMopo/LfJNWLR3JbU03lfgxjehWHq1alQDpDMLvfTP4OA==',key_name='tempest-TestVolumeBootPattern-1277717100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a51cd967e4254cfd9b8aee140f640682',ramdisk_id='',reservation_id='r-rkwhgmu5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1862722655',owner_user_name='tempest-TestVolumeBootPattern-1862722655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T23:05:07Z,user_data=None,user_id='3f12eb2e28904f63baa1ddce4641e180',uuid=7cd37206-86ce-47b6-ab17-3143f4184180,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d39a116b-5c47-40c3-a387-91d23997f573", "address": "fa:16:3e:a7:89:96", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd39a116b-5c", "ovs_interfaceid": "d39a116b-5c47-40c3-a387-91d23997f573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 23:05:18 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converting VIF {"id": "d39a116b-5c47-40c3-a387-91d23997f573", "address": "fa:16:3e:a7:89:96", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd39a116b-5c", "ovs_interfaceid": "d39a116b-5c47-40c3-a387-91d23997f573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 23:05:18 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:89:96,bridge_name='br-int',has_traffic_filtering=True,id=d39a116b-5c47-40c3-a387-91d23997f573,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd39a116b-5c') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 23:05:18 user nova-compute[72773]: DEBUG nova.objects.instance [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lazy-loading 'pci_devices' on Instance uuid 7cd37206-86ce-47b6-ab17-3143f4184180 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:05:18 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] End _get_guest_xml xml=<domain type="kvm">
Aug 16 23:05:18 user nova-compute[72773]:   <uuid>7cd37206-86ce-47b6-ab17-3143f4184180</uuid>
Aug 16 23:05:18 user nova-compute[72773]:   <name>instance-00000032</name>
Aug 16 23:05:18 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 23:05:18 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 23:05:18 user nova-compute[72773]:   <metadata>
Aug 16 23:05:18 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 23:05:18 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 23:05:18 user nova-compute[72773]:       <nova:name>tempest-TestVolumeBootPattern-server-744339351</nova:name>
Aug 16 23:05:18 user nova-compute[72773]:       <nova:creationTime>2023-08-16 23:05:17</nova:creationTime>
Aug 16 23:05:18 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 23:05:18 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 23:05:18 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 23:05:18 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 23:05:18 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 23:05:18 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 23:05:18 user nova-compute[72773]:       </nova:flavor>
Aug 16 23:05:18 user nova-compute[72773]:       <nova:owner>
Aug 16 23:05:18 user nova-compute[72773]:         <nova:user uuid="3f12eb2e28904f63baa1ddce4641e180">tempest-TestVolumeBootPattern-1862722655-project-member</nova:user>
Aug 16 23:05:18 user nova-compute[72773]:         <nova:project uuid="a51cd967e4254cfd9b8aee140f640682">tempest-TestVolumeBootPattern-1862722655</nova:project>
Aug 16 23:05:18 user nova-compute[72773]:       </nova:owner>
Aug 16 23:05:18 user nova-compute[72773]:       <nova:ports>
Aug 16 23:05:18 user nova-compute[72773]:         <nova:port uuid="d39a116b-5c47-40c3-a387-91d23997f573">
Aug 16 23:05:18 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 23:05:18 user nova-compute[72773]:         </nova:port>
Aug 16 23:05:18 user nova-compute[72773]:       </nova:ports>
Aug 16 23:05:18 user nova-compute[72773]:     </nova:instance>
Aug 16 23:05:18 user nova-compute[72773]:   </metadata>
Aug 16 23:05:18 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 23:05:18 user nova-compute[72773]:     <system>
Aug 16 23:05:18 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 23:05:18 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 23:05:18 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 23:05:18 user nova-compute[72773]:       <entry name="serial">7cd37206-86ce-47b6-ab17-3143f4184180</entry>
Aug 16 23:05:18 user nova-compute[72773]:       <entry name="uuid">7cd37206-86ce-47b6-ab17-3143f4184180</entry>
Aug 16 23:05:18 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 23:05:18 user nova-compute[72773]:     </system>
Aug 16 23:05:18 user nova-compute[72773]:   </sysinfo>
Aug 16 23:05:18 user nova-compute[72773]:   <os>
Aug 16 23:05:18 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 23:05:18 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 23:05:18 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 23:05:18 user nova-compute[72773]:   </os>
Aug 16 23:05:18 user nova-compute[72773]:   <features>
Aug 16 23:05:18 user nova-compute[72773]:     <acpi/>
Aug 16 23:05:18 user nova-compute[72773]:     <apic/>
Aug 16 23:05:18 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 23:05:18 user nova-compute[72773]:   </features>
Aug 16 23:05:18 user nova-compute[72773]:   <clock offset="utc">
Aug 16 23:05:18 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 23:05:18 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 23:05:18 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 23:05:18 user nova-compute[72773]:   </clock>
Aug 16 23:05:18 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 23:05:18 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 23:05:18 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 23:05:18 user nova-compute[72773]:   </cpu>
Aug 16 23:05:18 user nova-compute[72773]:   <devices>
Aug 16 23:05:18 user nova-compute[72773]:     <disk type="block" device="disk">
Aug 16 23:05:18 user nova-compute[72773]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 23:05:18 user nova-compute[72773]:       <source dev="/dev/sdb"/>
Aug 16 23:05:18 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 23:05:18 user nova-compute[72773]:       <serial>6ac9c546-e347-4191-8fdc-6c30f8bba640</serial>
Aug 16 23:05:18 user nova-compute[72773]:     </disk>
Aug 16 23:05:18 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 23:05:18 user nova-compute[72773]:       <mac address="fa:16:3e:a7:89:96"/>
Aug 16 23:05:18 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 23:05:18 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 23:05:18 user nova-compute[72773]:       <target dev="tapd39a116b-5c"/>
Aug 16 23:05:18 user nova-compute[72773]:     </interface>
Aug 16 23:05:18 user nova-compute[72773]:     <serial type="pty">
Aug 16 23:05:18 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/7cd37206-86ce-47b6-ab17-3143f4184180/console.log" append="off"/>
Aug 16 23:05:18 user nova-compute[72773]:     </serial>
Aug 16 23:05:18 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 23:05:18 user nova-compute[72773]:     <video>
Aug 16 23:05:18 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 23:05:18 user nova-compute[72773]:     </video>
Aug 16 23:05:18 user nova-compute[72773]:     <rng model="virtio">
Aug 16 23:05:18 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 23:05:18 user nova-compute[72773]:     </rng>
Aug 16 23:05:18 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 23:05:18 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 23:05:18 user nova-compute[72773]:       <stats period="10"/>
Aug 16 23:05:18 user nova-compute[72773]:     </memballoon>
Aug 16 23:05:18 user nova-compute[72773]:   </devices>
Aug 16 23:05:18 user nova-compute[72773]: </domain>
Aug 16 23:05:18 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 23:05:18 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T23:05:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-744339351',display_name='tempest-TestVolumeBootPattern-server-744339351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-744339351',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL02+v69rOIm3d3DTbZyuQdTDm7FnOwFLT+9aenwjm8psvyRLcpRR7jJ6qjZ+VoOb17oLOwBBPT4Y5q77K4hElMopo/LfJNWLR3JbU03lfgxjehWHq1alQDpDMLvfTP4OA==',key_name='tempest-TestVolumeBootPattern-1277717100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a51cd967e4254cfd9b8aee140f640682',ramdisk_id='',reservation_id='r-rkwhgmu5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1862722655',owner_user_name='tempest-TestVolumeBootPattern-1862722655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T23:05:07Z,user_data=None,user_id='3f12eb2e28904f63baa1ddce4641e180',uuid=7cd37206-86ce-47b6-ab17-3143f4184180,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d39a116b-5c47-40c3-a387-91d23997f573", "address": "fa:16:3e:a7:89:96", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd39a116b-5c", "ovs_interfaceid": "d39a116b-5c47-40c3-a387-91d23997f573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 23:05:18 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converting VIF {"id": "d39a116b-5c47-40c3-a387-91d23997f573", "address": "fa:16:3e:a7:89:96", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd39a116b-5c", "ovs_interfaceid": "d39a116b-5c47-40c3-a387-91d23997f573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 23:05:18 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:89:96,bridge_name='br-int',has_traffic_filtering=True,id=d39a116b-5c47-40c3-a387-91d23997f573,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd39a116b-5c') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 23:05:18 user nova-compute[72773]: DEBUG os_vif [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:89:96,bridge_name='br-int',has_traffic_filtering=True,id=d39a116b-5c47-40c3-a387-91d23997f573,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd39a116b-5c') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 23:05:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:05:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 23:05:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 23:05:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:05:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd39a116b-5c, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 23:05:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd39a116b-5c, col_values=(('external_ids', {'iface-id': 'd39a116b-5c47-40c3-a387-91d23997f573', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:89:96', 'vm-uuid': '7cd37206-86ce-47b6-ab17-3143f4184180'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 23:05:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:05:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:05:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:05:18 user nova-compute[72773]: INFO os_vif [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:89:96,bridge_name='br-int',has_traffic_filtering=True,id=d39a116b-5c47-40c3-a387-91d23997f573,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd39a116b-5c')
Aug 16 23:05:18 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 23:05:18 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] No VIF found with MAC fa:16:3e:a7:89:96, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 23:05:19 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:05:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:05:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:05:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:05:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-fe43466f-c9d0-4bd3-aa6d-a5e9c3896dc2 req-cd57eda0-bed7-45e3-b7f6-fb7a29949796 service nova] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Received event network-vif-plugged-d39a116b-5c47-40c3-a387-91d23997f573 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:05:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fe43466f-c9d0-4bd3-aa6d-a5e9c3896dc2 req-cd57eda0-bed7-45e3-b7f6-fb7a29949796 service nova] Acquiring lock "7cd37206-86ce-47b6-ab17-3143f4184180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:05:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fe43466f-c9d0-4bd3-aa6d-a5e9c3896dc2 req-cd57eda0-bed7-45e3-b7f6-fb7a29949796 service nova] Lock "7cd37206-86ce-47b6-ab17-3143f4184180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:05:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-fe43466f-c9d0-4bd3-aa6d-a5e9c3896dc2 req-cd57eda0-bed7-45e3-b7f6-fb7a29949796 service nova] Lock "7cd37206-86ce-47b6-ab17-3143f4184180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:05:20 user nova-compute[72773]: DEBUG nova.compute.manager [req-fe43466f-c9d0-4bd3-aa6d-a5e9c3896dc2 req-cd57eda0-bed7-45e3-b7f6-fb7a29949796 service nova] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] No waiting events found dispatching network-vif-plugged-d39a116b-5c47-40c3-a387-91d23997f573 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:05:20 user nova-compute[72773]: WARNING nova.compute.manager [req-fe43466f-c9d0-4bd3-aa6d-a5e9c3896dc2 req-cd57eda0-bed7-45e3-b7f6-fb7a29949796 service nova] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Received unexpected event network-vif-plugged-d39a116b-5c47-40c3-a387-91d23997f573 for instance with vm_state building and task_state spawning.
Aug 16 23:05:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:05:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:05:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:05:20 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:05:21 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:05:21 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 23:05:21 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Rebuilding the list of instances to heal {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 23:05:21 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Skipping network cache update for instance because it is Building. {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 16 23:05:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-2f05f5de-bf0b-4034-a755-a5f526a7b893" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:05:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-2f05f5de-bf0b-4034-a755-a5f526a7b893" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:05:21 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 23:05:21 user nova-compute[72773]: DEBUG nova.objects.instance [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lazy-loading 'info_cache' on Instance uuid 2f05f5de-bf0b-4034-a755-a5f526a7b893 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:05:21 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Updating instance_info_cache with network_info: [{"id": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "address": "fa:16:3e:6b:1d:44", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbfbc293-8e", "ovs_interfaceid": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:05:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-2f05f5de-bf0b-4034-a755-a5f526a7b893" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:05:21 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 23:05:22 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692227122.0991518, 7cd37206-86ce-47b6-ab17-3143f4184180 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 23:05:22 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] VM Resumed (Lifecycle Event)
Aug 16 23:05:22 user nova-compute[72773]: DEBUG nova.compute.manager [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 23:05:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 23:05:22 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Instance spawned successfully.
Aug 16 23:05:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 23:05:22 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 23:05:22 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 23:05:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 23:05:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 23:05:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 23:05:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 23:05:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 23:05:22 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 23:05:22 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 23:05:22 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692227122.1026275, 7cd37206-86ce-47b6-ab17-3143f4184180 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 23:05:22 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] VM Started (Lifecycle Event)
Aug 16 23:05:22 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 23:05:22 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 23:05:22 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 23:05:22 user nova-compute[72773]: INFO nova.compute.manager [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Took 5.01 seconds to spawn the instance on the hypervisor.
Aug 16 23:05:22 user nova-compute[72773]: DEBUG nova.compute.manager [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 23:05:22 user nova-compute[72773]: DEBUG nova.compute.manager [req-2bee30bb-501d-4f3e-aba8-c27aaeeca903 req-cf14663d-f7ac-4afd-8cfd-86828ce28355 service nova] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Received event network-vif-plugged-d39a116b-5c47-40c3-a387-91d23997f573 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:05:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2bee30bb-501d-4f3e-aba8-c27aaeeca903 req-cf14663d-f7ac-4afd-8cfd-86828ce28355 service nova] Acquiring lock "7cd37206-86ce-47b6-ab17-3143f4184180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:05:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2bee30bb-501d-4f3e-aba8-c27aaeeca903 req-cf14663d-f7ac-4afd-8cfd-86828ce28355 service nova] Lock "7cd37206-86ce-47b6-ab17-3143f4184180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:05:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2bee30bb-501d-4f3e-aba8-c27aaeeca903 req-cf14663d-f7ac-4afd-8cfd-86828ce28355 service nova] Lock "7cd37206-86ce-47b6-ab17-3143f4184180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:05:22 user nova-compute[72773]: DEBUG nova.compute.manager [req-2bee30bb-501d-4f3e-aba8-c27aaeeca903 req-cf14663d-f7ac-4afd-8cfd-86828ce28355 service nova] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] No waiting events found dispatching network-vif-plugged-d39a116b-5c47-40c3-a387-91d23997f573 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:05:22 user nova-compute[72773]: WARNING nova.compute.manager [req-2bee30bb-501d-4f3e-aba8-c27aaeeca903 req-cf14663d-f7ac-4afd-8cfd-86828ce28355 service nova] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Received unexpected event network-vif-plugged-d39a116b-5c47-40c3-a387-91d23997f573 for instance with vm_state building and task_state spawning.
Aug 16 23:05:22 user nova-compute[72773]: INFO nova.compute.manager [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Took 15.94 seconds to build instance.
Aug 16 23:05:22 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-987f4400-1bae-44ec-8e8c-4f9fefc7f7d5 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "7cd37206-86ce-47b6-ab17-3143f4184180" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.066s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:05:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:05:25 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:05:25 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:05:25 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 23:05:25 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:05:26 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:05:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:05:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:05:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:05:26 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 23:05:26 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 23:05:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f05f5de-bf0b-4034-a755-a5f526a7b893/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:05:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f05f5de-bf0b-4034-a755-a5f526a7b893/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:05:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f05f5de-bf0b-4034-a755-a5f526a7b893/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:05:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f05f5de-bf0b-4034-a755-a5f526a7b893/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:05:27 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:05:27 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:05:27 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=8680MB free_disk=25.35000228881836GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 23:05:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:05:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:05:27 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 2f05f5de-bf0b-4034-a755-a5f526a7b893 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 23:05:27 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 7cd37206-86ce-47b6-ab17-3143f4184180 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 23:05:27 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 23:05:27 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 23:05:27 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:05:27 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:05:27 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 23:05:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.212s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:05:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:05:29 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:05:29 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:05:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:05:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:05:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:05:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:05:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:05:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:05:36 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:05:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:05:41 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:05:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:05:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:05:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:05:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:05:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:05:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:06:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:06:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:06:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:06:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:06:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:06:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:06:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:06:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:06:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:06:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:06:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:06:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:06:12 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:06:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:06:17 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:06:18 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:06:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:06:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:06:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:06:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:06:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:06:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:06:19 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:06:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "2f05f5de-bf0b-4034-a755-a5f526a7b893" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:06:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "2f05f5de-bf0b-4034-a755-a5f526a7b893" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:06:20 user nova-compute[72773]: DEBUG nova.objects.instance [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lazy-loading 'flavor' on Instance uuid 2f05f5de-bf0b-4034-a755-a5f526a7b893 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:06:20 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "2f05f5de-bf0b-4034-a755-a5f526a7b893" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:06:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "2f05f5de-bf0b-4034-a755-a5f526a7b893" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:06:21 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "2f05f5de-bf0b-4034-a755-a5f526a7b893" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:06:21 user nova-compute[72773]: INFO nova.compute.manager [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Attaching volume c3f4e5b8-0f63-4341-bbd8-906429409fc2 to /dev/vdb
Aug 16 23:06:21 user nova-compute[72773]: DEBUG os_brick.utils [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 23:06:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:06:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:06:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c1988d-bcd0-4c66-a290-f7eb55e18cb6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:06:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:06:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:06:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[562990e8-99c2-42b3-b1cf-eaea52755fd7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:06:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:06:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:06:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcc2d08-df99-444e-b0a2-e226ed81bf69]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:06:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6df9177-b3a6-4f59-847d-d5b3db750378]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:06:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:06:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 23:06:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 23:06:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:06:21 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 23:06:21 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 23:06:21 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81473f9-262e-4e0a-a3db-3d215a2a0ded]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:06:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 23:06:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 23:06:21 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 23:06:21 user nova-compute[72773]: DEBUG os_brick.utils [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 23:06:21 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Updating existing volume attachment record: b2cb13f3-d79c-4731-b0b6-1a29d8f8245e {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 23:06:23 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:06:23 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 23:06:23 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Rebuilding the list of instances to heal {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 23:06:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-2f05f5de-bf0b-4034-a755-a5f526a7b893" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:06:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-2f05f5de-bf0b-4034-a755-a5f526a7b893" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:06:23 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 23:06:23 user nova-compute[72773]: DEBUG nova.objects.instance [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lazy-loading 'info_cache' on Instance uuid 2f05f5de-bf0b-4034-a755-a5f526a7b893 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:06:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:06:23 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Updating instance_info_cache with network_info: [{"id": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "address": "fa:16:3e:6b:1d:44", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbfbc293-8e", "ovs_interfaceid": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:06:23 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-2f05f5de-bf0b-4034-a755-a5f526a7b893" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:06:23 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 23:06:25 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:06:26 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:06:26 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 23:06:26 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:06:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:06:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:06:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:06:26 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 23:06:26 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 23:06:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f05f5de-bf0b-4034-a755-a5f526a7b893/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:06:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f05f5de-bf0b-4034-a755-a5f526a7b893/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:06:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f05f5de-bf0b-4034-a755-a5f526a7b893/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:06:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f05f5de-bf0b-4034-a755-a5f526a7b893/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:06:27 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:06:27 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:06:27 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=8697MB free_disk=25.34912872314453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 23:06:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:06:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:06:27 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 2f05f5de-bf0b-4034-a755-a5f526a7b893 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 23:06:27 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 7cd37206-86ce-47b6-ab17-3143f4184180 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 23:06:27 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 23:06:27 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 23:06:27 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Refreshing inventories for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 23:06:27 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Updating ProviderTree inventory for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 23:06:27 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Updating inventory in ProviderTree for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 23:06:27 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Refreshing aggregate associations for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e, aggregates: None {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 23:06:27 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Refreshing trait associations for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 23:06:27 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:06:27 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:06:27 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 23:06:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.441s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:06:27 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:06:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:06:30 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DOlGxwYP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 23:06:31 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 23:06:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 23:06:31 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 23:06:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 23:06:31 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 23:06:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff759e30-6ccb-4445-a4d5-1ba3b5bdef38]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 23:06:31 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea98f8fc-98ff-4e2d-b445-a04c42a8f852]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2] added
Aug 16 23:06:31 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[36adb700-a6f5-480a-91d1-0177f644c82a]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd6d4d4-3d49-4dd6-a34a-2803eef28925]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DOlGxwYP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DOlGxwYP" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba67250-40cc-40c3-9c22-d77fef65133d]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DOlGxwYP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f509cadf-06a6-4354-a85a-f498d78d9c38]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[883168ec-a86a-476e-bc0f-8775f2cf0d15]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 (non-flash)
Aug 16 23:06:31 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 (non-flash)
Aug 16 23:06:31 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b84d73-d8fd-48f8-a986-7caaeae13d11]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2, portal: 172.16.0.220,3260]
Aug 16 23:06:31 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2, portal: 172.16.0.220,3260] successful.
Aug 16 23:06:31 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b872469-5e70-4b62-97f6-c0f040044fc6]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[92174a46-4bdd-4be4-9af8-513f43155729]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 (non-flash)
Aug 16 23:06:31 user nova-compute[72773]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 (non-flash)
Aug 16 23:06:31 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 (non-flash)
Aug 16 23:06:31 user nova-compute[72773]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 (non-flash)
Aug 16 23:06:31 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca3941f-5010-4a63-aa7c-91e59edeb84f]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 23:06:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DOlGxwYP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 23:06:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 23:06:32 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23630373463333231', 'path': '/dev/sdc'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 23:06:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630373463333231', 'path': '/dev/sdc'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 23:06:32 user nova-compute[72773]: DEBUG nova.objects.instance [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lazy-loading 'flavor' on Instance uuid 2f05f5de-bf0b-4034-a755-a5f526a7b893 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:06:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 23:06:32 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 23:06:32 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 23:06:32 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 23:06:32 user nova-compute[72773]:   <serial>c3f4e5b8-0f63-4341-bbd8-906429409fc2</serial>
Aug 16 23:06:32 user nova-compute[72773]: </disk>
Aug 16 23:06:32 user nova-compute[72773]:  {{(pid=72773) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 23:06:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 23:06:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 23:06:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] No VIF found with MAC fa:16:3e:6b:1d:44, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 23:06:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-d359ebd5-db78-46da-975a-5c6640aa76cc tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "2f05f5de-bf0b-4034-a755-a5f526a7b893" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.272s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:06:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:06:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:06:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:06:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:06:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:06:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:06:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:06:36 user nova-compute[72773]: DEBUG nova.compute.manager [req-04321882-901c-4fa9-b486-15b87b0d3d70 req-852eeb07-9b1e-411a-aa56-585adee35c76 service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Received event network-changed-fbfbc293-8e8d-42cb-a48b-acbb18db85e1 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:06:36 user nova-compute[72773]: DEBUG nova.compute.manager [req-04321882-901c-4fa9-b486-15b87b0d3d70 req-852eeb07-9b1e-411a-aa56-585adee35c76 service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Refreshing instance network info cache due to event network-changed-fbfbc293-8e8d-42cb-a48b-acbb18db85e1. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 23:06:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-04321882-901c-4fa9-b486-15b87b0d3d70 req-852eeb07-9b1e-411a-aa56-585adee35c76 service nova] Acquiring lock "refresh_cache-2f05f5de-bf0b-4034-a755-a5f526a7b893" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:06:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-04321882-901c-4fa9-b486-15b87b0d3d70 req-852eeb07-9b1e-411a-aa56-585adee35c76 service nova] Acquired lock "refresh_cache-2f05f5de-bf0b-4034-a755-a5f526a7b893" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:06:36 user nova-compute[72773]: DEBUG nova.network.neutron [req-04321882-901c-4fa9-b486-15b87b0d3d70 req-852eeb07-9b1e-411a-aa56-585adee35c76 service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Refreshing network info cache for port fbfbc293-8e8d-42cb-a48b-acbb18db85e1 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 23:06:36 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:06:36 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Cleaning up deleted instances with incomplete migration  {{(pid=72773) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 23:06:37 user nova-compute[72773]: DEBUG nova.network.neutron [req-04321882-901c-4fa9-b486-15b87b0d3d70 req-852eeb07-9b1e-411a-aa56-585adee35c76 service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Updated VIF entry in instance network info cache for port fbfbc293-8e8d-42cb-a48b-acbb18db85e1. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 23:06:37 user nova-compute[72773]: DEBUG nova.network.neutron [req-04321882-901c-4fa9-b486-15b87b0d3d70 req-852eeb07-9b1e-411a-aa56-585adee35c76 service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Updating instance_info_cache with network_info: [{"id": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "address": "fa:16:3e:6b:1d:44", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbfbc293-8e", "ovs_interfaceid": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:06:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-04321882-901c-4fa9-b486-15b87b0d3d70 req-852eeb07-9b1e-411a-aa56-585adee35c76 service nova] Releasing lock "refresh_cache-2f05f5de-bf0b-4034-a755-a5f526a7b893" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:06:38 user nova-compute[72773]: DEBUG nova.compute.manager [req-92cc5cdf-73a0-4085-beb3-17160d7c3a93 req-b3462ba0-1812-4cde-8413-50658b073f84 service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Received event network-changed-fbfbc293-8e8d-42cb-a48b-acbb18db85e1 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:06:38 user nova-compute[72773]: DEBUG nova.compute.manager [req-92cc5cdf-73a0-4085-beb3-17160d7c3a93 req-b3462ba0-1812-4cde-8413-50658b073f84 service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Refreshing instance network info cache due to event network-changed-fbfbc293-8e8d-42cb-a48b-acbb18db85e1. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 23:06:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-92cc5cdf-73a0-4085-beb3-17160d7c3a93 req-b3462ba0-1812-4cde-8413-50658b073f84 service nova] Acquiring lock "refresh_cache-2f05f5de-bf0b-4034-a755-a5f526a7b893" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:06:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-92cc5cdf-73a0-4085-beb3-17160d7c3a93 req-b3462ba0-1812-4cde-8413-50658b073f84 service nova] Acquired lock "refresh_cache-2f05f5de-bf0b-4034-a755-a5f526a7b893" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:06:38 user nova-compute[72773]: DEBUG nova.network.neutron [req-92cc5cdf-73a0-4085-beb3-17160d7c3a93 req-b3462ba0-1812-4cde-8413-50658b073f84 service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Refreshing network info cache for port fbfbc293-8e8d-42cb-a48b-acbb18db85e1 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 23:06:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-53199f21-4be0-4052-9439-b0e00b1214f4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "2f05f5de-bf0b-4034-a755-a5f526a7b893" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:06:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-53199f21-4be0-4052-9439-b0e00b1214f4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "2f05f5de-bf0b-4034-a755-a5f526a7b893" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:06:38 user nova-compute[72773]: INFO nova.compute.manager [None req-53199f21-4be0-4052-9439-b0e00b1214f4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Rebooting instance
Aug 16 23:06:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-53199f21-4be0-4052-9439-b0e00b1214f4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "refresh_cache-2f05f5de-bf0b-4034-a755-a5f526a7b893" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:06:38 user nova-compute[72773]: DEBUG nova.network.neutron [req-92cc5cdf-73a0-4085-beb3-17160d7c3a93 req-b3462ba0-1812-4cde-8413-50658b073f84 service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Updated VIF entry in instance network info cache for port fbfbc293-8e8d-42cb-a48b-acbb18db85e1. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 23:06:38 user nova-compute[72773]: DEBUG nova.network.neutron [req-92cc5cdf-73a0-4085-beb3-17160d7c3a93 req-b3462ba0-1812-4cde-8413-50658b073f84 service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Updating instance_info_cache with network_info: [{"id": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "address": "fa:16:3e:6b:1d:44", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbfbc293-8e", "ovs_interfaceid": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:06:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-92cc5cdf-73a0-4085-beb3-17160d7c3a93 req-b3462ba0-1812-4cde-8413-50658b073f84 service nova] Releasing lock "refresh_cache-2f05f5de-bf0b-4034-a755-a5f526a7b893" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:06:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-53199f21-4be0-4052-9439-b0e00b1214f4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquired lock "refresh_cache-2f05f5de-bf0b-4034-a755-a5f526a7b893" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:06:38 user nova-compute[72773]: DEBUG nova.network.neutron [None req-53199f21-4be0-4052-9439-b0e00b1214f4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 23:06:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:06:38 user nova-compute[72773]: DEBUG nova.network.neutron [None req-53199f21-4be0-4052-9439-b0e00b1214f4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Updating instance_info_cache with network_info: [{"id": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "address": "fa:16:3e:6b:1d:44", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbfbc293-8e", "ovs_interfaceid": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:06:39 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-53199f21-4be0-4052-9439-b0e00b1214f4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Releasing lock "refresh_cache-2f05f5de-bf0b-4034-a755-a5f526a7b893" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:06:39 user nova-compute[72773]: DEBUG nova.compute.manager [None req-53199f21-4be0-4052-9439-b0e00b1214f4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 23:06:41 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:06:41 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:06:41 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:06:41 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:06:41 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:06:41 user nova-compute[72773]: DEBUG nova.compute.manager [req-b4d408cf-4209-4e41-adc1-b1dcdf64e7d3 req-769674f5-c2eb-4de4-b9cf-ff359d51bc8a service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Received event network-vif-unplugged-fbfbc293-8e8d-42cb-a48b-acbb18db85e1 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:06:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b4d408cf-4209-4e41-adc1-b1dcdf64e7d3 req-769674f5-c2eb-4de4-b9cf-ff359d51bc8a service nova] Acquiring lock "2f05f5de-bf0b-4034-a755-a5f526a7b893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:06:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b4d408cf-4209-4e41-adc1-b1dcdf64e7d3 req-769674f5-c2eb-4de4-b9cf-ff359d51bc8a service nova] Lock "2f05f5de-bf0b-4034-a755-a5f526a7b893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:06:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-b4d408cf-4209-4e41-adc1-b1dcdf64e7d3 req-769674f5-c2eb-4de4-b9cf-ff359d51bc8a service nova] Lock "2f05f5de-bf0b-4034-a755-a5f526a7b893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:06:41 user nova-compute[72773]: DEBUG nova.compute.manager [req-b4d408cf-4209-4e41-adc1-b1dcdf64e7d3 req-769674f5-c2eb-4de4-b9cf-ff359d51bc8a service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] No waiting events found dispatching network-vif-unplugged-fbfbc293-8e8d-42cb-a48b-acbb18db85e1 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:06:41 user nova-compute[72773]: WARNING nova.compute.manager [req-b4d408cf-4209-4e41-adc1-b1dcdf64e7d3 req-769674f5-c2eb-4de4-b9cf-ff359d51bc8a service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Received unexpected event network-vif-unplugged-fbfbc293-8e8d-42cb-a48b-acbb18db85e1 for instance with vm_state active and task_state reboot_started.
Aug 16 23:06:42 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-53199f21-4be0-4052-9439-b0e00b1214f4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Instance shutdown successfully.
Aug 16 23:06:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:06:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:06:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:06:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:06:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:06:43 user nova-compute[72773]: DEBUG nova.compute.manager [req-6a02da02-8002-47b4-a0dc-2aa52681b16f req-a6a34cd4-67fd-4bd9-a7c4-0501234cdb9f service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Received event network-vif-plugged-fbfbc293-8e8d-42cb-a48b-acbb18db85e1 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:06:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6a02da02-8002-47b4-a0dc-2aa52681b16f req-a6a34cd4-67fd-4bd9-a7c4-0501234cdb9f service nova] Acquiring lock "2f05f5de-bf0b-4034-a755-a5f526a7b893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:06:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6a02da02-8002-47b4-a0dc-2aa52681b16f req-a6a34cd4-67fd-4bd9-a7c4-0501234cdb9f service nova] Lock "2f05f5de-bf0b-4034-a755-a5f526a7b893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:06:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-6a02da02-8002-47b4-a0dc-2aa52681b16f req-a6a34cd4-67fd-4bd9-a7c4-0501234cdb9f service nova] Lock "2f05f5de-bf0b-4034-a755-a5f526a7b893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:06:43 user nova-compute[72773]: DEBUG nova.compute.manager [req-6a02da02-8002-47b4-a0dc-2aa52681b16f req-a6a34cd4-67fd-4bd9-a7c4-0501234cdb9f service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] No waiting events found dispatching network-vif-plugged-fbfbc293-8e8d-42cb-a48b-acbb18db85e1 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:06:43 user nova-compute[72773]: WARNING nova.compute.manager [req-6a02da02-8002-47b4-a0dc-2aa52681b16f req-a6a34cd4-67fd-4bd9-a7c4-0501234cdb9f service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Received unexpected event network-vif-plugged-fbfbc293-8e8d-42cb-a48b-acbb18db85e1 for instance with vm_state active and task_state reboot_started.
Aug 16 23:06:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:06:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:06:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:06:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:06:45 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:06:45 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Cleaning up deleted instances {{(pid=72773) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 23:06:45 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] There are 0 instances to clean {{(pid=72773) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 23:06:45 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Removed pending event for 2f05f5de-bf0b-4034-a755-a5f526a7b893 due to event {{(pid=72773) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 23:06:45 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692227205.449291, 2f05f5de-bf0b-4034-a755-a5f526a7b893 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 23:06:45 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] VM Resumed (Lifecycle Event)
Aug 16 23:06:45 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Instance running successfully.
Aug 16 23:06:45 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-53199f21-4be0-4052-9439-b0e00b1214f4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Instance soft rebooted successfully.
Aug 16 23:06:45 user nova-compute[72773]: DEBUG nova.compute.manager [None req-53199f21-4be0-4052-9439-b0e00b1214f4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 23:06:45 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 23:06:45 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 23:06:45 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 16 23:06:45 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692227205.4519894, 2f05f5de-bf0b-4034-a755-a5f526a7b893 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 23:06:45 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] VM Started (Lifecycle Event)
Aug 16 23:06:45 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 23:06:45 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 23:06:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-53199f21-4be0-4052-9439-b0e00b1214f4 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "2f05f5de-bf0b-4034-a755-a5f526a7b893" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.057s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:06:45 user nova-compute[72773]: DEBUG nova.compute.manager [req-002b2adb-023b-450c-8bda-8228fdd58c9f req-56a21dda-816f-44a6-b5fe-99ccd9489eb9 service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Received event network-vif-plugged-fbfbc293-8e8d-42cb-a48b-acbb18db85e1 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:06:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-002b2adb-023b-450c-8bda-8228fdd58c9f req-56a21dda-816f-44a6-b5fe-99ccd9489eb9 service nova] Acquiring lock "2f05f5de-bf0b-4034-a755-a5f526a7b893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:06:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-002b2adb-023b-450c-8bda-8228fdd58c9f req-56a21dda-816f-44a6-b5fe-99ccd9489eb9 service nova] Lock "2f05f5de-bf0b-4034-a755-a5f526a7b893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:06:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-002b2adb-023b-450c-8bda-8228fdd58c9f req-56a21dda-816f-44a6-b5fe-99ccd9489eb9 service nova] Lock "2f05f5de-bf0b-4034-a755-a5f526a7b893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:06:45 user nova-compute[72773]: DEBUG nova.compute.manager [req-002b2adb-023b-450c-8bda-8228fdd58c9f req-56a21dda-816f-44a6-b5fe-99ccd9489eb9 service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] No waiting events found dispatching network-vif-plugged-fbfbc293-8e8d-42cb-a48b-acbb18db85e1 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:06:45 user nova-compute[72773]: WARNING nova.compute.manager [req-002b2adb-023b-450c-8bda-8228fdd58c9f req-56a21dda-816f-44a6-b5fe-99ccd9489eb9 service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Received unexpected event network-vif-plugged-fbfbc293-8e8d-42cb-a48b-acbb18db85e1 for instance with vm_state active and task_state None.
Aug 16 23:06:45 user nova-compute[72773]: DEBUG nova.compute.manager [req-002b2adb-023b-450c-8bda-8228fdd58c9f req-56a21dda-816f-44a6-b5fe-99ccd9489eb9 service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Received event network-vif-plugged-fbfbc293-8e8d-42cb-a48b-acbb18db85e1 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:06:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-002b2adb-023b-450c-8bda-8228fdd58c9f req-56a21dda-816f-44a6-b5fe-99ccd9489eb9 service nova] Acquiring lock "2f05f5de-bf0b-4034-a755-a5f526a7b893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:06:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-002b2adb-023b-450c-8bda-8228fdd58c9f req-56a21dda-816f-44a6-b5fe-99ccd9489eb9 service nova] Lock "2f05f5de-bf0b-4034-a755-a5f526a7b893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:06:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-002b2adb-023b-450c-8bda-8228fdd58c9f req-56a21dda-816f-44a6-b5fe-99ccd9489eb9 service nova] Lock "2f05f5de-bf0b-4034-a755-a5f526a7b893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:06:45 user nova-compute[72773]: DEBUG nova.compute.manager [req-002b2adb-023b-450c-8bda-8228fdd58c9f req-56a21dda-816f-44a6-b5fe-99ccd9489eb9 service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] No waiting events found dispatching network-vif-plugged-fbfbc293-8e8d-42cb-a48b-acbb18db85e1 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:06:45 user nova-compute[72773]: WARNING nova.compute.manager [req-002b2adb-023b-450c-8bda-8228fdd58c9f req-56a21dda-816f-44a6-b5fe-99ccd9489eb9 service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Received unexpected event network-vif-plugged-fbfbc293-8e8d-42cb-a48b-acbb18db85e1 for instance with vm_state active and task_state None.
Aug 16 23:06:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:06:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:06:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:06:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:06:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-01a086b9-b7c7-4da5-b132-1bd30c7d06b1 req-94438f03-9950-4831-951b-3abf3eeca3c6 service nova] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Received event network-changed-d39a116b-5c47-40c3-a387-91d23997f573 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:06:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-01a086b9-b7c7-4da5-b132-1bd30c7d06b1 req-94438f03-9950-4831-951b-3abf3eeca3c6 service nova] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Refreshing instance network info cache due to event network-changed-d39a116b-5c47-40c3-a387-91d23997f573. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 23:06:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-01a086b9-b7c7-4da5-b132-1bd30c7d06b1 req-94438f03-9950-4831-951b-3abf3eeca3c6 service nova] Acquiring lock "refresh_cache-7cd37206-86ce-47b6-ab17-3143f4184180" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:06:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-01a086b9-b7c7-4da5-b132-1bd30c7d06b1 req-94438f03-9950-4831-951b-3abf3eeca3c6 service nova] Acquired lock "refresh_cache-7cd37206-86ce-47b6-ab17-3143f4184180" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:06:58 user nova-compute[72773]: DEBUG nova.network.neutron [req-01a086b9-b7c7-4da5-b132-1bd30c7d06b1 req-94438f03-9950-4831-951b-3abf3eeca3c6 service nova] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Refreshing network info cache for port d39a116b-5c47-40c3-a387-91d23997f573 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 23:06:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:06:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:06:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:06:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:06:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:06:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:06:58 user nova-compute[72773]: DEBUG nova.network.neutron [req-01a086b9-b7c7-4da5-b132-1bd30c7d06b1 req-94438f03-9950-4831-951b-3abf3eeca3c6 service nova] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Updated VIF entry in instance network info cache for port d39a116b-5c47-40c3-a387-91d23997f573. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 23:06:58 user nova-compute[72773]: DEBUG nova.network.neutron [req-01a086b9-b7c7-4da5-b132-1bd30c7d06b1 req-94438f03-9950-4831-951b-3abf3eeca3c6 service nova] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Updating instance_info_cache with network_info: [{"id": "d39a116b-5c47-40c3-a387-91d23997f573", "address": "fa:16:3e:a7:89:96", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd39a116b-5c", "ovs_interfaceid": "d39a116b-5c47-40c3-a387-91d23997f573", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:06:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-01a086b9-b7c7-4da5-b132-1bd30c7d06b1 req-94438f03-9950-4831-951b-3abf3eeca3c6 service nova] Releasing lock "refresh_cache-7cd37206-86ce-47b6-ab17-3143f4184180" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "7cd37206-86ce-47b6-ab17-3143f4184180" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "7cd37206-86ce-47b6-ab17-3143f4184180" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "7cd37206-86ce-47b6-ab17-3143f4184180-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "7cd37206-86ce-47b6-ab17-3143f4184180-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "7cd37206-86ce-47b6-ab17-3143f4184180-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:06:59 user nova-compute[72773]: INFO nova.compute.manager [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Terminating instance
Aug 16 23:06:59 user nova-compute[72773]: DEBUG nova.compute.manager [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG nova.compute.manager [req-48f84973-9bcc-4988-912f-196580c5adb9 req-3e742063-dd7d-4e45-b3d4-13a97d6271d6 service nova] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Received event network-vif-unplugged-d39a116b-5c47-40c3-a387-91d23997f573 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-48f84973-9bcc-4988-912f-196580c5adb9 req-3e742063-dd7d-4e45-b3d4-13a97d6271d6 service nova] Acquiring lock "7cd37206-86ce-47b6-ab17-3143f4184180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-48f84973-9bcc-4988-912f-196580c5adb9 req-3e742063-dd7d-4e45-b3d4-13a97d6271d6 service nova] Lock "7cd37206-86ce-47b6-ab17-3143f4184180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-48f84973-9bcc-4988-912f-196580c5adb9 req-3e742063-dd7d-4e45-b3d4-13a97d6271d6 service nova] Lock "7cd37206-86ce-47b6-ab17-3143f4184180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG nova.compute.manager [req-48f84973-9bcc-4988-912f-196580c5adb9 req-3e742063-dd7d-4e45-b3d4-13a97d6271d6 service nova] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] No waiting events found dispatching network-vif-unplugged-d39a116b-5c47-40c3-a387-91d23997f573 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG nova.compute.manager [req-48f84973-9bcc-4988-912f-196580c5adb9 req-3e742063-dd7d-4e45-b3d4-13a97d6271d6 service nova] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Received event network-vif-unplugged-d39a116b-5c47-40c3-a387-91d23997f573 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 23:06:59 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Instance destroyed successfully.
Aug 16 23:06:59 user nova-compute[72773]: DEBUG nova.objects.instance [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lazy-loading 'resources' on Instance uuid 7cd37206-86ce-47b6-ab17-3143f4184180 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T23:05:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-744339351',display_name='tempest-TestVolumeBootPattern-server-744339351',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-744339351',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL02+v69rOIm3d3DTbZyuQdTDm7FnOwFLT+9aenwjm8psvyRLcpRR7jJ6qjZ+VoOb17oLOwBBPT4Y5q77K4hElMopo/LfJNWLR3JbU03lfgxjehWHq1alQDpDMLvfTP4OA==',key_name='tempest-TestVolumeBootPattern-1277717100',keypairs=<?>,launch_index=0,launched_at=2023-08-16T23:05:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a51cd967e4254cfd9b8aee140f640682',ramdisk_id='',reservation_id='r-rkwhgmu5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1862722655',owner_user_name='tempest-TestVolumeBootPattern-1862722655-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T23:05:22Z,user_data=None,user_id='3f12eb2e28904f63baa1ddce4641e180',uuid=7cd37206-86ce-47b6-ab17-3143f4184180,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d39a116b-5c47-40c3-a387-91d23997f573", "address": "fa:16:3e:a7:89:96", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd39a116b-5c", "ovs_interfaceid": "d39a116b-5c47-40c3-a387-91d23997f573", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converting VIF {"id": "d39a116b-5c47-40c3-a387-91d23997f573", "address": "fa:16:3e:a7:89:96", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd39a116b-5c", "ovs_interfaceid": "d39a116b-5c47-40c3-a387-91d23997f573", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:89:96,bridge_name='br-int',has_traffic_filtering=True,id=d39a116b-5c47-40c3-a387-91d23997f573,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd39a116b-5c') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG os_vif [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:89:96,bridge_name='br-int',has_traffic_filtering=True,id=d39a116b-5c47-40c3-a387-91d23997f573,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd39a116b-5c') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd39a116b-5c, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:06:59 user nova-compute[72773]: INFO os_vif [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:89:96,bridge_name='br-int',has_traffic_filtering=True,id=d39a116b-5c47-40c3-a387-91d23997f573,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd39a116b-5c')
Aug 16 23:06:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JrAZRElQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 23:06:59 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 23:06:59 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e84c5ea-eae6-4984-9326-a1c14aa84840]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0a3d36-2456-49b7-a031-b9d08880d56c]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 (non-flash)
Aug 16 23:06:59 user nova-compute[72773]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 (non-flash)
Aug 16 23:06:59 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 (non-flash)
Aug 16 23:06:59 user nova-compute[72773]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 (non-flash)
Aug 16 23:06:59 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef5c269bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640'): ({'sdb'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Removing single pathed devices sdb {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50558f8-d099-4f18-b34c-811cfeccfdee]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:06:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:07:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:07:00 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2221f0ce-7a5c-4583-86fa-e6ad2ebe6901]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:07:00 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Flushing IO for device /dev/sdb {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 23:07:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:07:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:07:00 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[38773b19-5234-457a-b723-9390b0f61444]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:07:00 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 23:07:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:07:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:07:00 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cb48a0-8a54-4a79-bb9a-0a63e70736df]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:07:00 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 23:07:00 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] SCSI volumes sdb have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 23:07:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 23:07:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:07:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:07:00 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3684ffea-9bdf-4ab7-8beb-7ff6b16b9138]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:07:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:07:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:07:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:07:00 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[67910395-d142-429e-9263-62932699e2a1]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:07:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640, portal: 172.16.0.220,3260]
Aug 16 23:07:00 user nova-compute[72773]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640, portal: 172.16.0.220,3260] successful.
Aug 16 23:07:00 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:07:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:07:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:07:00 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd3bacd-d189-44d4-8ac1-6edd9f71140d]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:07:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:07:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 23:07:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] <== disconnect_volume: return (278ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 23:07:00 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 23:07:00 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Deleting instance files /opt/stack/data/nova/instances/7cd37206-86ce-47b6-ab17-3143f4184180_del
Aug 16 23:07:00 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Deletion of /opt/stack/data/nova/instances/7cd37206-86ce-47b6-ab17-3143f4184180_del complete
Aug 16 23:07:00 user nova-compute[72773]: INFO nova.compute.manager [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 16 23:07:00 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 23:07:00 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 23:07:00 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 23:07:01 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:07:01 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Took 0.78 seconds to deallocate network for instance.
Aug 16 23:07:01 user nova-compute[72773]: DEBUG nova.compute.manager [req-537c4a7e-d97e-4f21-b1e3-c44179fb472d req-167c4f98-4e48-4a29-9d0f-0465183bd6c9 service nova] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Received event network-vif-deleted-d39a116b-5c47-40c3-a387-91d23997f573 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:07:01 user nova-compute[72773]: INFO nova.compute.manager [req-537c4a7e-d97e-4f21-b1e3-c44179fb472d req-167c4f98-4e48-4a29-9d0f-0465183bd6c9 service nova] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Neutron deleted interface d39a116b-5c47-40c3-a387-91d23997f573; detaching it from the instance and deleting it from the info cache
Aug 16 23:07:01 user nova-compute[72773]: DEBUG nova.network.neutron [req-537c4a7e-d97e-4f21-b1e3-c44179fb472d req-167c4f98-4e48-4a29-9d0f-0465183bd6c9 service nova] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:07:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:07:01 user nova-compute[72773]: DEBUG nova.compute.manager [req-537c4a7e-d97e-4f21-b1e3-c44179fb472d req-167c4f98-4e48-4a29-9d0f-0465183bd6c9 service nova] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Detach interface failed, port_id=d39a116b-5c47-40c3-a387-91d23997f573, reason: Instance 7cd37206-86ce-47b6-ab17-3143f4184180 could not be found. {{(pid=72773) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 23:07:01 user nova-compute[72773]: DEBUG nova.compute.manager [req-75514edd-81fd-4e41-92bf-f1b23b6a3261 req-c4fef210-9506-4d19-9d2a-637dd4d82c09 service nova] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Received event network-vif-plugged-d39a116b-5c47-40c3-a387-91d23997f573 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:07:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-75514edd-81fd-4e41-92bf-f1b23b6a3261 req-c4fef210-9506-4d19-9d2a-637dd4d82c09 service nova] Acquiring lock "7cd37206-86ce-47b6-ab17-3143f4184180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:07:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-75514edd-81fd-4e41-92bf-f1b23b6a3261 req-c4fef210-9506-4d19-9d2a-637dd4d82c09 service nova] Lock "7cd37206-86ce-47b6-ab17-3143f4184180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:07:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-75514edd-81fd-4e41-92bf-f1b23b6a3261 req-c4fef210-9506-4d19-9d2a-637dd4d82c09 service nova] Lock "7cd37206-86ce-47b6-ab17-3143f4184180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:07:01 user nova-compute[72773]: DEBUG nova.compute.manager [req-75514edd-81fd-4e41-92bf-f1b23b6a3261 req-c4fef210-9506-4d19-9d2a-637dd4d82c09 service nova] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] No waiting events found dispatching network-vif-plugged-d39a116b-5c47-40c3-a387-91d23997f573 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:07:01 user nova-compute[72773]: WARNING nova.compute.manager [req-75514edd-81fd-4e41-92bf-f1b23b6a3261 req-c4fef210-9506-4d19-9d2a-637dd4d82c09 service nova] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Received unexpected event network-vif-plugged-d39a116b-5c47-40c3-a387-91d23997f573 for instance with vm_state active and task_state deleting.
Aug 16 23:07:01 user nova-compute[72773]: INFO nova.compute.manager [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Took 0.78 seconds to detach 1 volumes for instance.
Aug 16 23:07:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:07:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:07:01 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:07:01 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:07:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:07:02 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Deleted allocations for instance 7cd37206-86ce-47b6-ab17-3143f4184180
Aug 16 23:07:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e5f61b75-9189-4d7b-90f9-43801ade26d8 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "7cd37206-86ce-47b6-ab17-3143f4184180" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.049s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:07:04 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:07:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:07:09 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:07:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:07:13 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:07:14 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692227219.8493888, 7cd37206-86ce-47b6-ab17-3143f4184180 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 23:07:14 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] VM Stopped (Lifecycle Event)
Aug 16 23:07:14 user nova-compute[72773]: DEBUG nova.compute.manager [None req-d113966a-7619-4538-a8f2-b1fb78954613 None None] [instance: 7cd37206-86ce-47b6-ab17-3143f4184180] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 23:07:14 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:07:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:07:19 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:07:19 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:07:20 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:07:21 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:07:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:07:25 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:07:25 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 23:07:25 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Didn't find any instances for network info cache update. {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 23:07:25 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:07:26 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:07:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:07:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:07:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:07:26 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 23:07:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f05f5de-bf0b-4034-a755-a5f526a7b893/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:07:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f05f5de-bf0b-4034-a755-a5f526a7b893/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:07:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f05f5de-bf0b-4034-a755-a5f526a7b893/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:07:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f05f5de-bf0b-4034-a755-a5f526a7b893/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:07:26 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 23:07:27 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:07:27 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:07:27 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=8792MB free_disk=25.339115142822266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 23:07:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:07:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:07:27 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 2f05f5de-bf0b-4034-a755-a5f526a7b893 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 23:07:27 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 23:07:27 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 23:07:27 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:07:27 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:07:27 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 23:07:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.206s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:07:29 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:07:29 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:07:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 23:07:29 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:07:31 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:07:34 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:07:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:07:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:07:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:07:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:07:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:07:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:07:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:07:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:07:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:07:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:07:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:07:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:07:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:07:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "c15d1875-ca6c-48f8-af1d-937bf498107e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:07:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "c15d1875-ca6c-48f8-af1d-937bf498107e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:07:50 user nova-compute[72773]: DEBUG nova.compute.manager [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 23:07:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:07:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:07:50 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 23:07:50 user nova-compute[72773]: INFO nova.compute.claims [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Claim successful on node user
Aug 16 23:07:51 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:07:51 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:07:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.209s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:07:51 user nova-compute[72773]: DEBUG nova.compute.manager [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 23:07:51 user nova-compute[72773]: DEBUG nova.compute.manager [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 23:07:51 user nova-compute[72773]: DEBUG nova.network.neutron [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 23:07:51 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 23:07:51 user nova-compute[72773]: DEBUG nova.compute.manager [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 23:07:51 user nova-compute[72773]: INFO nova.virt.block_device [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Booting with volume 6ac9c546-e347-4191-8fdc-6c30f8bba640 at /dev/vda
Aug 16 23:07:51 user nova-compute[72773]: DEBUG nova.policy [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f12eb2e28904f63baa1ddce4641e180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cd967e4254cfd9b8aee140f640682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 23:07:51 user nova-compute[72773]: DEBUG os_brick.utils [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 23:07:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:07:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:07:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6097d4b-2757-42e4-bc7b-7cd9cc6afde6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:07:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:07:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:07:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[545463ef-4ac6-4ecb-97b9-21b49feba206]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:07:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:07:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:07:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c58fbcc-5c8b-4f7e-a0b1-420757674588]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:07:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[06362fa0-85e2-4c6a-97f3-66d11f225b53]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:07:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:07:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 23:07:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 23:07:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:07:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 23:07:51 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 23:07:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f00ce12-e3f6-4f41-a03d-33fddc29a978]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:07:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 23:07:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 23:07:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 23:07:51 user nova-compute[72773]: DEBUG os_brick.utils [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 23:07:51 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Updating existing volume attachment record: 872981d2-a070-47e1-a9f0-de3e6ca451d5 {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 23:07:51 user nova-compute[72773]: DEBUG nova.network.neutron [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Successfully created port: 4330c4c7-b719-45fb-b7bf-05922b6d37f0 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 23:07:52 user nova-compute[72773]: DEBUG nova.network.neutron [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Successfully updated port: 4330c4c7-b719-45fb-b7bf-05922b6d37f0 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 23:07:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "refresh_cache-c15d1875-ca6c-48f8-af1d-937bf498107e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:07:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquired lock "refresh_cache-c15d1875-ca6c-48f8-af1d-937bf498107e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:07:52 user nova-compute[72773]: DEBUG nova.network.neutron [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 23:07:52 user nova-compute[72773]: DEBUG nova.compute.manager [req-0a8b1d40-b96f-46a7-997b-81ba26e523da req-639defba-92e8-4df1-9d91-3b96eb6b704a service nova] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Received event network-changed-4330c4c7-b719-45fb-b7bf-05922b6d37f0 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:07:52 user nova-compute[72773]: DEBUG nova.compute.manager [req-0a8b1d40-b96f-46a7-997b-81ba26e523da req-639defba-92e8-4df1-9d91-3b96eb6b704a service nova] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Refreshing instance network info cache due to event network-changed-4330c4c7-b719-45fb-b7bf-05922b6d37f0. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 23:07:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0a8b1d40-b96f-46a7-997b-81ba26e523da req-639defba-92e8-4df1-9d91-3b96eb6b704a service nova] Acquiring lock "refresh_cache-c15d1875-ca6c-48f8-af1d-937bf498107e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:07:52 user nova-compute[72773]: DEBUG nova.network.neutron [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 23:07:53 user nova-compute[72773]: DEBUG nova.network.neutron [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Updating instance_info_cache with network_info: [{"id": "4330c4c7-b719-45fb-b7bf-05922b6d37f0", "address": "fa:16:3e:fd:5a:d6", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4330c4c7-b7", "ovs_interfaceid": "4330c4c7-b719-45fb-b7bf-05922b6d37f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:07:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Releasing lock "refresh_cache-c15d1875-ca6c-48f8-af1d-937bf498107e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:07:53 user nova-compute[72773]: DEBUG nova.compute.manager [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Instance network_info: |[{"id": "4330c4c7-b719-45fb-b7bf-05922b6d37f0", "address": "fa:16:3e:fd:5a:d6", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4330c4c7-b7", "ovs_interfaceid": "4330c4c7-b719-45fb-b7bf-05922b6d37f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 23:07:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0a8b1d40-b96f-46a7-997b-81ba26e523da req-639defba-92e8-4df1-9d91-3b96eb6b704a service nova] Acquired lock "refresh_cache-c15d1875-ca6c-48f8-af1d-937bf498107e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:07:53 user nova-compute[72773]: DEBUG nova.network.neutron [req-0a8b1d40-b96f-46a7-997b-81ba26e523da req-639defba-92e8-4df1-9d91-3b96eb6b704a service nova] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Refreshing network info cache for port 4330c4c7-b719-45fb-b7bf-05922b6d37f0 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 23:07:53 user nova-compute[72773]: DEBUG nova.network.neutron [req-0a8b1d40-b96f-46a7-997b-81ba26e523da req-639defba-92e8-4df1-9d91-3b96eb6b704a service nova] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Updated VIF entry in instance network info cache for port 4330c4c7-b719-45fb-b7bf-05922b6d37f0. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 23:07:53 user nova-compute[72773]: DEBUG nova.network.neutron [req-0a8b1d40-b96f-46a7-997b-81ba26e523da req-639defba-92e8-4df1-9d91-3b96eb6b704a service nova] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Updating instance_info_cache with network_info: [{"id": "4330c4c7-b719-45fb-b7bf-05922b6d37f0", "address": "fa:16:3e:fd:5a:d6", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4330c4c7-b7", "ovs_interfaceid": "4330c4c7-b719-45fb-b7bf-05922b6d37f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:07:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0a8b1d40-b96f-46a7-997b-81ba26e523da req-639defba-92e8-4df1-9d91-3b96eb6b704a service nova] Releasing lock "refresh_cache-c15d1875-ca6c-48f8-af1d-937bf498107e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:07:54 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:07:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG nova.compute.manager [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 23:08:02 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Creating image(s)
Aug 16 23:08:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Did not create local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Ensure instance console log exists: /opt/stack/data/nova/instances/c15d1875-ca6c-48f8-af1d-937bf498107e/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Start _get_guest_xml network_info=[{"id": "4330c4c7-b719-45fb-b7bf-05922b6d37f0", "address": "fa:16:3e:fd:5a:d6", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4330c4c7-b7", "ovs_interfaceid": "4330c4c7-b719-45fb-b7bf-05922b6d37f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '872981d2-a070-47e1-a9f0-de3e6ca451d5', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JrAZRElQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c15d1875-ca6c-48f8-af1d-937bf498107e', 'attached_at': '', 'detached_at': '', 'volume_id': '6ac9c546-e347-4191-8fdc-6c30f8bba640', 'serial': '6ac9c546-e347-4191-8fdc-6c30f8bba640'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 23:08:02 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:08:02 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:08:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JrAZRElQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 23:08:02 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 23:08:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 23:08:02 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 23:08:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 23:08:02 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4649c1-cd6e-437b-af08-5e34f107ad72]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 23:08:02 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11d20fe-0a1c-4567-86f7-70314144ba52]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640] added
Aug 16 23:08:02 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[09952b49-86f4-4227-8a1c-197fe53fdd68]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[861ec20e-1bf9-4dce-af5d-fae77c4b150e]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JrAZRElQ {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JrAZRElQ" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa734020-211d-43c8-83fb-8bbd60a552ac]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JrAZRElQ'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac74a07f-171b-4e97-8720-4c137ae518fa]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[51989d96-d80d-4242-a062-0419005411e4]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 (non-flash)
Aug 16 23:08:02 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 (non-flash)
Aug 16 23:08:02 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b306acc5-c5a2-4df9-8575-c72626f1c8f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640, portal: 172.16.0.220,3260]
Aug 16 23:08:02 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640, portal: 172.16.0.220,3260] successful.
Aug 16 23:08:02 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7029ec8-2958-4efb-a2cf-1ee2f64961ef]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4427136-e712-4d6e-a600-737abf895cf7]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 (non-flash)
Aug 16 23:08:02 user nova-compute[72773]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 (non-flash)
Aug 16 23:08:02 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 (non-flash)
Aug 16 23:08:02 user nova-compute[72773]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 (non-flash)
Aug 16 23:08:02 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d33d24-0d0e-4316-bf26-d71672733e45]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:08:02 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 23:08:03 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 23:08:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JrAZRElQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 23:08:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 23:08:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '26435636331613166', 'path': '/dev/sdb'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 23:08:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435636331613166', 'path': '/dev/sdb'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 23:08:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T23:07:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-427935291',display_name='tempest-TestVolumeBootPattern-server-427935291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-427935291',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL02+v69rOIm3d3DTbZyuQdTDm7FnOwFLT+9aenwjm8psvyRLcpRR7jJ6qjZ+VoOb17oLOwBBPT4Y5q77K4hElMopo/LfJNWLR3JbU03lfgxjehWHq1alQDpDMLvfTP4OA==',key_name='tempest-TestVolumeBootPattern-1277717100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a51cd967e4254cfd9b8aee140f640682',ramdisk_id='',reservation_id='r-k7eiisds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1862722655',owner_user_name='tempest-TestVolumeBootPattern-1862722655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T23:07:51Z,user_data=None,user_id='3f12eb2e28904f63baa1ddce4641e180',uuid=c15d1875-ca6c-48f8-af1d-937bf498107e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4330c4c7-b719-45fb-b7bf-05922b6d37f0", "address": "fa:16:3e:fd:5a:d6", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4330c4c7-b7", "ovs_interfaceid": "4330c4c7-b719-45fb-b7bf-05922b6d37f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 23:08:03 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converting VIF {"id": "4330c4c7-b719-45fb-b7bf-05922b6d37f0", "address": "fa:16:3e:fd:5a:d6", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4330c4c7-b7", "ovs_interfaceid": "4330c4c7-b719-45fb-b7bf-05922b6d37f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 23:08:03 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:5a:d6,bridge_name='br-int',has_traffic_filtering=True,id=4330c4c7-b719-45fb-b7bf-05922b6d37f0,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4330c4c7-b7') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 23:08:03 user nova-compute[72773]: DEBUG nova.objects.instance [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lazy-loading 'pci_devices' on Instance uuid c15d1875-ca6c-48f8-af1d-937bf498107e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:08:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] End _get_guest_xml xml=<domain type="kvm">
Aug 16 23:08:03 user nova-compute[72773]:   <uuid>c15d1875-ca6c-48f8-af1d-937bf498107e</uuid>
Aug 16 23:08:03 user nova-compute[72773]:   <name>instance-00000033</name>
Aug 16 23:08:03 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 23:08:03 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 23:08:03 user nova-compute[72773]:   <metadata>
Aug 16 23:08:03 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 23:08:03 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 23:08:03 user nova-compute[72773]:       <nova:name>tempest-TestVolumeBootPattern-server-427935291</nova:name>
Aug 16 23:08:03 user nova-compute[72773]:       <nova:creationTime>2023-08-16 23:08:02</nova:creationTime>
Aug 16 23:08:03 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 23:08:03 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 23:08:03 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 23:08:03 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 23:08:03 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 23:08:03 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 23:08:03 user nova-compute[72773]:       </nova:flavor>
Aug 16 23:08:03 user nova-compute[72773]:       <nova:owner>
Aug 16 23:08:03 user nova-compute[72773]:         <nova:user uuid="3f12eb2e28904f63baa1ddce4641e180">tempest-TestVolumeBootPattern-1862722655-project-member</nova:user>
Aug 16 23:08:03 user nova-compute[72773]:         <nova:project uuid="a51cd967e4254cfd9b8aee140f640682">tempest-TestVolumeBootPattern-1862722655</nova:project>
Aug 16 23:08:03 user nova-compute[72773]:       </nova:owner>
Aug 16 23:08:03 user nova-compute[72773]:       <nova:ports>
Aug 16 23:08:03 user nova-compute[72773]:         <nova:port uuid="4330c4c7-b719-45fb-b7bf-05922b6d37f0">
Aug 16 23:08:03 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 23:08:03 user nova-compute[72773]:         </nova:port>
Aug 16 23:08:03 user nova-compute[72773]:       </nova:ports>
Aug 16 23:08:03 user nova-compute[72773]:     </nova:instance>
Aug 16 23:08:03 user nova-compute[72773]:   </metadata>
Aug 16 23:08:03 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 23:08:03 user nova-compute[72773]:     <system>
Aug 16 23:08:03 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 23:08:03 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 23:08:03 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 23:08:03 user nova-compute[72773]:       <entry name="serial">c15d1875-ca6c-48f8-af1d-937bf498107e</entry>
Aug 16 23:08:03 user nova-compute[72773]:       <entry name="uuid">c15d1875-ca6c-48f8-af1d-937bf498107e</entry>
Aug 16 23:08:03 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 23:08:03 user nova-compute[72773]:     </system>
Aug 16 23:08:03 user nova-compute[72773]:   </sysinfo>
Aug 16 23:08:03 user nova-compute[72773]:   <os>
Aug 16 23:08:03 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 23:08:03 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 23:08:03 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 23:08:03 user nova-compute[72773]:   </os>
Aug 16 23:08:03 user nova-compute[72773]:   <features>
Aug 16 23:08:03 user nova-compute[72773]:     <acpi/>
Aug 16 23:08:03 user nova-compute[72773]:     <apic/>
Aug 16 23:08:03 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 23:08:03 user nova-compute[72773]:   </features>
Aug 16 23:08:03 user nova-compute[72773]:   <clock offset="utc">
Aug 16 23:08:03 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 23:08:03 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 23:08:03 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 23:08:03 user nova-compute[72773]:   </clock>
Aug 16 23:08:03 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 23:08:03 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 23:08:03 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 23:08:03 user nova-compute[72773]:   </cpu>
Aug 16 23:08:03 user nova-compute[72773]:   <devices>
Aug 16 23:08:03 user nova-compute[72773]:     <disk type="block" device="disk">
Aug 16 23:08:03 user nova-compute[72773]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 23:08:03 user nova-compute[72773]:       <source dev="/dev/sdb"/>
Aug 16 23:08:03 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 23:08:03 user nova-compute[72773]:       <serial>6ac9c546-e347-4191-8fdc-6c30f8bba640</serial>
Aug 16 23:08:03 user nova-compute[72773]:     </disk>
Aug 16 23:08:03 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 23:08:03 user nova-compute[72773]:       <mac address="fa:16:3e:fd:5a:d6"/>
Aug 16 23:08:03 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 23:08:03 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 23:08:03 user nova-compute[72773]:       <target dev="tap4330c4c7-b7"/>
Aug 16 23:08:03 user nova-compute[72773]:     </interface>
Aug 16 23:08:03 user nova-compute[72773]:     <serial type="pty">
Aug 16 23:08:03 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/c15d1875-ca6c-48f8-af1d-937bf498107e/console.log" append="off"/>
Aug 16 23:08:03 user nova-compute[72773]:     </serial>
Aug 16 23:08:03 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 23:08:03 user nova-compute[72773]:     <video>
Aug 16 23:08:03 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 23:08:03 user nova-compute[72773]:     </video>
Aug 16 23:08:03 user nova-compute[72773]:     <rng model="virtio">
Aug 16 23:08:03 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 23:08:03 user nova-compute[72773]:     </rng>
Aug 16 23:08:03 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 23:08:03 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 23:08:03 user nova-compute[72773]:       <stats period="10"/>
Aug 16 23:08:03 user nova-compute[72773]:     </memballoon>
Aug 16 23:08:03 user nova-compute[72773]:   </devices>
Aug 16 23:08:03 user nova-compute[72773]: </domain>
Aug 16 23:08:03 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 23:08:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T23:07:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-427935291',display_name='tempest-TestVolumeBootPattern-server-427935291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-427935291',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL02+v69rOIm3d3DTbZyuQdTDm7FnOwFLT+9aenwjm8psvyRLcpRR7jJ6qjZ+VoOb17oLOwBBPT4Y5q77K4hElMopo/LfJNWLR3JbU03lfgxjehWHq1alQDpDMLvfTP4OA==',key_name='tempest-TestVolumeBootPattern-1277717100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a51cd967e4254cfd9b8aee140f640682',ramdisk_id='',reservation_id='r-k7eiisds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1862722655',owner_user_name='tempest-TestVolumeBootPattern-1862722655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T23:07:51Z,user_data=None,user_id='3f12eb2e28904f63baa1ddce4641e180',uuid=c15d1875-ca6c-48f8-af1d-937bf498107e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4330c4c7-b719-45fb-b7bf-05922b6d37f0", "address": "fa:16:3e:fd:5a:d6", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4330c4c7-b7", "ovs_interfaceid": "4330c4c7-b719-45fb-b7bf-05922b6d37f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 23:08:03 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converting VIF {"id": "4330c4c7-b719-45fb-b7bf-05922b6d37f0", "address": "fa:16:3e:fd:5a:d6", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4330c4c7-b7", "ovs_interfaceid": "4330c4c7-b719-45fb-b7bf-05922b6d37f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 23:08:03 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:5a:d6,bridge_name='br-int',has_traffic_filtering=True,id=4330c4c7-b719-45fb-b7bf-05922b6d37f0,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4330c4c7-b7') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 23:08:03 user nova-compute[72773]: DEBUG os_vif [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:5a:d6,bridge_name='br-int',has_traffic_filtering=True,id=4330c4c7-b719-45fb-b7bf-05922b6d37f0,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4330c4c7-b7') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 23:08:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:08:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 23:08:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 23:08:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:08:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4330c4c7-b7, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 23:08:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4330c4c7-b7, col_values=(('external_ids', {'iface-id': '4330c4c7-b719-45fb-b7bf-05922b6d37f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:5a:d6', 'vm-uuid': 'c15d1875-ca6c-48f8-af1d-937bf498107e'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 23:08:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:08:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:08:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:08:03 user nova-compute[72773]: INFO os_vif [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:5a:d6,bridge_name='br-int',has_traffic_filtering=True,id=4330c4c7-b719-45fb-b7bf-05922b6d37f0,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4330c4c7-b7')
Aug 16 23:08:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 23:08:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] No VIF found with MAC fa:16:3e:fd:5a:d6, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 23:08:04 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:08:04 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:08:04 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:08:04 user nova-compute[72773]: DEBUG nova.compute.manager [req-9f68bb8b-5324-4311-a84e-be948737aced req-25e8a063-bcf5-4d73-aeb2-5f1428008bcb service nova] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Received event network-vif-plugged-4330c4c7-b719-45fb-b7bf-05922b6d37f0 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:08:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9f68bb8b-5324-4311-a84e-be948737aced req-25e8a063-bcf5-4d73-aeb2-5f1428008bcb service nova] Acquiring lock "c15d1875-ca6c-48f8-af1d-937bf498107e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:08:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9f68bb8b-5324-4311-a84e-be948737aced req-25e8a063-bcf5-4d73-aeb2-5f1428008bcb service nova] Lock "c15d1875-ca6c-48f8-af1d-937bf498107e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:08:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9f68bb8b-5324-4311-a84e-be948737aced req-25e8a063-bcf5-4d73-aeb2-5f1428008bcb service nova] Lock "c15d1875-ca6c-48f8-af1d-937bf498107e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:08:04 user nova-compute[72773]: DEBUG nova.compute.manager [req-9f68bb8b-5324-4311-a84e-be948737aced req-25e8a063-bcf5-4d73-aeb2-5f1428008bcb service nova] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] No waiting events found dispatching network-vif-plugged-4330c4c7-b719-45fb-b7bf-05922b6d37f0 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:08:04 user nova-compute[72773]: WARNING nova.compute.manager [req-9f68bb8b-5324-4311-a84e-be948737aced req-25e8a063-bcf5-4d73-aeb2-5f1428008bcb service nova] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Received unexpected event network-vif-plugged-4330c4c7-b719-45fb-b7bf-05922b6d37f0 for instance with vm_state building and task_state spawning.
Aug 16 23:08:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:08:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:08:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:08:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:08:05 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:08:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:08:06 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692227286.9619386, c15d1875-ca6c-48f8-af1d-937bf498107e => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 23:08:06 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] VM Resumed (Lifecycle Event)
Aug 16 23:08:06 user nova-compute[72773]: DEBUG nova.compute.manager [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 23:08:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 23:08:06 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Instance spawned successfully.
Aug 16 23:08:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 23:08:06 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 23:08:06 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 23:08:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 23:08:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 23:08:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 23:08:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 23:08:06 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 23:08:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 23:08:07 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 23:08:07 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692227286.963389, c15d1875-ca6c-48f8-af1d-937bf498107e => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 23:08:07 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] VM Started (Lifecycle Event)
Aug 16 23:08:07 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 23:08:07 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 23:08:07 user nova-compute[72773]: DEBUG nova.compute.manager [req-d509c73c-f989-410e-8009-fbe38d8842b4 req-cd8bccf6-dae5-4abd-9e41-023b846af0ca service nova] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Received event network-vif-plugged-4330c4c7-b719-45fb-b7bf-05922b6d37f0 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:08:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d509c73c-f989-410e-8009-fbe38d8842b4 req-cd8bccf6-dae5-4abd-9e41-023b846af0ca service nova] Acquiring lock "c15d1875-ca6c-48f8-af1d-937bf498107e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:08:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d509c73c-f989-410e-8009-fbe38d8842b4 req-cd8bccf6-dae5-4abd-9e41-023b846af0ca service nova] Lock "c15d1875-ca6c-48f8-af1d-937bf498107e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:08:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d509c73c-f989-410e-8009-fbe38d8842b4 req-cd8bccf6-dae5-4abd-9e41-023b846af0ca service nova] Lock "c15d1875-ca6c-48f8-af1d-937bf498107e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:08:07 user nova-compute[72773]: DEBUG nova.compute.manager [req-d509c73c-f989-410e-8009-fbe38d8842b4 req-cd8bccf6-dae5-4abd-9e41-023b846af0ca service nova] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] No waiting events found dispatching network-vif-plugged-4330c4c7-b719-45fb-b7bf-05922b6d37f0 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:08:07 user nova-compute[72773]: WARNING nova.compute.manager [req-d509c73c-f989-410e-8009-fbe38d8842b4 req-cd8bccf6-dae5-4abd-9e41-023b846af0ca service nova] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Received unexpected event network-vif-plugged-4330c4c7-b719-45fb-b7bf-05922b6d37f0 for instance with vm_state building and task_state spawning.
Aug 16 23:08:07 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 23:08:07 user nova-compute[72773]: INFO nova.compute.manager [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Took 4.96 seconds to spawn the instance on the hypervisor.
Aug 16 23:08:07 user nova-compute[72773]: DEBUG nova.compute.manager [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 23:08:07 user nova-compute[72773]: INFO nova.compute.manager [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Took 16.21 seconds to build instance.
Aug 16 23:08:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-676c10b9-2f3f-4501-95d9-4b7effd7137b tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "c15d1875-ca6c-48f8-af1d-937bf498107e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.304s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:08:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:08:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:08:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:08:15 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:08:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:08:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:08:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:08:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:08:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:08:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:08:19 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:08:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:08:21 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:08:23 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:08:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:08:25 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:08:25 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 23:08:25 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Rebuilding the list of instances to heal {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 23:08:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-2f05f5de-bf0b-4034-a755-a5f526a7b893" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:08:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-2f05f5de-bf0b-4034-a755-a5f526a7b893" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:08:25 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 23:08:25 user nova-compute[72773]: DEBUG nova.objects.instance [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lazy-loading 'info_cache' on Instance uuid 2f05f5de-bf0b-4034-a755-a5f526a7b893 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:08:25 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Updating instance_info_cache with network_info: [{"id": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "address": "fa:16:3e:6b:1d:44", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbfbc293-8e", "ovs_interfaceid": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:08:25 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-2f05f5de-bf0b-4034-a755-a5f526a7b893" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:08:25 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 23:08:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:08:26 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:08:26 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:08:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:08:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:08:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:08:26 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 23:08:26 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 23:08:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f05f5de-bf0b-4034-a755-a5f526a7b893/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:08:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f05f5de-bf0b-4034-a755-a5f526a7b893/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:08:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f05f5de-bf0b-4034-a755-a5f526a7b893/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:08:26 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f05f5de-bf0b-4034-a755-a5f526a7b893/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:08:26 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 23:08:27 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:08:27 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:08:27 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=8615MB free_disk=25.337493896484375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 23:08:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:08:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:08:27 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 2f05f5de-bf0b-4034-a755-a5f526a7b893 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 23:08:27 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance c15d1875-ca6c-48f8-af1d-937bf498107e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 23:08:27 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 23:08:27 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 23:08:27 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:08:27 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:08:27 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 23:08:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.230s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:08:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:08:30 user nova-compute[72773]: DEBUG nova.compute.manager [req-f22bde0a-80ea-447f-a7c3-2391852a2e1e req-2b600293-2003-4552-8712-dc4c86242257 service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Received event network-changed-fbfbc293-8e8d-42cb-a48b-acbb18db85e1 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:08:30 user nova-compute[72773]: DEBUG nova.compute.manager [req-f22bde0a-80ea-447f-a7c3-2391852a2e1e req-2b600293-2003-4552-8712-dc4c86242257 service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Refreshing instance network info cache due to event network-changed-fbfbc293-8e8d-42cb-a48b-acbb18db85e1. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 23:08:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f22bde0a-80ea-447f-a7c3-2391852a2e1e req-2b600293-2003-4552-8712-dc4c86242257 service nova] Acquiring lock "refresh_cache-2f05f5de-bf0b-4034-a755-a5f526a7b893" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:08:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f22bde0a-80ea-447f-a7c3-2391852a2e1e req-2b600293-2003-4552-8712-dc4c86242257 service nova] Acquired lock "refresh_cache-2f05f5de-bf0b-4034-a755-a5f526a7b893" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:08:30 user nova-compute[72773]: DEBUG nova.network.neutron [req-f22bde0a-80ea-447f-a7c3-2391852a2e1e req-2b600293-2003-4552-8712-dc4c86242257 service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Refreshing network info cache for port fbfbc293-8e8d-42cb-a48b-acbb18db85e1 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 23:08:30 user nova-compute[72773]: DEBUG nova.network.neutron [req-f22bde0a-80ea-447f-a7c3-2391852a2e1e req-2b600293-2003-4552-8712-dc4c86242257 service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Updated VIF entry in instance network info cache for port fbfbc293-8e8d-42cb-a48b-acbb18db85e1. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 23:08:30 user nova-compute[72773]: DEBUG nova.network.neutron [req-f22bde0a-80ea-447f-a7c3-2391852a2e1e req-2b600293-2003-4552-8712-dc4c86242257 service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Updating instance_info_cache with network_info: [{"id": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "address": "fa:16:3e:6b:1d:44", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbfbc293-8e", "ovs_interfaceid": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:08:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f22bde0a-80ea-447f-a7c3-2391852a2e1e req-2b600293-2003-4552-8712-dc4c86242257 service nova] Releasing lock "refresh_cache-2f05f5de-bf0b-4034-a755-a5f526a7b893" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:08:30 user nova-compute[72773]: DEBUG nova.compute.manager [req-810d9e4b-1622-458e-b8ca-0f3bd36e22db req-debe0293-f4ae-4713-955c-fd12651d85cd service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Received event network-changed-fbfbc293-8e8d-42cb-a48b-acbb18db85e1 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:08:30 user nova-compute[72773]: DEBUG nova.compute.manager [req-810d9e4b-1622-458e-b8ca-0f3bd36e22db req-debe0293-f4ae-4713-955c-fd12651d85cd service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Refreshing instance network info cache due to event network-changed-fbfbc293-8e8d-42cb-a48b-acbb18db85e1. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 23:08:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-810d9e4b-1622-458e-b8ca-0f3bd36e22db req-debe0293-f4ae-4713-955c-fd12651d85cd service nova] Acquiring lock "refresh_cache-2f05f5de-bf0b-4034-a755-a5f526a7b893" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:08:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-810d9e4b-1622-458e-b8ca-0f3bd36e22db req-debe0293-f4ae-4713-955c-fd12651d85cd service nova] Acquired lock "refresh_cache-2f05f5de-bf0b-4034-a755-a5f526a7b893" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:08:30 user nova-compute[72773]: DEBUG nova.network.neutron [req-810d9e4b-1622-458e-b8ca-0f3bd36e22db req-debe0293-f4ae-4713-955c-fd12651d85cd service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Refreshing network info cache for port fbfbc293-8e8d-42cb-a48b-acbb18db85e1 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8e172524-32b7-41fc-b015-db969de3ac54 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "2f05f5de-bf0b-4034-a755-a5f526a7b893" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8e172524-32b7-41fc-b015-db969de3ac54 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "2f05f5de-bf0b-4034-a755-a5f526a7b893" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:08:31 user nova-compute[72773]: INFO nova.compute.manager [None req-8e172524-32b7-41fc-b015-db969de3ac54 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Detaching volume c3f4e5b8-0f63-4341-bbd8-906429409fc2
Aug 16 23:08:31 user nova-compute[72773]: INFO nova.virt.block_device [None req-8e172524-32b7-41fc-b015-db969de3ac54 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Attempting to driver detach volume c3f4e5b8-0f63-4341-bbd8-906429409fc2 from mountpoint /dev/vdb
Aug 16 23:08:31 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-8e172524-32b7-41fc-b015-db969de3ac54 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Attempting to detach device vdb from instance 2f05f5de-bf0b-4034-a755-a5f526a7b893 from the persistent domain config. {{(pid=72773) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-8e172524-32b7-41fc-b015-db969de3ac54 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 23:08:31 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 23:08:31 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 23:08:31 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 23:08:31 user nova-compute[72773]:   <serial>c3f4e5b8-0f63-4341-bbd8-906429409fc2</serial>
Aug 16 23:08:31 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 23:08:31 user nova-compute[72773]: </disk>
Aug 16 23:08:31 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 23:08:31 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-8e172524-32b7-41fc-b015-db969de3ac54 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Successfully detached device vdb from instance 2f05f5de-bf0b-4034-a755-a5f526a7b893 from the persistent domain config.
Aug 16 23:08:31 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-8e172524-32b7-41fc-b015-db969de3ac54 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2f05f5de-bf0b-4034-a755-a5f526a7b893 from the live domain config. {{(pid=72773) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-8e172524-32b7-41fc-b015-db969de3ac54 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 23:08:31 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 23:08:31 user nova-compute[72773]:   <source dev="/dev/sdc"/>
Aug 16 23:08:31 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 23:08:31 user nova-compute[72773]:   <serial>c3f4e5b8-0f63-4341-bbd8-906429409fc2</serial>
Aug 16 23:08:31 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 23:08:31 user nova-compute[72773]: </disk>
Aug 16 23:08:31 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG nova.network.neutron [req-810d9e4b-1622-458e-b8ca-0f3bd36e22db req-debe0293-f4ae-4713-955c-fd12651d85cd service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Updated VIF entry in instance network info cache for port fbfbc293-8e8d-42cb-a48b-acbb18db85e1. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG nova.network.neutron [req-810d9e4b-1622-458e-b8ca-0f3bd36e22db req-debe0293-f4ae-4713-955c-fd12651d85cd service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Updating instance_info_cache with network_info: [{"id": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "address": "fa:16:3e:6b:1d:44", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbfbc293-8e", "ovs_interfaceid": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-810d9e4b-1622-458e-b8ca-0f3bd36e22db req-debe0293-f4ae-4713-955c-fd12651d85cd service nova] Releasing lock "refresh_cache-2f05f5de-bf0b-4034-a755-a5f526a7b893" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Received event <DeviceRemovedEvent: 1692227311.5613446, 2f05f5de-bf0b-4034-a755-a5f526a7b893 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72773) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-8e172524-32b7-41fc-b015-db969de3ac54 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2f05f5de-bf0b-4034-a755-a5f526a7b893 {{(pid=72773) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 23:08:31 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-8e172524-32b7-41fc-b015-db969de3ac54 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Successfully detached device vdb from instance 2f05f5de-bf0b-4034-a755-a5f526a7b893 from the live domain config.
Aug 16 23:08:31 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e172524-32b7-41fc-b015-db969de3ac54 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e172524-32b7-41fc-b015-db969de3ac54 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DOlGxwYP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 23:08:31 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-8e172524-32b7-41fc-b015-db969de3ac54 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 23:08:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-8e172524-32b7-41fc-b015-db969de3ac54 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-8e172524-32b7-41fc-b015-db969de3ac54 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e172524-32b7-41fc-b015-db969de3ac54 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78a7c83-a924-4e3b-bdb1-65d2a992e994]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e0758f-2dc1-415c-ac74-2d03c1aad9ad]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e172524-32b7-41fc-b015-db969de3ac54 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 (non-flash)
Aug 16 23:08:31 user nova-compute[72773]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 (non-flash)
Aug 16 23:08:31 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e172524-32b7-41fc-b015-db969de3ac54 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 (non-flash)
Aug 16 23:08:31 user nova-compute[72773]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 (non-flash)
Aug 16 23:08:31 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e172524-32b7-41fc-b015-db969de3ac54 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef5c2511b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2'): ({'sdc'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-8e172524-32b7-41fc-b015-db969de3ac54 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Removing single pathed devices sdc {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f92e3e1-9d42-428c-8f74-63081e9a408b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a056363-354c-4957-80cb-ee0f1ef08ede]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-8e172524-32b7-41fc-b015-db969de3ac54 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Flushing IO for device /dev/sdc {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc22b7da-1bf4-4a8e-a435-0512421dfdd4]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-8e172524-32b7-41fc-b015-db969de3ac54 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2531ad73-364e-4c85-a93c-a86bc2816ff0]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-8e172524-32b7-41fc-b015-db969de3ac54 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-8e172524-32b7-41fc-b015-db969de3ac54 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e172524-32b7-41fc-b015-db969de3ac54 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c81a7c7-441d-4b6f-8ee4-684c19b64e9f]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e172524-32b7-41fc-b015-db969de3ac54 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0b2e9d-eab4-43e6-8889-e52b6dbe1234]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e172524-32b7-41fc-b015-db969de3ac54 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2, portal: 172.16.0.220,3260]
Aug 16 23:08:31 user nova-compute[72773]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2, portal: 172.16.0.220,3260] successful.
Aug 16 23:08:31 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3f4e5b8-0f63-4341-bbd8-906429409fc2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7b7148-4e0a-4053-9587-a83186e042aa]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e172524-32b7-41fc-b015-db969de3ac54 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-8e172524-32b7-41fc-b015-db969de3ac54 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e172524-32b7-41fc-b015-db969de3ac54 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] <== disconnect_volume: return (282ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 23:08:31 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e172524-32b7-41fc-b015-db969de3ac54 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 23:08:32 user nova-compute[72773]: DEBUG nova.objects.instance [None req-8e172524-32b7-41fc-b015-db969de3ac54 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lazy-loading 'flavor' on Instance uuid 2f05f5de-bf0b-4034-a755-a5f526a7b893 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:08:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8e172524-32b7-41fc-b015-db969de3ac54 tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "2f05f5de-bf0b-4034-a755-a5f526a7b893" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.674s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:08:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:08:36 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:08:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:08:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:08:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:08:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:08:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:08:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:08:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:08:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:08:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:08:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:08:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:08:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:08:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:08:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:08:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:09:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:09:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:09:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:09:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:09:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:09:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:09:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:09:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:09:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:09:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:09:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:09:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:09:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:09:17 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:09:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:09:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:09:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:09:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:09:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:09:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:09:21 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:09:21 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:09:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:09:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:09:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:09:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:09:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:09:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:09:25 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:09:26 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:09:26 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 23:09:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-c15d1875-ca6c-48f8-af1d-937bf498107e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:09:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-c15d1875-ca6c-48f8-af1d-937bf498107e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:09:26 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 23:09:26 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Updating instance_info_cache with network_info: [{"id": "4330c4c7-b719-45fb-b7bf-05922b6d37f0", "address": "fa:16:3e:fd:5a:d6", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4330c4c7-b7", "ovs_interfaceid": "4330c4c7-b719-45fb-b7bf-05922b6d37f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:09:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-c15d1875-ca6c-48f8-af1d-937bf498107e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:09:26 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 23:09:27 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:09:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-af1ee511-e9a4-4a91-b5fb-59618e0f805f tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "2f05f5de-bf0b-4034-a755-a5f526a7b893" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:09:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-af1ee511-e9a4-4a91-b5fb-59618e0f805f tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "2f05f5de-bf0b-4034-a755-a5f526a7b893" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:09:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-af1ee511-e9a4-4a91-b5fb-59618e0f805f tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "2f05f5de-bf0b-4034-a755-a5f526a7b893-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:09:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-af1ee511-e9a4-4a91-b5fb-59618e0f805f tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "2f05f5de-bf0b-4034-a755-a5f526a7b893-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:09:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-af1ee511-e9a4-4a91-b5fb-59618e0f805f tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "2f05f5de-bf0b-4034-a755-a5f526a7b893-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:09:27 user nova-compute[72773]: INFO nova.compute.manager [None req-af1ee511-e9a4-4a91-b5fb-59618e0f805f tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Terminating instance
Aug 16 23:09:27 user nova-compute[72773]: DEBUG nova.compute.manager [None req-af1ee511-e9a4-4a91-b5fb-59618e0f805f tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 23:09:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:09:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:09:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:09:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:09:28 user nova-compute[72773]: DEBUG nova.compute.manager [req-d6e911e9-a7d3-49bf-8410-c69179269476 req-69eb7c64-41a2-4c24-a34e-b4eedac4311f service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Received event network-vif-unplugged-fbfbc293-8e8d-42cb-a48b-acbb18db85e1 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:09:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d6e911e9-a7d3-49bf-8410-c69179269476 req-69eb7c64-41a2-4c24-a34e-b4eedac4311f service nova] Acquiring lock "2f05f5de-bf0b-4034-a755-a5f526a7b893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:09:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d6e911e9-a7d3-49bf-8410-c69179269476 req-69eb7c64-41a2-4c24-a34e-b4eedac4311f service nova] Lock "2f05f5de-bf0b-4034-a755-a5f526a7b893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:09:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d6e911e9-a7d3-49bf-8410-c69179269476 req-69eb7c64-41a2-4c24-a34e-b4eedac4311f service nova] Lock "2f05f5de-bf0b-4034-a755-a5f526a7b893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:09:28 user nova-compute[72773]: DEBUG nova.compute.manager [req-d6e911e9-a7d3-49bf-8410-c69179269476 req-69eb7c64-41a2-4c24-a34e-b4eedac4311f service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] No waiting events found dispatching network-vif-unplugged-fbfbc293-8e8d-42cb-a48b-acbb18db85e1 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:09:28 user nova-compute[72773]: DEBUG nova.compute.manager [req-d6e911e9-a7d3-49bf-8410-c69179269476 req-69eb7c64-41a2-4c24-a34e-b4eedac4311f service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Received event network-vif-unplugged-fbfbc293-8e8d-42cb-a48b-acbb18db85e1 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 23:09:28 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:09:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:09:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:09:28 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:09:28 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 23:09:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:09:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:09:28 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Instance destroyed successfully.
Aug 16 23:09:28 user nova-compute[72773]: DEBUG nova.objects.instance [None req-af1ee511-e9a4-4a91-b5fb-59618e0f805f tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lazy-loading 'resources' on Instance uuid 2f05f5de-bf0b-4034-a755-a5f526a7b893 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:09:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-af1ee511-e9a4-4a91-b5fb-59618e0f805f tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T23:04:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-453993895',display_name='tempest-TestMinimumBasicScenario-server-453993895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-453993895',id=49,image_ref='6783777a-68fc-4e6d-89dd-68928fda3795',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUV7FQulcTeSGbSdFwxTCqodoEZ+8sBBrvn1GuL4aEuKQ0KQiKfhOZQ9ne0gqbcIfrYg9mvfdF4csttr0nrB42mU5qtOj+7t0t2b7/AXqi5W723TnkW5sUn8KyaSB7Gjg==',key_name='tempest-TestMinimumBasicScenario-460007714',keypairs=<?>,launch_index=0,launched_at=2023-08-16T23:04:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de13176691174b7eab7cb53a49df2933',ramdisk_id='',reservation_id='r-xw7b1qfq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6783777a-68fc-4e6d-89dd-68928fda3795',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1869730972',owner_user_name='tempest-TestMinimumBasicScenario-1869730972-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T23:06:46Z,user_data=None,user_id='4d71f078c09c449ca7747a74d5bfb138',uuid=2f05f5de-bf0b-4034-a755-a5f526a7b893,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "address": "fa:16:3e:6b:1d:44", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbfbc293-8e", "ovs_interfaceid": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 23:09:28 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-af1ee511-e9a4-4a91-b5fb-59618e0f805f tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Converting VIF {"id": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "address": "fa:16:3e:6b:1d:44", "network": {"id": "206eb708-434c-424b-86c4-5f958178361d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-30435224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de13176691174b7eab7cb53a49df2933", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbfbc293-8e", "ovs_interfaceid": "fbfbc293-8e8d-42cb-a48b-acbb18db85e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 23:09:28 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-af1ee511-e9a4-4a91-b5fb-59618e0f805f tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:1d:44,bridge_name='br-int',has_traffic_filtering=True,id=fbfbc293-8e8d-42cb-a48b-acbb18db85e1,network=Network(206eb708-434c-424b-86c4-5f958178361d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbfbc293-8e') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 23:09:28 user nova-compute[72773]: DEBUG os_vif [None req-af1ee511-e9a4-4a91-b5fb-59618e0f805f tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:1d:44,bridge_name='br-int',has_traffic_filtering=True,id=fbfbc293-8e8d-42cb-a48b-acbb18db85e1,network=Network(206eb708-434c-424b-86c4-5f958178361d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbfbc293-8e') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 23:09:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:09:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfbfbc293-8e, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 23:09:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:09:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:09:28 user nova-compute[72773]: INFO os_vif [None req-af1ee511-e9a4-4a91-b5fb-59618e0f805f tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:1d:44,bridge_name='br-int',has_traffic_filtering=True,id=fbfbc293-8e8d-42cb-a48b-acbb18db85e1,network=Network(206eb708-434c-424b-86c4-5f958178361d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbfbc293-8e')
Aug 16 23:09:28 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-af1ee511-e9a4-4a91-b5fb-59618e0f805f tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Deleting instance files /opt/stack/data/nova/instances/2f05f5de-bf0b-4034-a755-a5f526a7b893_del
Aug 16 23:09:28 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-af1ee511-e9a4-4a91-b5fb-59618e0f805f tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Deletion of /opt/stack/data/nova/instances/2f05f5de-bf0b-4034-a755-a5f526a7b893_del complete
Aug 16 23:09:28 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 23:09:28 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000031, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/2f05f5de-bf0b-4034-a755-a5f526a7b893/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/2f05f5de-bf0b-4034-a755-a5f526a7b893/disk
Aug 16 23:09:28 user nova-compute[72773]: INFO nova.compute.manager [None req-af1ee511-e9a4-4a91-b5fb-59618e0f805f tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 16 23:09:28 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-af1ee511-e9a4-4a91-b5fb-59618e0f805f tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 23:09:28 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 23:09:28 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 23:09:29 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:09:29 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:09:29 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=8757MB free_disk=25.33642578125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 23:09:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:09:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:09:29 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 2f05f5de-bf0b-4034-a755-a5f526a7b893 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 23:09:29 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance c15d1875-ca6c-48f8-af1d-937bf498107e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 23:09:29 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 23:09:29 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 23:09:29 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:09:29 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:09:29 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 23:09:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.211s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:09:29 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:09:29 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Took 0.77 seconds to deallocate network for instance.
Aug 16 23:09:29 user nova-compute[72773]: DEBUG nova.compute.manager [req-356f3e65-186c-4ed7-a816-a09594f77092 req-dc59fd0e-e277-40ea-9314-b9872999fc90 service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Received event network-vif-deleted-fbfbc293-8e8d-42cb-a48b-acbb18db85e1 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:09:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-af1ee511-e9a4-4a91-b5fb-59618e0f805f tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:09:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-af1ee511-e9a4-4a91-b5fb-59618e0f805f tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:09:29 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-af1ee511-e9a4-4a91-b5fb-59618e0f805f tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:09:29 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-af1ee511-e9a4-4a91-b5fb-59618e0f805f tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:09:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-af1ee511-e9a4-4a91-b5fb-59618e0f805f tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:09:29 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-af1ee511-e9a4-4a91-b5fb-59618e0f805f tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Deleted allocations for instance 2f05f5de-bf0b-4034-a755-a5f526a7b893
Aug 16 23:09:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-af1ee511-e9a4-4a91-b5fb-59618e0f805f tempest-TestMinimumBasicScenario-1869730972 tempest-TestMinimumBasicScenario-1869730972-project-member] Lock "2f05f5de-bf0b-4034-a755-a5f526a7b893" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.943s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:09:30 user nova-compute[72773]: DEBUG nova.compute.manager [req-8e386f60-0f1a-4cfc-a97a-3b5481c8be57 req-c6a6bb94-74f6-40db-a936-4c9ed60f379d service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Received event network-vif-plugged-fbfbc293-8e8d-42cb-a48b-acbb18db85e1 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:09:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-8e386f60-0f1a-4cfc-a97a-3b5481c8be57 req-c6a6bb94-74f6-40db-a936-4c9ed60f379d service nova] Acquiring lock "2f05f5de-bf0b-4034-a755-a5f526a7b893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:09:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-8e386f60-0f1a-4cfc-a97a-3b5481c8be57 req-c6a6bb94-74f6-40db-a936-4c9ed60f379d service nova] Lock "2f05f5de-bf0b-4034-a755-a5f526a7b893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:09:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-8e386f60-0f1a-4cfc-a97a-3b5481c8be57 req-c6a6bb94-74f6-40db-a936-4c9ed60f379d service nova] Lock "2f05f5de-bf0b-4034-a755-a5f526a7b893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:09:30 user nova-compute[72773]: DEBUG nova.compute.manager [req-8e386f60-0f1a-4cfc-a97a-3b5481c8be57 req-c6a6bb94-74f6-40db-a936-4c9ed60f379d service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] No waiting events found dispatching network-vif-plugged-fbfbc293-8e8d-42cb-a48b-acbb18db85e1 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:09:30 user nova-compute[72773]: WARNING nova.compute.manager [req-8e386f60-0f1a-4cfc-a97a-3b5481c8be57 req-c6a6bb94-74f6-40db-a936-4c9ed60f379d service nova] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Received unexpected event network-vif-plugged-fbfbc293-8e8d-42cb-a48b-acbb18db85e1 for instance with vm_state deleted and task_state None.
Aug 16 23:09:31 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:09:31 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 23:09:32 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:09:33 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:09:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:09:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:09:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:09:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:09:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:09:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:09:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:09:42 user nova-compute[72773]: DEBUG nova.compute.manager [req-191c79d0-6e8c-4ff8-887a-f9bd9cce89ef req-66511669-bde9-4e52-b3d8-7d3558e2a401 service nova] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Received event network-changed-4330c4c7-b719-45fb-b7bf-05922b6d37f0 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:09:42 user nova-compute[72773]: DEBUG nova.compute.manager [req-191c79d0-6e8c-4ff8-887a-f9bd9cce89ef req-66511669-bde9-4e52-b3d8-7d3558e2a401 service nova] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Refreshing instance network info cache due to event network-changed-4330c4c7-b719-45fb-b7bf-05922b6d37f0. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 23:09:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-191c79d0-6e8c-4ff8-887a-f9bd9cce89ef req-66511669-bde9-4e52-b3d8-7d3558e2a401 service nova] Acquiring lock "refresh_cache-c15d1875-ca6c-48f8-af1d-937bf498107e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:09:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-191c79d0-6e8c-4ff8-887a-f9bd9cce89ef req-66511669-bde9-4e52-b3d8-7d3558e2a401 service nova] Acquired lock "refresh_cache-c15d1875-ca6c-48f8-af1d-937bf498107e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:09:42 user nova-compute[72773]: DEBUG nova.network.neutron [req-191c79d0-6e8c-4ff8-887a-f9bd9cce89ef req-66511669-bde9-4e52-b3d8-7d3558e2a401 service nova] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Refreshing network info cache for port 4330c4c7-b719-45fb-b7bf-05922b6d37f0 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 23:09:43 user nova-compute[72773]: DEBUG nova.network.neutron [req-191c79d0-6e8c-4ff8-887a-f9bd9cce89ef req-66511669-bde9-4e52-b3d8-7d3558e2a401 service nova] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Updated VIF entry in instance network info cache for port 4330c4c7-b719-45fb-b7bf-05922b6d37f0. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 23:09:43 user nova-compute[72773]: DEBUG nova.network.neutron [req-191c79d0-6e8c-4ff8-887a-f9bd9cce89ef req-66511669-bde9-4e52-b3d8-7d3558e2a401 service nova] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Updating instance_info_cache with network_info: [{"id": "4330c4c7-b719-45fb-b7bf-05922b6d37f0", "address": "fa:16:3e:fd:5a:d6", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4330c4c7-b7", "ovs_interfaceid": "4330c4c7-b719-45fb-b7bf-05922b6d37f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:09:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-191c79d0-6e8c-4ff8-887a-f9bd9cce89ef req-66511669-bde9-4e52-b3d8-7d3558e2a401 service nova] Releasing lock "refresh_cache-c15d1875-ca6c-48f8-af1d-937bf498107e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:09:43 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692227368.6600208, 2f05f5de-bf0b-4034-a755-a5f526a7b893 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 23:09:43 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] VM Stopped (Lifecycle Event)
Aug 16 23:09:43 user nova-compute[72773]: DEBUG nova.compute.manager [None req-e9616f22-b2b0-426f-abce-b7d8c40e86d5 None None] [instance: 2f05f5de-bf0b-4034-a755-a5f526a7b893] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 23:09:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:09:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:09:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:09:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:09:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:09:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "9931204d-9ee0-4d48-bb71-e0f662979b30" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:09:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "9931204d-9ee0-4d48-bb71-e0f662979b30" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:09:56 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 23:09:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:09:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:09:56 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 23:09:56 user nova-compute[72773]: INFO nova.compute.claims [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Claim successful on node user
Aug 16 23:09:56 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:09:56 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:09:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.201s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:09:56 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 23:09:57 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 23:09:57 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 23:09:57 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 23:09:57 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 23:09:57 user nova-compute[72773]: INFO nova.virt.block_device [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Booting with volume cd4d096a-3935-40a8-9164-032258a20a9f at /dev/vda
Aug 16 23:09:57 user nova-compute[72773]: DEBUG nova.policy [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f12eb2e28904f63baa1ddce4641e180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cd967e4254cfd9b8aee140f640682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 23:09:57 user nova-compute[72773]: DEBUG os_brick.utils [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 23:09:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:09:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:09:57 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d33155-c819-4125-aff6-252e804d05ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:09:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:09:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:09:57 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[952caa01-44a1-4682-8383-ab486e63596e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:09:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:09:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:09:57 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b8f393-262f-48d5-b457-9b5baba493dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:09:57 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98130d2-2878-44a4-8935-5b395e45d5e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:09:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:09:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 23:09:57 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 23:09:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:09:57 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 23:09:57 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 23:09:57 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a214e5f2-f631-4e11-9eec-cdc5a647a323]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:09:57 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 23:09:57 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 23:09:57 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 23:09:57 user nova-compute[72773]: DEBUG os_brick.utils [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 23:09:57 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Updating existing volume attachment record: 973f29c9-d067-4e53-934e-e3b7491996ec {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 23:09:57 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Successfully created port: 26c7d845-5f32-4688-b819-1d59f3360c01 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 23:09:58 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Successfully updated port: 26c7d845-5f32-4688-b819-1d59f3360c01 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 23:09:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "refresh_cache-9931204d-9ee0-4d48-bb71-e0f662979b30" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:09:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquired lock "refresh_cache-9931204d-9ee0-4d48-bb71-e0f662979b30" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:09:58 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 23:09:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-2fb2e448-a983-47f6-80b5-2e0bc8f71183 req-1cad6150-bc65-4092-8ba7-e5a4da6d1b26 service nova] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Received event network-changed-26c7d845-5f32-4688-b819-1d59f3360c01 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:09:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-2fb2e448-a983-47f6-80b5-2e0bc8f71183 req-1cad6150-bc65-4092-8ba7-e5a4da6d1b26 service nova] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Refreshing instance network info cache due to event network-changed-26c7d845-5f32-4688-b819-1d59f3360c01. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 23:09:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2fb2e448-a983-47f6-80b5-2e0bc8f71183 req-1cad6150-bc65-4092-8ba7-e5a4da6d1b26 service nova] Acquiring lock "refresh_cache-9931204d-9ee0-4d48-bb71-e0f662979b30" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:09:58 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 23:09:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:09:58 user nova-compute[72773]: DEBUG nova.network.neutron [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Updating instance_info_cache with network_info: [{"id": "26c7d845-5f32-4688-b819-1d59f3360c01", "address": "fa:16:3e:76:a2:b5", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c7d845-5f", "ovs_interfaceid": "26c7d845-5f32-4688-b819-1d59f3360c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:09:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Releasing lock "refresh_cache-9931204d-9ee0-4d48-bb71-e0f662979b30" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:09:58 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Instance network_info: |[{"id": "26c7d845-5f32-4688-b819-1d59f3360c01", "address": "fa:16:3e:76:a2:b5", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c7d845-5f", "ovs_interfaceid": "26c7d845-5f32-4688-b819-1d59f3360c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 23:09:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2fb2e448-a983-47f6-80b5-2e0bc8f71183 req-1cad6150-bc65-4092-8ba7-e5a4da6d1b26 service nova] Acquired lock "refresh_cache-9931204d-9ee0-4d48-bb71-e0f662979b30" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:09:58 user nova-compute[72773]: DEBUG nova.network.neutron [req-2fb2e448-a983-47f6-80b5-2e0bc8f71183 req-1cad6150-bc65-4092-8ba7-e5a4da6d1b26 service nova] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Refreshing network info cache for port 26c7d845-5f32-4688-b819-1d59f3360c01 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 23:09:59 user nova-compute[72773]: DEBUG nova.network.neutron [req-2fb2e448-a983-47f6-80b5-2e0bc8f71183 req-1cad6150-bc65-4092-8ba7-e5a4da6d1b26 service nova] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Updated VIF entry in instance network info cache for port 26c7d845-5f32-4688-b819-1d59f3360c01. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 23:09:59 user nova-compute[72773]: DEBUG nova.network.neutron [req-2fb2e448-a983-47f6-80b5-2e0bc8f71183 req-1cad6150-bc65-4092-8ba7-e5a4da6d1b26 service nova] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Updating instance_info_cache with network_info: [{"id": "26c7d845-5f32-4688-b819-1d59f3360c01", "address": "fa:16:3e:76:a2:b5", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c7d845-5f", "ovs_interfaceid": "26c7d845-5f32-4688-b819-1d59f3360c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:09:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-2fb2e448-a983-47f6-80b5-2e0bc8f71183 req-1cad6150-bc65-4092-8ba7-e5a4da6d1b26 service nova] Releasing lock "refresh_cache-9931204d-9ee0-4d48-bb71-e0f662979b30" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:10:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:10:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 23:10:07 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Creating image(s)
Aug 16 23:10:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Did not create local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Ensure instance console log exists: /opt/stack/data/nova/instances/9931204d-9ee0-4d48-bb71-e0f662979b30/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Start _get_guest_xml network_info=[{"id": "26c7d845-5f32-4688-b819-1d59f3360c01", "address": "fa:16:3e:76:a2:b5", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c7d845-5f", "ovs_interfaceid": "26c7d845-5f32-4688-b819-1d59f3360c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '973f29c9-d067-4e53-934e-e3b7491996ec', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mwiyUBFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9931204d-9ee0-4d48-bb71-e0f662979b30', 'attached_at': '', 'detached_at': '', 'volume_id': 'cd4d096a-3935-40a8-9164-032258a20a9f', 'serial': 'cd4d096a-3935-40a8-9164-032258a20a9f'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 23:10:07 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:10:07 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:10:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mwiyUBFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 23:10:07 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 23:10:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 23:10:07 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 23:10:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 23:10:07 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfdf4b8-4459-48e7-86e2-854910a9f3b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 23:10:07 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5fbc8f-3f9e-43b0-ba8f-7ce0bf573b92]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f] added
Aug 16 23:10:07 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[73526eb6-9686-431c-acbb-18d55c42b8cb]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d217ebe9-41e7-44be-ba66-f3e38b613acc]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mwiyUBFC {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mwiyUBFC" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f4b759-1fe7-4c26-a52a-dce7cdd74b39]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mwiyUBFC'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fb6443-31f5-4a44-8cfc-2caf72b2ccbf]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[66183a18-5cfb-44e9-b516-71f8bfd70093]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 (non-flash)
Aug 16 23:10:07 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 (non-flash)
Aug 16 23:10:07 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d989ecf-d202-450d-b0ce-f7670b0dc53c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f, portal: 172.16.0.220,3260]
Aug 16 23:10:07 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f, portal: 172.16.0.220,3260] successful.
Aug 16 23:10:07 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8e2a1c-5357-4f87-a1e0-fbf14b2f956f]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[457e85bb-efe5-4b3a-932d-076553e2c56c]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 (non-flash)
Aug 16 23:10:07 user nova-compute[72773]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f (non-flash)
Aug 16 23:10:07 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 (non-flash)
Aug 16 23:10:07 user nova-compute[72773]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f (non-flash)
Aug 16 23:10:07 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcaa5b5-1f46-4083-b2d7-cfda5eec2000]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 23:10:07 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mwiyUBFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 23:10:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:10:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:10:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:10:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:10:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:10:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:10:08 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 23:10:08 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '26438646138666637', 'path': '/dev/sdc'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 23:10:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438646138666637', 'path': '/dev/sdc'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 23:10:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T23:09:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-133376122',display_name='tempest-TestVolumeBootPattern-server-133376122',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-133376122',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL02+v69rOIm3d3DTbZyuQdTDm7FnOwFLT+9aenwjm8psvyRLcpRR7jJ6qjZ+VoOb17oLOwBBPT4Y5q77K4hElMopo/LfJNWLR3JbU03lfgxjehWHq1alQDpDMLvfTP4OA==',key_name='tempest-TestVolumeBootPattern-1277717100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a51cd967e4254cfd9b8aee140f640682',ramdisk_id='',reservation_id='r-nzs4zhie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1862722655',owner_user_name='tempest-TestVolumeBootPattern-1862722655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T23:09:57Z,user_data=None,user_id='3f12eb2e28904f63baa1ddce4641e180',uuid=9931204d-9ee0-4d48-bb71-e0f662979b30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26c7d845-5f32-4688-b819-1d59f3360c01", "address": "fa:16:3e:76:a2:b5", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c7d845-5f", "ovs_interfaceid": "26c7d845-5f32-4688-b819-1d59f3360c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 23:10:08 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converting VIF {"id": "26c7d845-5f32-4688-b819-1d59f3360c01", "address": "fa:16:3e:76:a2:b5", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c7d845-5f", "ovs_interfaceid": "26c7d845-5f32-4688-b819-1d59f3360c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 23:10:08 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:a2:b5,bridge_name='br-int',has_traffic_filtering=True,id=26c7d845-5f32-4688-b819-1d59f3360c01,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c7d845-5f') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 23:10:08 user nova-compute[72773]: DEBUG nova.objects.instance [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lazy-loading 'pci_devices' on Instance uuid 9931204d-9ee0-4d48-bb71-e0f662979b30 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:10:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] End _get_guest_xml xml=<domain type="kvm">
Aug 16 23:10:08 user nova-compute[72773]:   <uuid>9931204d-9ee0-4d48-bb71-e0f662979b30</uuid>
Aug 16 23:10:08 user nova-compute[72773]:   <name>instance-00000034</name>
Aug 16 23:10:08 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 23:10:08 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 23:10:08 user nova-compute[72773]:   <metadata>
Aug 16 23:10:08 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 23:10:08 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 23:10:08 user nova-compute[72773]:       <nova:name>tempest-TestVolumeBootPattern-server-133376122</nova:name>
Aug 16 23:10:08 user nova-compute[72773]:       <nova:creationTime>2023-08-16 23:10:07</nova:creationTime>
Aug 16 23:10:08 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 23:10:08 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 23:10:08 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 23:10:08 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 23:10:08 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 23:10:08 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 23:10:08 user nova-compute[72773]:       </nova:flavor>
Aug 16 23:10:08 user nova-compute[72773]:       <nova:owner>
Aug 16 23:10:08 user nova-compute[72773]:         <nova:user uuid="3f12eb2e28904f63baa1ddce4641e180">tempest-TestVolumeBootPattern-1862722655-project-member</nova:user>
Aug 16 23:10:08 user nova-compute[72773]:         <nova:project uuid="a51cd967e4254cfd9b8aee140f640682">tempest-TestVolumeBootPattern-1862722655</nova:project>
Aug 16 23:10:08 user nova-compute[72773]:       </nova:owner>
Aug 16 23:10:08 user nova-compute[72773]:       <nova:ports>
Aug 16 23:10:08 user nova-compute[72773]:         <nova:port uuid="26c7d845-5f32-4688-b819-1d59f3360c01">
Aug 16 23:10:08 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 23:10:08 user nova-compute[72773]:         </nova:port>
Aug 16 23:10:08 user nova-compute[72773]:       </nova:ports>
Aug 16 23:10:08 user nova-compute[72773]:     </nova:instance>
Aug 16 23:10:08 user nova-compute[72773]:   </metadata>
Aug 16 23:10:08 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 23:10:08 user nova-compute[72773]:     <system>
Aug 16 23:10:08 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 23:10:08 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 23:10:08 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 23:10:08 user nova-compute[72773]:       <entry name="serial">9931204d-9ee0-4d48-bb71-e0f662979b30</entry>
Aug 16 23:10:08 user nova-compute[72773]:       <entry name="uuid">9931204d-9ee0-4d48-bb71-e0f662979b30</entry>
Aug 16 23:10:08 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 23:10:08 user nova-compute[72773]:     </system>
Aug 16 23:10:08 user nova-compute[72773]:   </sysinfo>
Aug 16 23:10:08 user nova-compute[72773]:   <os>
Aug 16 23:10:08 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 23:10:08 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 23:10:08 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 23:10:08 user nova-compute[72773]:   </os>
Aug 16 23:10:08 user nova-compute[72773]:   <features>
Aug 16 23:10:08 user nova-compute[72773]:     <acpi/>
Aug 16 23:10:08 user nova-compute[72773]:     <apic/>
Aug 16 23:10:08 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 23:10:08 user nova-compute[72773]:   </features>
Aug 16 23:10:08 user nova-compute[72773]:   <clock offset="utc">
Aug 16 23:10:08 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 23:10:08 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 23:10:08 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 23:10:08 user nova-compute[72773]:   </clock>
Aug 16 23:10:08 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 23:10:08 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 23:10:08 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 23:10:08 user nova-compute[72773]:   </cpu>
Aug 16 23:10:08 user nova-compute[72773]:   <devices>
Aug 16 23:10:08 user nova-compute[72773]:     <disk type="block" device="disk">
Aug 16 23:10:08 user nova-compute[72773]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 23:10:08 user nova-compute[72773]:       <source dev="/dev/sdc"/>
Aug 16 23:10:08 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 23:10:08 user nova-compute[72773]:       <serial>cd4d096a-3935-40a8-9164-032258a20a9f</serial>
Aug 16 23:10:08 user nova-compute[72773]:     </disk>
Aug 16 23:10:08 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 23:10:08 user nova-compute[72773]:       <mac address="fa:16:3e:76:a2:b5"/>
Aug 16 23:10:08 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 23:10:08 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 23:10:08 user nova-compute[72773]:       <target dev="tap26c7d845-5f"/>
Aug 16 23:10:08 user nova-compute[72773]:     </interface>
Aug 16 23:10:08 user nova-compute[72773]:     <serial type="pty">
Aug 16 23:10:08 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/9931204d-9ee0-4d48-bb71-e0f662979b30/console.log" append="off"/>
Aug 16 23:10:08 user nova-compute[72773]:     </serial>
Aug 16 23:10:08 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 23:10:08 user nova-compute[72773]:     <video>
Aug 16 23:10:08 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 23:10:08 user nova-compute[72773]:     </video>
Aug 16 23:10:08 user nova-compute[72773]:     <rng model="virtio">
Aug 16 23:10:08 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 23:10:08 user nova-compute[72773]:     </rng>
Aug 16 23:10:08 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 23:10:08 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 23:10:08 user nova-compute[72773]:       <stats period="10"/>
Aug 16 23:10:08 user nova-compute[72773]:     </memballoon>
Aug 16 23:10:08 user nova-compute[72773]:   </devices>
Aug 16 23:10:08 user nova-compute[72773]: </domain>
Aug 16 23:10:08 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 23:10:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T23:09:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-133376122',display_name='tempest-TestVolumeBootPattern-server-133376122',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-133376122',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL02+v69rOIm3d3DTbZyuQdTDm7FnOwFLT+9aenwjm8psvyRLcpRR7jJ6qjZ+VoOb17oLOwBBPT4Y5q77K4hElMopo/LfJNWLR3JbU03lfgxjehWHq1alQDpDMLvfTP4OA==',key_name='tempest-TestVolumeBootPattern-1277717100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a51cd967e4254cfd9b8aee140f640682',ramdisk_id='',reservation_id='r-nzs4zhie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1862722655',owner_user_name='tempest-TestVolumeBootPattern-1862722655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T23:09:57Z,user_data=None,user_id='3f12eb2e28904f63baa1ddce4641e180',uuid=9931204d-9ee0-4d48-bb71-e0f662979b30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26c7d845-5f32-4688-b819-1d59f3360c01", "address": "fa:16:3e:76:a2:b5", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c7d845-5f", "ovs_interfaceid": "26c7d845-5f32-4688-b819-1d59f3360c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 23:10:08 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converting VIF {"id": "26c7d845-5f32-4688-b819-1d59f3360c01", "address": "fa:16:3e:76:a2:b5", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c7d845-5f", "ovs_interfaceid": "26c7d845-5f32-4688-b819-1d59f3360c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 23:10:08 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:a2:b5,bridge_name='br-int',has_traffic_filtering=True,id=26c7d845-5f32-4688-b819-1d59f3360c01,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c7d845-5f') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 23:10:08 user nova-compute[72773]: DEBUG os_vif [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:a2:b5,bridge_name='br-int',has_traffic_filtering=True,id=26c7d845-5f32-4688-b819-1d59f3360c01,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c7d845-5f') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 23:10:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:10:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 23:10:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 23:10:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:10:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26c7d845-5f, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 23:10:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap26c7d845-5f, col_values=(('external_ids', {'iface-id': '26c7d845-5f32-4688-b819-1d59f3360c01', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:a2:b5', 'vm-uuid': '9931204d-9ee0-4d48-bb71-e0f662979b30'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 23:10:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:10:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:10:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:10:08 user nova-compute[72773]: INFO os_vif [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:a2:b5,bridge_name='br-int',has_traffic_filtering=True,id=26c7d845-5f32-4688-b819-1d59f3360c01,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c7d845-5f')
Aug 16 23:10:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 23:10:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] No VIF found with MAC fa:16:3e:76:a2:b5, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 23:10:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:10:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:10:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:10:10 user nova-compute[72773]: DEBUG nova.compute.manager [req-004f3ccf-7206-4bdf-b974-5262917c42c5 req-d0c38d78-12a6-4ccd-b14a-ba96739d2692 service nova] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Received event network-vif-plugged-26c7d845-5f32-4688-b819-1d59f3360c01 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:10:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-004f3ccf-7206-4bdf-b974-5262917c42c5 req-d0c38d78-12a6-4ccd-b14a-ba96739d2692 service nova] Acquiring lock "9931204d-9ee0-4d48-bb71-e0f662979b30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:10:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-004f3ccf-7206-4bdf-b974-5262917c42c5 req-d0c38d78-12a6-4ccd-b14a-ba96739d2692 service nova] Lock "9931204d-9ee0-4d48-bb71-e0f662979b30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:10:10 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-004f3ccf-7206-4bdf-b974-5262917c42c5 req-d0c38d78-12a6-4ccd-b14a-ba96739d2692 service nova] Lock "9931204d-9ee0-4d48-bb71-e0f662979b30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:10:10 user nova-compute[72773]: DEBUG nova.compute.manager [req-004f3ccf-7206-4bdf-b974-5262917c42c5 req-d0c38d78-12a6-4ccd-b14a-ba96739d2692 service nova] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] No waiting events found dispatching network-vif-plugged-26c7d845-5f32-4688-b819-1d59f3360c01 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:10:10 user nova-compute[72773]: WARNING nova.compute.manager [req-004f3ccf-7206-4bdf-b974-5262917c42c5 req-d0c38d78-12a6-4ccd-b14a-ba96739d2692 service nova] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Received unexpected event network-vif-plugged-26c7d845-5f32-4688-b819-1d59f3360c01 for instance with vm_state building and task_state spawning.
Aug 16 23:10:10 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:10:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:10:12 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692227412.1326659, 9931204d-9ee0-4d48-bb71-e0f662979b30 => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 23:10:12 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] VM Resumed (Lifecycle Event)
Aug 16 23:10:12 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 23:10:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 23:10:12 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Instance spawned successfully.
Aug 16 23:10:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 23:10:12 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 23:10:12 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 23:10:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 23:10:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 23:10:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 23:10:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 23:10:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 23:10:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 23:10:12 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 23:10:12 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692227412.1340358, 9931204d-9ee0-4d48-bb71-e0f662979b30 => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 23:10:12 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] VM Started (Lifecycle Event)
Aug 16 23:10:12 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 23:10:12 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 23:10:12 user nova-compute[72773]: INFO nova.compute.manager [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Took 4.80 seconds to spawn the instance on the hypervisor.
Aug 16 23:10:12 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 23:10:12 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 23:10:12 user nova-compute[72773]: INFO nova.compute.manager [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Took 15.59 seconds to build instance.
Aug 16 23:10:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-7c9ce923-e8b7-4ef2-813b-4cb36aa81b86 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "9931204d-9ee0-4d48-bb71-e0f662979b30" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.872s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:10:12 user nova-compute[72773]: DEBUG nova.compute.manager [req-c68dd8e6-55e3-46a7-929d-d0e4d5277a3c req-4b975a0c-fb16-41ae-ac3b-6b4d3174df80 service nova] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Received event network-vif-plugged-26c7d845-5f32-4688-b819-1d59f3360c01 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:10:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c68dd8e6-55e3-46a7-929d-d0e4d5277a3c req-4b975a0c-fb16-41ae-ac3b-6b4d3174df80 service nova] Acquiring lock "9931204d-9ee0-4d48-bb71-e0f662979b30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:10:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c68dd8e6-55e3-46a7-929d-d0e4d5277a3c req-4b975a0c-fb16-41ae-ac3b-6b4d3174df80 service nova] Lock "9931204d-9ee0-4d48-bb71-e0f662979b30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:10:12 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-c68dd8e6-55e3-46a7-929d-d0e4d5277a3c req-4b975a0c-fb16-41ae-ac3b-6b4d3174df80 service nova] Lock "9931204d-9ee0-4d48-bb71-e0f662979b30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:10:12 user nova-compute[72773]: DEBUG nova.compute.manager [req-c68dd8e6-55e3-46a7-929d-d0e4d5277a3c req-4b975a0c-fb16-41ae-ac3b-6b4d3174df80 service nova] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] No waiting events found dispatching network-vif-plugged-26c7d845-5f32-4688-b819-1d59f3360c01 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:10:12 user nova-compute[72773]: WARNING nova.compute.manager [req-c68dd8e6-55e3-46a7-929d-d0e4d5277a3c req-4b975a0c-fb16-41ae-ac3b-6b4d3174df80 service nova] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Received unexpected event network-vif-plugged-26c7d845-5f32-4688-b819-1d59f3360c01 for instance with vm_state active and task_state None.
Aug 16 23:10:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:10:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:10:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:10:19 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:10:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:10:23 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:10:23 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:10:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:10:24 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:10:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:10:26 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:10:26 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 23:10:26 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Rebuilding the list of instances to heal {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 23:10:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-c15d1875-ca6c-48f8-af1d-937bf498107e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:10:26 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-c15d1875-ca6c-48f8-af1d-937bf498107e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:10:26 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 23:10:26 user nova-compute[72773]: DEBUG nova.objects.instance [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lazy-loading 'info_cache' on Instance uuid c15d1875-ca6c-48f8-af1d-937bf498107e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:10:27 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Updating instance_info_cache with network_info: [{"id": "4330c4c7-b719-45fb-b7bf-05922b6d37f0", "address": "fa:16:3e:fd:5a:d6", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4330c4c7-b7", "ovs_interfaceid": "4330c4c7-b719-45fb-b7bf-05922b6d37f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:10:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-c15d1875-ca6c-48f8-af1d-937bf498107e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:10:27 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 23:10:27 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:10:28 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:10:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:10:30 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:10:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:10:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:10:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:10:30 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 23:10:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 23:10:30 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 23:10:30 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:10:30 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:10:30 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=8693MB free_disk=25.4019775390625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 23:10:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:10:30 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:10:30 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance c15d1875-ca6c-48f8-af1d-937bf498107e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 23:10:30 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 9931204d-9ee0-4d48-bb71-e0f662979b30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 23:10:30 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 23:10:30 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 23:10:31 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:10:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:10:31 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:10:31 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 23:10:31 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:10:32 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:10:32 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 23:10:32 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:10:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:10:36 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:10:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:10:41 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:10:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:10:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:10:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:10:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:10:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:10:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:10:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:10:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:10:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:10:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:11:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:11:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:11:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:11:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:11:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:11:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:11:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:11:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:11:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:11:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:11:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:11:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:11:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:11:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:11:19 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:11:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:11:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:11:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:11:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:11:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:11:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:11:25 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:11:25 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:11:27 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:11:27 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 23:11:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-9931204d-9ee0-4d48-bb71-e0f662979b30" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:11:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-9931204d-9ee0-4d48-bb71-e0f662979b30" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:11:27 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 23:11:27 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Updating instance_info_cache with network_info: [{"id": "26c7d845-5f32-4688-b819-1d59f3360c01", "address": "fa:16:3e:76:a2:b5", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c7d845-5f", "ovs_interfaceid": "26c7d845-5f32-4688-b819-1d59f3360c01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:11:27 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-9931204d-9ee0-4d48-bb71-e0f662979b30" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:11:27 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 23:11:28 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:11:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:11:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:11:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:11:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:11:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:11:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:11:29 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:11:32 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:11:32 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:11:32 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 23:11:32 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:11:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:11:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:11:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:11:32 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 23:11:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 23:11:32 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 23:11:32 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:11:32 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:11:32 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=8768MB free_disk=25.40134048461914GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 23:11:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:11:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:11:33 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance c15d1875-ca6c-48f8-af1d-937bf498107e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 23:11:33 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 9931204d-9ee0-4d48-bb71-e0f662979b30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 23:11:33 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 23:11:33 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 23:11:33 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Refreshing inventories for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 23:11:33 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Updating ProviderTree inventory for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 23:11:33 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Updating inventory in ProviderTree for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 23:11:33 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Refreshing aggregate associations for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e, aggregates: None {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 23:11:33 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Refreshing trait associations for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 23:11:33 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:11:33 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:11:33 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 23:11:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.494s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:11:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:11:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:11:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:11:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:11:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:11:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:11:38 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:11:38 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:11:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:11:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:11:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:11:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:11:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:11:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:11:40 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:11:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Cleaning up deleted instances with incomplete migration  {{(pid=72773) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 23:11:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:11:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:11:48 user nova-compute[72773]: DEBUG nova.compute.manager [req-9a031794-5706-4876-8974-735db4b303f3 req-e3e54f38-8c60-476a-a351-bde9d0b9a396 service nova] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Received event network-changed-26c7d845-5f32-4688-b819-1d59f3360c01 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:11:48 user nova-compute[72773]: DEBUG nova.compute.manager [req-9a031794-5706-4876-8974-735db4b303f3 req-e3e54f38-8c60-476a-a351-bde9d0b9a396 service nova] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Refreshing instance network info cache due to event network-changed-26c7d845-5f32-4688-b819-1d59f3360c01. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 23:11:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9a031794-5706-4876-8974-735db4b303f3 req-e3e54f38-8c60-476a-a351-bde9d0b9a396 service nova] Acquiring lock "refresh_cache-9931204d-9ee0-4d48-bb71-e0f662979b30" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:11:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9a031794-5706-4876-8974-735db4b303f3 req-e3e54f38-8c60-476a-a351-bde9d0b9a396 service nova] Acquired lock "refresh_cache-9931204d-9ee0-4d48-bb71-e0f662979b30" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:11:48 user nova-compute[72773]: DEBUG nova.network.neutron [req-9a031794-5706-4876-8974-735db4b303f3 req-e3e54f38-8c60-476a-a351-bde9d0b9a396 service nova] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Refreshing network info cache for port 26c7d845-5f32-4688-b819-1d59f3360c01 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 23:11:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:11:49 user nova-compute[72773]: DEBUG nova.network.neutron [req-9a031794-5706-4876-8974-735db4b303f3 req-e3e54f38-8c60-476a-a351-bde9d0b9a396 service nova] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Updated VIF entry in instance network info cache for port 26c7d845-5f32-4688-b819-1d59f3360c01. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 23:11:49 user nova-compute[72773]: DEBUG nova.network.neutron [req-9a031794-5706-4876-8974-735db4b303f3 req-e3e54f38-8c60-476a-a351-bde9d0b9a396 service nova] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Updating instance_info_cache with network_info: [{"id": "26c7d845-5f32-4688-b819-1d59f3360c01", "address": "fa:16:3e:76:a2:b5", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c7d845-5f", "ovs_interfaceid": "26c7d845-5f32-4688-b819-1d59f3360c01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:11:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-9a031794-5706-4876-8974-735db4b303f3 req-e3e54f38-8c60-476a-a351-bde9d0b9a396 service nova] Releasing lock "refresh_cache-9931204d-9ee0-4d48-bb71-e0f662979b30" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG nova.compute.manager [req-d9ce6c88-7f34-4c21-ba3f-e5780af60e3d req-66174142-580f-4dff-894f-43f05fe81cc8 service nova] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Received event network-changed-26c7d845-5f32-4688-b819-1d59f3360c01 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG nova.compute.manager [req-d9ce6c88-7f34-4c21-ba3f-e5780af60e3d req-66174142-580f-4dff-894f-43f05fe81cc8 service nova] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Refreshing instance network info cache due to event network-changed-26c7d845-5f32-4688-b819-1d59f3360c01. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d9ce6c88-7f34-4c21-ba3f-e5780af60e3d req-66174142-580f-4dff-894f-43f05fe81cc8 service nova] Acquiring lock "refresh_cache-9931204d-9ee0-4d48-bb71-e0f662979b30" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d9ce6c88-7f34-4c21-ba3f-e5780af60e3d req-66174142-580f-4dff-894f-43f05fe81cc8 service nova] Acquired lock "refresh_cache-9931204d-9ee0-4d48-bb71-e0f662979b30" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG nova.network.neutron [req-d9ce6c88-7f34-4c21-ba3f-e5780af60e3d req-66174142-580f-4dff-894f-43f05fe81cc8 service nova] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Refreshing network info cache for port 26c7d845-5f32-4688-b819-1d59f3360c01 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "9931204d-9ee0-4d48-bb71-e0f662979b30" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "9931204d-9ee0-4d48-bb71-e0f662979b30" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "9931204d-9ee0-4d48-bb71-e0f662979b30-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "9931204d-9ee0-4d48-bb71-e0f662979b30-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "9931204d-9ee0-4d48-bb71-e0f662979b30-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:11:51 user nova-compute[72773]: INFO nova.compute.manager [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Terminating instance
Aug 16 23:11:51 user nova-compute[72773]: DEBUG nova.compute.manager [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG nova.network.neutron [req-d9ce6c88-7f34-4c21-ba3f-e5780af60e3d req-66174142-580f-4dff-894f-43f05fe81cc8 service nova] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Updated VIF entry in instance network info cache for port 26c7d845-5f32-4688-b819-1d59f3360c01. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG nova.network.neutron [req-d9ce6c88-7f34-4c21-ba3f-e5780af60e3d req-66174142-580f-4dff-894f-43f05fe81cc8 service nova] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Updating instance_info_cache with network_info: [{"id": "26c7d845-5f32-4688-b819-1d59f3360c01", "address": "fa:16:3e:76:a2:b5", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c7d845-5f", "ovs_interfaceid": "26c7d845-5f32-4688-b819-1d59f3360c01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-d9ce6c88-7f34-4c21-ba3f-e5780af60e3d req-66174142-580f-4dff-894f-43f05fe81cc8 service nova] Releasing lock "refresh_cache-9931204d-9ee0-4d48-bb71-e0f662979b30" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG nova.compute.manager [req-0cc06969-0316-491a-b385-e2850a964306 req-ce059cc2-1fad-4b01-8443-f8704a92e295 service nova] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Received event network-vif-unplugged-26c7d845-5f32-4688-b819-1d59f3360c01 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0cc06969-0316-491a-b385-e2850a964306 req-ce059cc2-1fad-4b01-8443-f8704a92e295 service nova] Acquiring lock "9931204d-9ee0-4d48-bb71-e0f662979b30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0cc06969-0316-491a-b385-e2850a964306 req-ce059cc2-1fad-4b01-8443-f8704a92e295 service nova] Lock "9931204d-9ee0-4d48-bb71-e0f662979b30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0cc06969-0316-491a-b385-e2850a964306 req-ce059cc2-1fad-4b01-8443-f8704a92e295 service nova] Lock "9931204d-9ee0-4d48-bb71-e0f662979b30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG nova.compute.manager [req-0cc06969-0316-491a-b385-e2850a964306 req-ce059cc2-1fad-4b01-8443-f8704a92e295 service nova] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] No waiting events found dispatching network-vif-unplugged-26c7d845-5f32-4688-b819-1d59f3360c01 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG nova.compute.manager [req-0cc06969-0316-491a-b385-e2850a964306 req-ce059cc2-1fad-4b01-8443-f8704a92e295 service nova] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Received event network-vif-unplugged-26c7d845-5f32-4688-b819-1d59f3360c01 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 23:11:51 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Instance destroyed successfully.
Aug 16 23:11:51 user nova-compute[72773]: DEBUG nova.objects.instance [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lazy-loading 'resources' on Instance uuid 9931204d-9ee0-4d48-bb71-e0f662979b30 {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T23:09:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-133376122',display_name='tempest-TestVolumeBootPattern-server-133376122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-133376122',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL02+v69rOIm3d3DTbZyuQdTDm7FnOwFLT+9aenwjm8psvyRLcpRR7jJ6qjZ+VoOb17oLOwBBPT4Y5q77K4hElMopo/LfJNWLR3JbU03lfgxjehWHq1alQDpDMLvfTP4OA==',key_name='tempest-TestVolumeBootPattern-1277717100',keypairs=<?>,launch_index=0,launched_at=2023-08-16T23:10:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a51cd967e4254cfd9b8aee140f640682',ramdisk_id='',reservation_id='r-nzs4zhie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1862722655',owner_user_name='tempest-TestVolumeBootPattern-1862722655-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T23:10:12Z,user_data=None,user_id='3f12eb2e28904f63baa1ddce4641e180',uuid=9931204d-9ee0-4d48-bb71-e0f662979b30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26c7d845-5f32-4688-b819-1d59f3360c01", "address": "fa:16:3e:76:a2:b5", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c7d845-5f", "ovs_interfaceid": "26c7d845-5f32-4688-b819-1d59f3360c01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converting VIF {"id": "26c7d845-5f32-4688-b819-1d59f3360c01", "address": "fa:16:3e:76:a2:b5", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c7d845-5f", "ovs_interfaceid": "26c7d845-5f32-4688-b819-1d59f3360c01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:a2:b5,bridge_name='br-int',has_traffic_filtering=True,id=26c7d845-5f32-4688-b819-1d59f3360c01,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c7d845-5f') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG os_vif [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:a2:b5,bridge_name='br-int',has_traffic_filtering=True,id=26c7d845-5f32-4688-b819-1d59f3360c01,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c7d845-5f') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26c7d845-5f, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:11:51 user nova-compute[72773]: INFO os_vif [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:a2:b5,bridge_name='br-int',has_traffic_filtering=True,id=26c7d845-5f32-4688-b819-1d59f3360c01,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c7d845-5f')
Aug 16 23:11:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mwiyUBFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 23:11:51 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 23:11:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[48975593-a16d-449d-8a4a-012b90b0f2a3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:11:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd83253-db0f-4307-8ea6-5ea605eaf98b]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 (non-flash)
Aug 16 23:11:52 user nova-compute[72773]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f (non-flash)
Aug 16 23:11:52 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 (non-flash)
Aug 16 23:11:52 user nova-compute[72773]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f (non-flash)
Aug 16 23:11:52 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef5c587c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f'): ({'sdc'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Removing single pathed devices sdc {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b66e0e-5169-4ff9-b76f-8f81cc53529f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cb0abf-5deb-4f95-8114-812150d176c7]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Flushing IO for device /dev/sdc {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b73e83f-85f8-40c8-b3e9-8183ae363fe2]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8609ded-3809-49c8-845f-aa0f4b826b36]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] SCSI volumes sdc have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9617ab8c-04ea-4a8a-ac07-c8d8941e1bf5]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed76b1ab-75f4-48d3-a5f5-258ea6230557]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f, portal: 172.16.0.220,3260]
Aug 16 23:11:52 user nova-compute[72773]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f, portal: 172.16.0.220,3260] successful.
Aug 16 23:11:52 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd4d096a-3935-40a8-9164-032258a20a9f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ee1a9e-a4ff-4439-a106-c7241162fc77]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] <== disconnect_volume: return (295ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 23:11:52 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Deleting instance files /opt/stack/data/nova/instances/9931204d-9ee0-4d48-bb71-e0f662979b30_del
Aug 16 23:11:52 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Deletion of /opt/stack/data/nova/instances/9931204d-9ee0-4d48-bb71-e0f662979b30_del complete
Aug 16 23:11:52 user nova-compute[72773]: INFO nova.compute.manager [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 16 23:11:52 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 23:11:52 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:11:52 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Took 0.56 seconds to deallocate network for instance.
Aug 16 23:11:53 user nova-compute[72773]: DEBUG nova.compute.manager [req-a9247c08-c986-40a0-a331-d5aa94833bd3 req-9baf2816-1e6e-44e0-b571-88596002c692 service nova] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Received event network-vif-deleted-26c7d845-5f32-4688-b819-1d59f3360c01 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:11:53 user nova-compute[72773]: INFO nova.compute.manager [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Took 0.74 seconds to detach 1 volumes for instance.
Aug 16 23:11:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:11:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:11:53 user nova-compute[72773]: DEBUG nova.compute.manager [req-270e7fca-12c8-4ba7-ba20-525c157045ed req-b29e42c1-7d78-400b-8c6e-47df7dc68b7d service nova] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Received event network-vif-plugged-26c7d845-5f32-4688-b819-1d59f3360c01 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:11:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-270e7fca-12c8-4ba7-ba20-525c157045ed req-b29e42c1-7d78-400b-8c6e-47df7dc68b7d service nova] Acquiring lock "9931204d-9ee0-4d48-bb71-e0f662979b30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:11:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-270e7fca-12c8-4ba7-ba20-525c157045ed req-b29e42c1-7d78-400b-8c6e-47df7dc68b7d service nova] Lock "9931204d-9ee0-4d48-bb71-e0f662979b30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:11:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-270e7fca-12c8-4ba7-ba20-525c157045ed req-b29e42c1-7d78-400b-8c6e-47df7dc68b7d service nova] Lock "9931204d-9ee0-4d48-bb71-e0f662979b30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:11:53 user nova-compute[72773]: DEBUG nova.compute.manager [req-270e7fca-12c8-4ba7-ba20-525c157045ed req-b29e42c1-7d78-400b-8c6e-47df7dc68b7d service nova] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] No waiting events found dispatching network-vif-plugged-26c7d845-5f32-4688-b819-1d59f3360c01 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:11:53 user nova-compute[72773]: WARNING nova.compute.manager [req-270e7fca-12c8-4ba7-ba20-525c157045ed req-b29e42c1-7d78-400b-8c6e-47df7dc68b7d service nova] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Received unexpected event network-vif-plugged-26c7d845-5f32-4688-b819-1d59f3360c01 for instance with vm_state deleted and task_state None.
Aug 16 23:11:53 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:11:53 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:11:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:11:53 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Deleted allocations for instance 9931204d-9ee0-4d48-bb71-e0f662979b30
Aug 16 23:11:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-09e8ccfd-ba92-432a-b149-23e6f2ec0c44 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "9931204d-9ee0-4d48-bb71-e0f662979b30" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.802s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:11:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:11:58 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:11:58 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Cleaning up deleted instances {{(pid=72773) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 23:11:58 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] There are 0 instances to clean {{(pid=72773) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 23:12:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:12:06 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692227511.9049225, 9931204d-9ee0-4d48-bb71-e0f662979b30 => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 23:12:06 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] VM Stopped (Lifecycle Event)
Aug 16 23:12:06 user nova-compute[72773]: DEBUG nova.compute.manager [None req-7e479901-0ae8-4225-aa8f-9db7650bdf85 None None] [instance: 9931204d-9ee0-4d48-bb71-e0f662979b30] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 23:12:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:12:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:12:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:12:19 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_power_states {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:12:19 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Triggering sync for uuid c15d1875-ca6c-48f8-af1d-937bf498107e {{(pid=72773) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 23:12:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "c15d1875-ca6c-48f8-af1d-937bf498107e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:12:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "c15d1875-ca6c-48f8-af1d-937bf498107e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:12:19 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "c15d1875-ca6c-48f8-af1d-937bf498107e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:12:20 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:12:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:12:26 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:12:26 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:12:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:12:29 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:12:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 23:12:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Rebuilding the list of instances to heal {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 23:12:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-c15d1875-ca6c-48f8-af1d-937bf498107e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:12:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-c15d1875-ca6c-48f8-af1d-937bf498107e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:12:29 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 23:12:29 user nova-compute[72773]: DEBUG nova.objects.instance [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lazy-loading 'info_cache' on Instance uuid c15d1875-ca6c-48f8-af1d-937bf498107e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:12:29 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Updating instance_info_cache with network_info: [{"id": "4330c4c7-b719-45fb-b7bf-05922b6d37f0", "address": "fa:16:3e:fd:5a:d6", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4330c4c7-b7", "ovs_interfaceid": "4330c4c7-b719-45fb-b7bf-05922b6d37f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:12:29 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-c15d1875-ca6c-48f8-af1d-937bf498107e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:12:29 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 23:12:29 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:12:29 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:12:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:12:33 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:12:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 23:12:33 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:12:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:12:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:12:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:12:33 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 23:12:33 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 23:12:33 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:12:33 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:12:33 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=8851MB free_disk=25.400432586669922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 23:12:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:12:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:12:33 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance c15d1875-ca6c-48f8-af1d-937bf498107e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 23:12:33 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 23:12:33 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 23:12:34 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:12:34 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:12:34 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 23:12:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:12:35 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:12:36 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:12:41 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:12:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:12:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:12:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:13:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:13:01 user nova-compute[72773]: DEBUG nova.compute.manager [req-a760e3bb-8c0e-47c9-9fe7-0bcd6b6e8832 req-19ed15cb-5461-4342-a800-300a8c9c0a1f service nova] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Received event network-changed-4330c4c7-b719-45fb-b7bf-05922b6d37f0 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:13:01 user nova-compute[72773]: DEBUG nova.compute.manager [req-a760e3bb-8c0e-47c9-9fe7-0bcd6b6e8832 req-19ed15cb-5461-4342-a800-300a8c9c0a1f service nova] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Refreshing instance network info cache due to event network-changed-4330c4c7-b719-45fb-b7bf-05922b6d37f0. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 23:13:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a760e3bb-8c0e-47c9-9fe7-0bcd6b6e8832 req-19ed15cb-5461-4342-a800-300a8c9c0a1f service nova] Acquiring lock "refresh_cache-c15d1875-ca6c-48f8-af1d-937bf498107e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:13:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a760e3bb-8c0e-47c9-9fe7-0bcd6b6e8832 req-19ed15cb-5461-4342-a800-300a8c9c0a1f service nova] Acquired lock "refresh_cache-c15d1875-ca6c-48f8-af1d-937bf498107e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:13:01 user nova-compute[72773]: DEBUG nova.network.neutron [req-a760e3bb-8c0e-47c9-9fe7-0bcd6b6e8832 req-19ed15cb-5461-4342-a800-300a8c9c0a1f service nova] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Refreshing network info cache for port 4330c4c7-b719-45fb-b7bf-05922b6d37f0 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 23:13:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "c15d1875-ca6c-48f8-af1d-937bf498107e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:13:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "c15d1875-ca6c-48f8-af1d-937bf498107e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:13:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "c15d1875-ca6c-48f8-af1d-937bf498107e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:13:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "c15d1875-ca6c-48f8-af1d-937bf498107e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:13:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "c15d1875-ca6c-48f8-af1d-937bf498107e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:13:01 user nova-compute[72773]: INFO nova.compute.manager [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Terminating instance
Aug 16 23:13:01 user nova-compute[72773]: DEBUG nova.compute.manager [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 23:13:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:13:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:13:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:13:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:13:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG nova.compute.manager [req-4d6319f2-4291-45c9-afd5-7e4364fa492b req-bc4ffceb-6320-43e5-97da-fafe0ae38c42 service nova] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Received event network-vif-unplugged-4330c4c7-b719-45fb-b7bf-05922b6d37f0 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4d6319f2-4291-45c9-afd5-7e4364fa492b req-bc4ffceb-6320-43e5-97da-fafe0ae38c42 service nova] Acquiring lock "c15d1875-ca6c-48f8-af1d-937bf498107e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4d6319f2-4291-45c9-afd5-7e4364fa492b req-bc4ffceb-6320-43e5-97da-fafe0ae38c42 service nova] Lock "c15d1875-ca6c-48f8-af1d-937bf498107e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4d6319f2-4291-45c9-afd5-7e4364fa492b req-bc4ffceb-6320-43e5-97da-fafe0ae38c42 service nova] Lock "c15d1875-ca6c-48f8-af1d-937bf498107e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG nova.compute.manager [req-4d6319f2-4291-45c9-afd5-7e4364fa492b req-bc4ffceb-6320-43e5-97da-fafe0ae38c42 service nova] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] No waiting events found dispatching network-vif-unplugged-4330c4c7-b719-45fb-b7bf-05922b6d37f0 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG nova.compute.manager [req-4d6319f2-4291-45c9-afd5-7e4364fa492b req-bc4ffceb-6320-43e5-97da-fafe0ae38c42 service nova] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Received event network-vif-unplugged-4330c4c7-b719-45fb-b7bf-05922b6d37f0 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG nova.network.neutron [req-a760e3bb-8c0e-47c9-9fe7-0bcd6b6e8832 req-19ed15cb-5461-4342-a800-300a8c9c0a1f service nova] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Updated VIF entry in instance network info cache for port 4330c4c7-b719-45fb-b7bf-05922b6d37f0. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG nova.network.neutron [req-a760e3bb-8c0e-47c9-9fe7-0bcd6b6e8832 req-19ed15cb-5461-4342-a800-300a8c9c0a1f service nova] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Updating instance_info_cache with network_info: [{"id": "4330c4c7-b719-45fb-b7bf-05922b6d37f0", "address": "fa:16:3e:fd:5a:d6", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4330c4c7-b7", "ovs_interfaceid": "4330c4c7-b719-45fb-b7bf-05922b6d37f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a760e3bb-8c0e-47c9-9fe7-0bcd6b6e8832 req-19ed15cb-5461-4342-a800-300a8c9c0a1f service nova] Releasing lock "refresh_cache-c15d1875-ca6c-48f8-af1d-937bf498107e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:13:02 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Instance destroyed successfully.
Aug 16 23:13:02 user nova-compute[72773]: DEBUG nova.objects.instance [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lazy-loading 'resources' on Instance uuid c15d1875-ca6c-48f8-af1d-937bf498107e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T23:07:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-427935291',display_name='tempest-TestVolumeBootPattern-server-427935291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-427935291',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL02+v69rOIm3d3DTbZyuQdTDm7FnOwFLT+9aenwjm8psvyRLcpRR7jJ6qjZ+VoOb17oLOwBBPT4Y5q77K4hElMopo/LfJNWLR3JbU03lfgxjehWHq1alQDpDMLvfTP4OA==',key_name='tempest-TestVolumeBootPattern-1277717100',keypairs=<?>,launch_index=0,launched_at=2023-08-16T23:08:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a51cd967e4254cfd9b8aee140f640682',ramdisk_id='',reservation_id='r-k7eiisds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1862722655',owner_user_name='tempest-TestVolumeBootPattern-1862722655-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T23:08:07Z,user_data=None,user_id='3f12eb2e28904f63baa1ddce4641e180',uuid=c15d1875-ca6c-48f8-af1d-937bf498107e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4330c4c7-b719-45fb-b7bf-05922b6d37f0", "address": "fa:16:3e:fd:5a:d6", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4330c4c7-b7", "ovs_interfaceid": "4330c4c7-b719-45fb-b7bf-05922b6d37f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converting VIF {"id": "4330c4c7-b719-45fb-b7bf-05922b6d37f0", "address": "fa:16:3e:fd:5a:d6", "network": {"id": "78e0228c-b13d-45c5-880f-599c5190b0d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-172211804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a51cd967e4254cfd9b8aee140f640682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4330c4c7-b7", "ovs_interfaceid": "4330c4c7-b719-45fb-b7bf-05922b6d37f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:5a:d6,bridge_name='br-int',has_traffic_filtering=True,id=4330c4c7-b719-45fb-b7bf-05922b6d37f0,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4330c4c7-b7') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG os_vif [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:5a:d6,bridge_name='br-int',has_traffic_filtering=True,id=4330c4c7-b719-45fb-b7bf-05922b6d37f0,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4330c4c7-b7') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4330c4c7-b7, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:13:02 user nova-compute[72773]: INFO os_vif [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:5a:d6,bridge_name='br-int',has_traffic_filtering=True,id=4330c4c7-b719-45fb-b7bf-05922b6d37f0,network=Network(78e0228c-b13d-45c5-880f-599c5190b0d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4330c4c7-b7')
Aug 16 23:13:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JrAZRElQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 23:13:02 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 23:13:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff93ece-6a96-4065-9dff-1e20a77271bd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[335d345e-d7a8-411a-8003-25e5c30b45d9]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 (non-flash)
Aug 16 23:13:02 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 (non-flash)
Aug 16 23:13:02 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef5c252050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640'): ({'sdb'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Removing single pathed devices sdb {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca87b1c-2d08-4cbb-a0b1-0a9ec4e8e0b5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[fceb3447-277b-46fc-9908-9a042f909f04]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Flushing IO for device /dev/sdb {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65d0475-3f11-45af-b083-aca8c3d764e1]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68393d3-b29e-4b0f-a37a-1b79fe4dbb1f]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] SCSI volumes sdb have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26435636331613166', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e93e98d1', '/dev/disk/by-id/scsi-1SCST_BIOe93e98d1-d5cc1a1fd584b8cf') {{(pid=83955) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cb3e11-1c68-4682-9706-2ba72bc85826]: (4, None) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb68cce-eff2-495f-97c9-a29575f9c5ab]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2db1d0-781d-43d5-b0ba-bef0ea2d6564]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640, portal: 172.16.0.220,3260]
Aug 16 23:13:02 user nova-compute[72773]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640, portal: 172.16.0.220,3260] successful.
Aug 16 23:13:02 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ac9c546-e347-4191-8fdc-6c30f8bba640 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ae6bc6-8d80-4fd9-b775-230566c7c44f]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] <== disconnect_volume: return (265ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 23:13:02 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Deleting instance files /opt/stack/data/nova/instances/c15d1875-ca6c-48f8-af1d-937bf498107e_del
Aug 16 23:13:02 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Deletion of /opt/stack/data/nova/instances/c15d1875-ca6c-48f8-af1d-937bf498107e_del complete
Aug 16 23:13:02 user nova-compute[72773]: INFO nova.compute.manager [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 16 23:13:02 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 23:13:02 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 23:13:03 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:13:03 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Took 0.81 seconds to deallocate network for instance.
Aug 16 23:13:03 user nova-compute[72773]: DEBUG nova.compute.manager [req-0eecceac-5de3-4e2c-986c-119cc1e6d5d8 req-0390d3a0-aebc-40b4-95d4-fba16132f1f6 service nova] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Received event network-vif-deleted-4330c4c7-b719-45fb-b7bf-05922b6d37f0 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:13:04 user nova-compute[72773]: DEBUG nova.compute.manager [req-a7c1c737-12ae-4a53-b5d3-f0a494943d5b req-9deb5290-fee6-4470-bbee-5ff66db942b4 service nova] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Received event network-vif-plugged-4330c4c7-b719-45fb-b7bf-05922b6d37f0 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:13:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a7c1c737-12ae-4a53-b5d3-f0a494943d5b req-9deb5290-fee6-4470-bbee-5ff66db942b4 service nova] Acquiring lock "c15d1875-ca6c-48f8-af1d-937bf498107e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:13:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a7c1c737-12ae-4a53-b5d3-f0a494943d5b req-9deb5290-fee6-4470-bbee-5ff66db942b4 service nova] Lock "c15d1875-ca6c-48f8-af1d-937bf498107e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:13:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-a7c1c737-12ae-4a53-b5d3-f0a494943d5b req-9deb5290-fee6-4470-bbee-5ff66db942b4 service nova] Lock "c15d1875-ca6c-48f8-af1d-937bf498107e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:13:04 user nova-compute[72773]: DEBUG nova.compute.manager [req-a7c1c737-12ae-4a53-b5d3-f0a494943d5b req-9deb5290-fee6-4470-bbee-5ff66db942b4 service nova] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] No waiting events found dispatching network-vif-plugged-4330c4c7-b719-45fb-b7bf-05922b6d37f0 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:13:04 user nova-compute[72773]: WARNING nova.compute.manager [req-a7c1c737-12ae-4a53-b5d3-f0a494943d5b req-9deb5290-fee6-4470-bbee-5ff66db942b4 service nova] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Received unexpected event network-vif-plugged-4330c4c7-b719-45fb-b7bf-05922b6d37f0 for instance with vm_state active and task_state deleting.
Aug 16 23:13:04 user nova-compute[72773]: INFO nova.compute.manager [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Took 0.78 seconds to detach 1 volumes for instance.
Aug 16 23:13:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:13:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:13:04 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:13:04 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:13:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.112s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:13:04 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Deleted allocations for instance c15d1875-ca6c-48f8-af1d-937bf498107e
Aug 16 23:13:04 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-4742079d-7005-42c7-9ca0-26407e46d3a4 tempest-TestVolumeBootPattern-1862722655 tempest-TestVolumeBootPattern-1862722655-project-member] Lock "c15d1875-ca6c-48f8-af1d-937bf498107e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.990s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:13:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:13:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:13:17 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692227582.60843, c15d1875-ca6c-48f8-af1d-937bf498107e => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 23:13:17 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] VM Stopped (Lifecycle Event)
Aug 16 23:13:17 user nova-compute[72773]: DEBUG nova.compute.manager [None req-d8adf97c-d984-4f9f-952c-e29eb3d2598e None None] [instance: c15d1875-ca6c-48f8-af1d-937bf498107e] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 23:13:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:13:21 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:13:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:13:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:13:28 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:13:28 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:13:29 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:13:30 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:13:30 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 23:13:30 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Rebuilding the list of instances to heal {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 23:13:30 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Didn't find any instances for network info cache update. {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 23:13:30 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:13:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:13:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:13:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:13:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:13:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:13:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:13:33 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:13:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:13:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:13:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:13:33 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 23:13:33 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:13:33 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:13:33 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=8973MB free_disk=25.399497985839844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 23:13:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:13:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:13:33 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 23:13:33 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 23:13:33 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:13:33 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:13:33 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 23:13:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:13:35 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:13:35 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:13:35 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 23:13:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:13:42 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:13:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:13:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:13:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:13:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:13:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:13:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:13:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:13:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:13:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:14:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:14:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:14:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:14:06 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:14:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:14:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:14:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:14:22 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:14:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:14:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:14:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:14:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:14:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:14:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:14:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:14:28 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:14:29 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:14:30 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:14:30 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 23:14:30 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Rebuilding the list of instances to heal {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 23:14:30 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Didn't find any instances for network info cache update. {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 23:14:30 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:14:31 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:14:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:14:34 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:14:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:14:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:14:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:14:34 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 23:14:35 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:14:35 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:14:35 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=8690MB free_disk=25.388202667236328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 23:14:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:14:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:14:35 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 23:14:35 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 23:14:35 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:14:35 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:14:35 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 23:14:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.129s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:14:35 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:14:37 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:14:37 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:14:37 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 23:14:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:14:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:14:41 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:14:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:14:44 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:14:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:14:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:14:49 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:14:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:14:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:14:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Acquiring lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:14:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:14:54 user nova-compute[72773]: DEBUG nova.compute.manager [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Starting instance... {{(pid=72773) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 23:14:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:14:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:14:54 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72773) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 23:14:54 user nova-compute[72773]: INFO nova.compute.claims [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Claim successful on node user
Aug 16 23:14:54 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:14:54 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:14:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.228s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:14:54 user nova-compute[72773]: DEBUG nova.compute.manager [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Start building networks asynchronously for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 23:14:54 user nova-compute[72773]: DEBUG nova.compute.manager [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Allocating IP information in the background. {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 23:14:54 user nova-compute[72773]: DEBUG nova.network.neutron [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] allocate_for_instance() {{(pid=72773) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 23:14:54 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 23:14:54 user nova-compute[72773]: DEBUG nova.compute.manager [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Start building block device mappings for instance. {{(pid=72773) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 23:14:54 user nova-compute[72773]: DEBUG nova.policy [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '62cdc961403d4bdba1d7fbebb42d4d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872cd11021f14ff7a9e68ee019da97f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72773) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 23:14:54 user nova-compute[72773]: DEBUG nova.compute.manager [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Start spawning the instance on the hypervisor. {{(pid=72773) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 23:14:54 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Creating instance directory {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 23:14:54 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Creating image(s)
Aug 16 23:14:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Acquiring lock "/opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:14:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "/opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:14:54 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "/opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:14:54 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:14:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.238s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:14:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Acquiring lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:14:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:14:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:14:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.193s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:14:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk 1073741824 {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:14:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380,backing_fmt=raw /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk 1073741824" returned: 0 in 0.055s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:14:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "6ad38a6a82b9cbce5b3574e4afc64fd87581d380" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:14:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:14:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ad38a6a82b9cbce5b3574e4afc64fd87581d380 --force-share --output=json" returned: 0 in 0.194s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:14:55 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Checking if we can resize image /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk. size=1073741824 {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 23:14:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:14:55 user nova-compute[72773]: DEBUG nova.network.neutron [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Successfully created port: e1d7f8c2-be99-47fa-9444-31186eebe7d2 {{(pid=72773) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 23:14:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:14:55 user nova-compute[72773]: DEBUG nova.virt.disk.api [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Cannot resize image /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk to a smaller size. {{(pid=72773) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 23:14:55 user nova-compute[72773]: DEBUG nova.objects.instance [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lazy-loading 'migration_context' on Instance uuid 403e2d11-98ae-48e4-b7be-fc15c28e863e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:14:55 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Created local disks {{(pid=72773) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 23:14:55 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Ensure instance console log exists: /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/console.log {{(pid=72773) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 23:14:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:14:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:14:55 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:14:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:14:56 user nova-compute[72773]: DEBUG nova.network.neutron [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Successfully updated port: e1d7f8c2-be99-47fa-9444-31186eebe7d2 {{(pid=72773) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 23:14:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Acquiring lock "refresh_cache-403e2d11-98ae-48e4-b7be-fc15c28e863e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:14:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Acquired lock "refresh_cache-403e2d11-98ae-48e4-b7be-fc15c28e863e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:14:56 user nova-compute[72773]: DEBUG nova.network.neutron [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Building network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 23:14:56 user nova-compute[72773]: DEBUG nova.compute.manager [req-0c7c724f-e193-44a4-b8d0-4096eb541524 req-4ffcd6bf-3c41-40f2-901c-32a2768626c9 service nova] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Received event network-changed-e1d7f8c2-be99-47fa-9444-31186eebe7d2 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:14:56 user nova-compute[72773]: DEBUG nova.compute.manager [req-0c7c724f-e193-44a4-b8d0-4096eb541524 req-4ffcd6bf-3c41-40f2-901c-32a2768626c9 service nova] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Refreshing instance network info cache due to event network-changed-e1d7f8c2-be99-47fa-9444-31186eebe7d2. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 23:14:56 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0c7c724f-e193-44a4-b8d0-4096eb541524 req-4ffcd6bf-3c41-40f2-901c-32a2768626c9 service nova] Acquiring lock "refresh_cache-403e2d11-98ae-48e4-b7be-fc15c28e863e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:14:56 user nova-compute[72773]: DEBUG nova.network.neutron [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Instance cache missing network info. {{(pid=72773) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG nova.network.neutron [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Updating instance_info_cache with network_info: [{"id": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "address": "fa:16:3e:64:14:98", "network": {"id": "a81d5927-b817-4702-9d46-66e63046290b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-436011694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872cd11021f14ff7a9e68ee019da97f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d7f8c2-be", "ovs_interfaceid": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Releasing lock "refresh_cache-403e2d11-98ae-48e4-b7be-fc15c28e863e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG nova.compute.manager [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Instance network_info: |[{"id": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "address": "fa:16:3e:64:14:98", "network": {"id": "a81d5927-b817-4702-9d46-66e63046290b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-436011694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872cd11021f14ff7a9e68ee019da97f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d7f8c2-be", "ovs_interfaceid": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72773) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0c7c724f-e193-44a4-b8d0-4096eb541524 req-4ffcd6bf-3c41-40f2-901c-32a2768626c9 service nova] Acquired lock "refresh_cache-403e2d11-98ae-48e4-b7be-fc15c28e863e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG nova.network.neutron [req-0c7c724f-e193-44a4-b8d0-4096eb541524 req-4ffcd6bf-3c41-40f2-901c-32a2768626c9 service nova] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Refreshing network info cache for port e1d7f8c2-be99-47fa-9444-31186eebe7d2 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Start _get_guest_xml network_info=[{"id": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "address": "fa:16:3e:64:14:98", "network": {"id": "a81d5927-b817-4702-9d46-66e63046290b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-436011694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872cd11021f14ff7a9e68ee019da97f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d7f8c2-be", "ovs_interfaceid": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '370c21db-2a77-45c9-b1ac-4447fbc4f414'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 23:14:57 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:14:57 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:14:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] CPU controller missing on host. {{(pid=72773) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.host [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] CPU controller found on host. {{(pid=72773) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72773) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T22:20:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T22:21:10Z,direct_url=<?>,disk_format='qcow2',id=370c21db-2a77-45c9-b1ac-4447fbc4f414,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='271c18b5b5f546819051ae850473f6b8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T22:21:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Flavor limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Image limits 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Flavor pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Image pref 0:0:0 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Got 1 possible topologies {{(pid=72773) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG nova.virt.hardware [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72773) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T23:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-244184505',display_name='tempest-SnapshotDataIntegrityTests-server-244184505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-244184505',id=53,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxBK1MHTT8x74wNXck1X3F9Lv5xl1kOqRlWHRkM0kVSQFRG4z8h+IMk7YRByB8/DLUp94XTuWIo5HRr2QdPzC85ow/1AR7pA3gqmS4vXiNNz4Jmz5Y/KOd+0tPLhXqsHg==',key_name='tempest-keypair-333796332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='872cd11021f14ff7a9e68ee019da97f4',ramdisk_id='',reservation_id='r-pn7j9z4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-223046460',owner_user_name='tempest-SnapshotDataIntegrityTests-223046460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T23:14:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62cdc961403d4bdba1d7fbebb42d4d88',uuid=403e2d11-98ae-48e4-b7be-fc15c28e863e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "address": "fa:16:3e:64:14:98", "network": {"id": "a81d5927-b817-4702-9d46-66e63046290b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-436011694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872cd11021f14ff7a9e68ee019da97f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d7f8c2-be", "ovs_interfaceid": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72773) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Converting VIF {"id": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "address": "fa:16:3e:64:14:98", "network": {"id": "a81d5927-b817-4702-9d46-66e63046290b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-436011694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872cd11021f14ff7a9e68ee019da97f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d7f8c2-be", "ovs_interfaceid": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:14:98,bridge_name='br-int',has_traffic_filtering=True,id=e1d7f8c2-be99-47fa-9444-31186eebe7d2,network=Network(a81d5927-b817-4702-9d46-66e63046290b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d7f8c2-be') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG nova.objects.instance [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lazy-loading 'pci_devices' on Instance uuid 403e2d11-98ae-48e4-b7be-fc15c28e863e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] End _get_guest_xml xml=<domain type="kvm">
Aug 16 23:14:57 user nova-compute[72773]:   <uuid>403e2d11-98ae-48e4-b7be-fc15c28e863e</uuid>
Aug 16 23:14:57 user nova-compute[72773]:   <name>instance-00000035</name>
Aug 16 23:14:57 user nova-compute[72773]:   <memory>524288</memory>
Aug 16 23:14:57 user nova-compute[72773]:   <vcpu>1</vcpu>
Aug 16 23:14:57 user nova-compute[72773]:   <metadata>
Aug 16 23:14:57 user nova-compute[72773]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 23:14:57 user nova-compute[72773]:       <nova:package version="0.0.0"/>
Aug 16 23:14:57 user nova-compute[72773]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-244184505</nova:name>
Aug 16 23:14:57 user nova-compute[72773]:       <nova:creationTime>2023-08-16 23:14:57</nova:creationTime>
Aug 16 23:14:57 user nova-compute[72773]:       <nova:flavor name="m1.tiny">
Aug 16 23:14:57 user nova-compute[72773]:         <nova:memory>512</nova:memory>
Aug 16 23:14:57 user nova-compute[72773]:         <nova:disk>1</nova:disk>
Aug 16 23:14:57 user nova-compute[72773]:         <nova:swap>0</nova:swap>
Aug 16 23:14:57 user nova-compute[72773]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 23:14:57 user nova-compute[72773]:         <nova:vcpus>1</nova:vcpus>
Aug 16 23:14:57 user nova-compute[72773]:       </nova:flavor>
Aug 16 23:14:57 user nova-compute[72773]:       <nova:owner>
Aug 16 23:14:57 user nova-compute[72773]:         <nova:user uuid="62cdc961403d4bdba1d7fbebb42d4d88">tempest-SnapshotDataIntegrityTests-223046460-project-member</nova:user>
Aug 16 23:14:57 user nova-compute[72773]:         <nova:project uuid="872cd11021f14ff7a9e68ee019da97f4">tempest-SnapshotDataIntegrityTests-223046460</nova:project>
Aug 16 23:14:57 user nova-compute[72773]:       </nova:owner>
Aug 16 23:14:57 user nova-compute[72773]:       <nova:root type="image" uuid="370c21db-2a77-45c9-b1ac-4447fbc4f414"/>
Aug 16 23:14:57 user nova-compute[72773]:       <nova:ports>
Aug 16 23:14:57 user nova-compute[72773]:         <nova:port uuid="e1d7f8c2-be99-47fa-9444-31186eebe7d2">
Aug 16 23:14:57 user nova-compute[72773]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 23:14:57 user nova-compute[72773]:         </nova:port>
Aug 16 23:14:57 user nova-compute[72773]:       </nova:ports>
Aug 16 23:14:57 user nova-compute[72773]:     </nova:instance>
Aug 16 23:14:57 user nova-compute[72773]:   </metadata>
Aug 16 23:14:57 user nova-compute[72773]:   <sysinfo type="smbios">
Aug 16 23:14:57 user nova-compute[72773]:     <system>
Aug 16 23:14:57 user nova-compute[72773]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 23:14:57 user nova-compute[72773]:       <entry name="product">OpenStack Nova</entry>
Aug 16 23:14:57 user nova-compute[72773]:       <entry name="version">0.0.0</entry>
Aug 16 23:14:57 user nova-compute[72773]:       <entry name="serial">403e2d11-98ae-48e4-b7be-fc15c28e863e</entry>
Aug 16 23:14:57 user nova-compute[72773]:       <entry name="uuid">403e2d11-98ae-48e4-b7be-fc15c28e863e</entry>
Aug 16 23:14:57 user nova-compute[72773]:       <entry name="family">Virtual Machine</entry>
Aug 16 23:14:57 user nova-compute[72773]:     </system>
Aug 16 23:14:57 user nova-compute[72773]:   </sysinfo>
Aug 16 23:14:57 user nova-compute[72773]:   <os>
Aug 16 23:14:57 user nova-compute[72773]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 23:14:57 user nova-compute[72773]:     <boot dev="hd"/>
Aug 16 23:14:57 user nova-compute[72773]:     <smbios mode="sysinfo"/>
Aug 16 23:14:57 user nova-compute[72773]:   </os>
Aug 16 23:14:57 user nova-compute[72773]:   <features>
Aug 16 23:14:57 user nova-compute[72773]:     <acpi/>
Aug 16 23:14:57 user nova-compute[72773]:     <apic/>
Aug 16 23:14:57 user nova-compute[72773]:     <vmcoreinfo/>
Aug 16 23:14:57 user nova-compute[72773]:   </features>
Aug 16 23:14:57 user nova-compute[72773]:   <clock offset="utc">
Aug 16 23:14:57 user nova-compute[72773]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 23:14:57 user nova-compute[72773]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 23:14:57 user nova-compute[72773]:     <timer name="hpet" present="no"/>
Aug 16 23:14:57 user nova-compute[72773]:   </clock>
Aug 16 23:14:57 user nova-compute[72773]:   <cpu mode="custom" match="exact">
Aug 16 23:14:57 user nova-compute[72773]:     <model>Nehalem</model>
Aug 16 23:14:57 user nova-compute[72773]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 23:14:57 user nova-compute[72773]:   </cpu>
Aug 16 23:14:57 user nova-compute[72773]:   <devices>
Aug 16 23:14:57 user nova-compute[72773]:     <disk type="file" device="disk">
Aug 16 23:14:57 user nova-compute[72773]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 23:14:57 user nova-compute[72773]:       <source file="/opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk"/>
Aug 16 23:14:57 user nova-compute[72773]:       <target dev="vda" bus="virtio"/>
Aug 16 23:14:57 user nova-compute[72773]:     </disk>
Aug 16 23:14:57 user nova-compute[72773]:     <interface type="ethernet">
Aug 16 23:14:57 user nova-compute[72773]:       <mac address="fa:16:3e:64:14:98"/>
Aug 16 23:14:57 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 23:14:57 user nova-compute[72773]:       <mtu size="1442"/>
Aug 16 23:14:57 user nova-compute[72773]:       <target dev="tape1d7f8c2-be"/>
Aug 16 23:14:57 user nova-compute[72773]:     </interface>
Aug 16 23:14:57 user nova-compute[72773]:     <serial type="pty">
Aug 16 23:14:57 user nova-compute[72773]:       <log file="/opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/console.log" append="off"/>
Aug 16 23:14:57 user nova-compute[72773]:     </serial>
Aug 16 23:14:57 user nova-compute[72773]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 23:14:57 user nova-compute[72773]:     <video>
Aug 16 23:14:57 user nova-compute[72773]:       <model type="virtio"/>
Aug 16 23:14:57 user nova-compute[72773]:     </video>
Aug 16 23:14:57 user nova-compute[72773]:     <rng model="virtio">
Aug 16 23:14:57 user nova-compute[72773]:       <backend model="random">/dev/urandom</backend>
Aug 16 23:14:57 user nova-compute[72773]:     </rng>
Aug 16 23:14:57 user nova-compute[72773]:     <controller type="usb" index="0" model="none"/>
Aug 16 23:14:57 user nova-compute[72773]:     <memballoon model="virtio">
Aug 16 23:14:57 user nova-compute[72773]:       <stats period="10"/>
Aug 16 23:14:57 user nova-compute[72773]:     </memballoon>
Aug 16 23:14:57 user nova-compute[72773]:   </devices>
Aug 16 23:14:57 user nova-compute[72773]: </domain>
Aug 16 23:14:57 user nova-compute[72773]:  {{(pid=72773) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T23:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-244184505',display_name='tempest-SnapshotDataIntegrityTests-server-244184505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-244184505',id=53,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxBK1MHTT8x74wNXck1X3F9Lv5xl1kOqRlWHRkM0kVSQFRG4z8h+IMk7YRByB8/DLUp94XTuWIo5HRr2QdPzC85ow/1AR7pA3gqmS4vXiNNz4Jmz5Y/KOd+0tPLhXqsHg==',key_name='tempest-keypair-333796332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='872cd11021f14ff7a9e68ee019da97f4',ramdisk_id='',reservation_id='r-pn7j9z4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-223046460',owner_user_name='tempest-SnapshotDataIntegrityTests-223046460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T23:14:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62cdc961403d4bdba1d7fbebb42d4d88',uuid=403e2d11-98ae-48e4-b7be-fc15c28e863e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "address": "fa:16:3e:64:14:98", "network": {"id": "a81d5927-b817-4702-9d46-66e63046290b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-436011694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872cd11021f14ff7a9e68ee019da97f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d7f8c2-be", "ovs_interfaceid": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Converting VIF {"id": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "address": "fa:16:3e:64:14:98", "network": {"id": "a81d5927-b817-4702-9d46-66e63046290b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-436011694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872cd11021f14ff7a9e68ee019da97f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d7f8c2-be", "ovs_interfaceid": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:14:98,bridge_name='br-int',has_traffic_filtering=True,id=e1d7f8c2-be99-47fa-9444-31186eebe7d2,network=Network(a81d5927-b817-4702-9d46-66e63046290b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d7f8c2-be') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG os_vif [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:14:98,bridge_name='br-int',has_traffic_filtering=True,id=e1d7f8c2-be99-47fa-9444-31186eebe7d2,network=Network(a81d5927-b817-4702-9d46-66e63046290b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d7f8c2-be') {{(pid=72773) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1d7f8c2-be, may_exist=True, interface_attrs={}) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape1d7f8c2-be, col_values=(('external_ids', {'iface-id': 'e1d7f8c2-be99-47fa-9444-31186eebe7d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:14:98', 'vm-uuid': '403e2d11-98ae-48e4-b7be-fc15c28e863e'}),), if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:14:57 user nova-compute[72773]: INFO os_vif [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:14:98,bridge_name='br-int',has_traffic_filtering=True,id=e1d7f8c2-be99-47fa-9444-31186eebe7d2,network=Network(a81d5927-b817-4702-9d46-66e63046290b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d7f8c2-be')
Aug 16 23:14:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] No VIF found with MAC fa:16:3e:64:14:98, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG nova.network.neutron [req-0c7c724f-e193-44a4-b8d0-4096eb541524 req-4ffcd6bf-3c41-40f2-901c-32a2768626c9 service nova] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Updated VIF entry in instance network info cache for port e1d7f8c2-be99-47fa-9444-31186eebe7d2. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG nova.network.neutron [req-0c7c724f-e193-44a4-b8d0-4096eb541524 req-4ffcd6bf-3c41-40f2-901c-32a2768626c9 service nova] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Updating instance_info_cache with network_info: [{"id": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "address": "fa:16:3e:64:14:98", "network": {"id": "a81d5927-b817-4702-9d46-66e63046290b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-436011694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872cd11021f14ff7a9e68ee019da97f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d7f8c2-be", "ovs_interfaceid": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:14:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-0c7c724f-e193-44a4-b8d0-4096eb541524 req-4ffcd6bf-3c41-40f2-901c-32a2768626c9 service nova] Releasing lock "refresh_cache-403e2d11-98ae-48e4-b7be-fc15c28e863e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:14:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:14:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:14:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:14:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-85930b83-c882-45b8-a396-b28dc6b68fc6 req-3a56367e-fac2-4725-82ae-1d00ca0f2848 service nova] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Received event network-vif-plugged-e1d7f8c2-be99-47fa-9444-31186eebe7d2 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:14:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-85930b83-c882-45b8-a396-b28dc6b68fc6 req-3a56367e-fac2-4725-82ae-1d00ca0f2848 service nova] Acquiring lock "403e2d11-98ae-48e4-b7be-fc15c28e863e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:14:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-85930b83-c882-45b8-a396-b28dc6b68fc6 req-3a56367e-fac2-4725-82ae-1d00ca0f2848 service nova] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:14:58 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-85930b83-c882-45b8-a396-b28dc6b68fc6 req-3a56367e-fac2-4725-82ae-1d00ca0f2848 service nova] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:14:58 user nova-compute[72773]: DEBUG nova.compute.manager [req-85930b83-c882-45b8-a396-b28dc6b68fc6 req-3a56367e-fac2-4725-82ae-1d00ca0f2848 service nova] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] No waiting events found dispatching network-vif-plugged-e1d7f8c2-be99-47fa-9444-31186eebe7d2 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:14:58 user nova-compute[72773]: WARNING nova.compute.manager [req-85930b83-c882-45b8-a396-b28dc6b68fc6 req-3a56367e-fac2-4725-82ae-1d00ca0f2848 service nova] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Received unexpected event network-vif-plugged-e1d7f8c2-be99-47fa-9444-31186eebe7d2 for instance with vm_state building and task_state spawning.
Aug 16 23:14:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:14:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:14:59 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:15:00 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692227700.9941702, 403e2d11-98ae-48e4-b7be-fc15c28e863e => Resumed> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 23:15:00 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] VM Resumed (Lifecycle Event)
Aug 16 23:15:00 user nova-compute[72773]: DEBUG nova.compute.manager [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Instance event wait completed in 0 seconds for  {{(pid=72773) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 23:15:01 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Guest created on hypervisor {{(pid=72773) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 23:15:01 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Instance spawned successfully.
Aug 16 23:15:01 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 23:15:01 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 23:15:01 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 23:15:01 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Found default for hw_cdrom_bus of ide {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 23:15:01 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Found default for hw_disk_bus of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 23:15:01 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Found default for hw_input_bus of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 23:15:01 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Found default for hw_pointer_model of None {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 23:15:01 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Found default for hw_video_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 23:15:01 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Found default for hw_vif_model of virtio {{(pid=72773) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 23:15:01 user nova-compute[72773]: DEBUG nova.compute.manager [req-772e5bec-9ed3-4959-9afe-4e02d54baf3e req-4e82d119-d666-45fd-ac5e-7c47c4570b9a service nova] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Received event network-vif-plugged-e1d7f8c2-be99-47fa-9444-31186eebe7d2 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:15:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-772e5bec-9ed3-4959-9afe-4e02d54baf3e req-4e82d119-d666-45fd-ac5e-7c47c4570b9a service nova] Acquiring lock "403e2d11-98ae-48e4-b7be-fc15c28e863e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:15:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-772e5bec-9ed3-4959-9afe-4e02d54baf3e req-4e82d119-d666-45fd-ac5e-7c47c4570b9a service nova] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:15:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-772e5bec-9ed3-4959-9afe-4e02d54baf3e req-4e82d119-d666-45fd-ac5e-7c47c4570b9a service nova] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:15:01 user nova-compute[72773]: DEBUG nova.compute.manager [req-772e5bec-9ed3-4959-9afe-4e02d54baf3e req-4e82d119-d666-45fd-ac5e-7c47c4570b9a service nova] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] No waiting events found dispatching network-vif-plugged-e1d7f8c2-be99-47fa-9444-31186eebe7d2 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:15:01 user nova-compute[72773]: WARNING nova.compute.manager [req-772e5bec-9ed3-4959-9afe-4e02d54baf3e req-4e82d119-d666-45fd-ac5e-7c47c4570b9a service nova] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Received unexpected event network-vif-plugged-e1d7f8c2-be99-47fa-9444-31186eebe7d2 for instance with vm_state building and task_state spawning.
Aug 16 23:15:01 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 23:15:01 user nova-compute[72773]: DEBUG nova.virt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Emitting event <LifecycleEvent: 1692227700.9956665, 403e2d11-98ae-48e4-b7be-fc15c28e863e => Started> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 23:15:01 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] VM Started (Lifecycle Event)
Aug 16 23:15:01 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 23:15:01 user nova-compute[72773]: DEBUG nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72773) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 23:15:01 user nova-compute[72773]: INFO nova.compute.manager [None req-87966913-7caf-487d-bc43-31432767e2ce None None] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 23:15:01 user nova-compute[72773]: INFO nova.compute.manager [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Took 6.18 seconds to spawn the instance on the hypervisor.
Aug 16 23:15:01 user nova-compute[72773]: DEBUG nova.compute.manager [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 23:15:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:15:01 user nova-compute[72773]: INFO nova.compute.manager [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Took 6.78 seconds to build instance.
Aug 16 23:15:01 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6f4ebffe-8475-4255-b7b9-ef5651995dd5 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.940s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:15:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:15:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:15:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:15:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:15:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:15:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:15:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:15:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:15:23 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:15:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:15:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:15:28 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:15:29 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:15:30 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:15:31 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:15:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:15:32 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:15:32 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 23:15:32 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Rebuilding the list of instances to heal {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 23:15:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-403e2d11-98ae-48e4-b7be-fc15c28e863e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:15:32 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-403e2d11-98ae-48e4-b7be-fc15c28e863e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:15:32 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 23:15:32 user nova-compute[72773]: DEBUG nova.objects.instance [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lazy-loading 'info_cache' on Instance uuid 403e2d11-98ae-48e4-b7be-fc15c28e863e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:15:33 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Updating instance_info_cache with network_info: [{"id": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "address": "fa:16:3e:64:14:98", "network": {"id": "a81d5927-b817-4702-9d46-66e63046290b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-436011694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872cd11021f14ff7a9e68ee019da97f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d7f8c2-be", "ovs_interfaceid": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:15:33 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-403e2d11-98ae-48e4-b7be-fc15c28e863e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:15:33 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 23:15:33 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:15:36 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:15:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:15:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:15:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:15:36 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 23:15:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:15:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:15:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:15:36 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:15:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:15:37 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:15:37 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:15:37 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=8485MB free_disk=25.346084594726562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 23:15:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:15:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:15:37 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 403e2d11-98ae-48e4-b7be-fc15c28e863e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 23:15:37 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 23:15:37 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 23:15:37 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:15:37 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:15:37 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 23:15:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:15:38 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:15:38 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:15:38 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 23:15:39 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:15:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:15:42 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:15:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:15:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:15:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:16:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:16:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:16:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:16:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:16:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:16:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:16:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:16:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:16:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:16:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:16:24 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:16:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:16:28 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:16:29 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:16:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:16:32 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:16:32 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:16:34 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:16:34 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 23:16:34 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Rebuilding the list of instances to heal {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 23:16:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-403e2d11-98ae-48e4-b7be-fc15c28e863e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:16:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-403e2d11-98ae-48e4-b7be-fc15c28e863e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:16:34 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 23:16:34 user nova-compute[72773]: DEBUG nova.objects.instance [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lazy-loading 'info_cache' on Instance uuid 403e2d11-98ae-48e4-b7be-fc15c28e863e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:16:35 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Updating instance_info_cache with network_info: [{"id": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "address": "fa:16:3e:64:14:98", "network": {"id": "a81d5927-b817-4702-9d46-66e63046290b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-436011694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872cd11021f14ff7a9e68ee019da97f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d7f8c2-be", "ovs_interfaceid": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:16:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-403e2d11-98ae-48e4-b7be-fc15c28e863e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:16:35 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 23:16:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:16:37 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:16:37 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:16:37 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 23:16:38 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:16:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:16:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:16:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:16:38 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 23:16:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:16:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:16:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:16:38 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:16:39 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:16:39 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:16:39 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=8755MB free_disk=25.343524932861328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 23:16:39 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:16:39 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:16:39 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 403e2d11-98ae-48e4-b7be-fc15c28e863e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 23:16:39 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 23:16:39 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 23:16:39 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Refreshing inventories for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 23:16:39 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Updating ProviderTree inventory for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 23:16:39 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Updating inventory in ProviderTree for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 23:16:39 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Refreshing aggregate associations for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e, aggregates: None {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 23:16:39 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Refreshing trait associations for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 23:16:39 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:16:39 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:16:39 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 23:16:39 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.440s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:16:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:16:45 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:16:45 user nova-compute[72773]: DEBUG nova.compute.manager [req-4a492910-279a-4759-8667-617fe5cea593 req-f3753534-7aac-4368-b817-39f2426d8ea1 service nova] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Received event network-changed-e1d7f8c2-be99-47fa-9444-31186eebe7d2 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:16:45 user nova-compute[72773]: DEBUG nova.compute.manager [req-4a492910-279a-4759-8667-617fe5cea593 req-f3753534-7aac-4368-b817-39f2426d8ea1 service nova] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Refreshing instance network info cache due to event network-changed-e1d7f8c2-be99-47fa-9444-31186eebe7d2. {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 23:16:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4a492910-279a-4759-8667-617fe5cea593 req-f3753534-7aac-4368-b817-39f2426d8ea1 service nova] Acquiring lock "refresh_cache-403e2d11-98ae-48e4-b7be-fc15c28e863e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:16:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4a492910-279a-4759-8667-617fe5cea593 req-f3753534-7aac-4368-b817-39f2426d8ea1 service nova] Acquired lock "refresh_cache-403e2d11-98ae-48e4-b7be-fc15c28e863e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:16:45 user nova-compute[72773]: DEBUG nova.network.neutron [req-4a492910-279a-4759-8667-617fe5cea593 req-f3753534-7aac-4368-b817-39f2426d8ea1 service nova] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Refreshing network info cache for port e1d7f8c2-be99-47fa-9444-31186eebe7d2 {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 23:16:46 user nova-compute[72773]: DEBUG nova.network.neutron [req-4a492910-279a-4759-8667-617fe5cea593 req-f3753534-7aac-4368-b817-39f2426d8ea1 service nova] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Updated VIF entry in instance network info cache for port e1d7f8c2-be99-47fa-9444-31186eebe7d2. {{(pid=72773) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 23:16:46 user nova-compute[72773]: DEBUG nova.network.neutron [req-4a492910-279a-4759-8667-617fe5cea593 req-f3753534-7aac-4368-b817-39f2426d8ea1 service nova] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Updating instance_info_cache with network_info: [{"id": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "address": "fa:16:3e:64:14:98", "network": {"id": "a81d5927-b817-4702-9d46-66e63046290b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-436011694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872cd11021f14ff7a9e68ee019da97f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d7f8c2-be", "ovs_interfaceid": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:16:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-4a492910-279a-4759-8667-617fe5cea593 req-f3753534-7aac-4368-b817-39f2426d8ea1 service nova] Releasing lock "refresh_cache-403e2d11-98ae-48e4-b7be-fc15c28e863e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:16:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:16:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:16:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:16:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Acquiring lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:16:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:16:51 user nova-compute[72773]: DEBUG nova.objects.instance [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lazy-loading 'flavor' on Instance uuid 403e2d11-98ae-48e4-b7be-fc15c28e863e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:16:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:16:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Acquiring lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:16:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:16:51 user nova-compute[72773]: INFO nova.compute.manager [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Attaching volume 07672c4a-f444-4a61-a790-d25ecc75ed5f to /dev/vdb
Aug 16 23:16:51 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:16:51 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Cleaning up deleted instances with incomplete migration  {{(pid=72773) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 23:16:51 user nova-compute[72773]: DEBUG os_brick.utils [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 23:16:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:16:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:16:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3176c69c-8468-4665-9c0d-b5416507a6fa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:16:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:16:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:16:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fff3df0-35cb-4ef2-9eb0-1c3525d1a76d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:16:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:16:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:16:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a15813-0e26-40fa-95e5-8f162e44795a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:16:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac09db6-58c1-4d15-bebf-a3ee5714af96]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:16:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:16:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 23:16:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 23:16:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:16:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 23:16:51 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 23:16:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[80272664-30af-46d7-8bdc-a7830952e438]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:16:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 23:16:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 23:16:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 23:16:51 user nova-compute[72773]: DEBUG os_brick.utils [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 23:16:51 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Updating existing volume attachment record: c26d51ec-c02f-4711-bebe-84686d34d1a9 {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 23:16:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:16:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:16:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:16:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:17:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:17:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:17:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:17:09 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:17:09 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Cleaning up deleted instances {{(pid=72773) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 23:17:09 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] There are 0 instances to clean {{(pid=72773) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CMLKrhbU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 23:17:11 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 23:17:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 23:17:11 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 23:17:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 23:17:11 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 23:17:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ba34e9-90b4-4ce2-ad6d-ccc24e0b1a6f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 23:17:11 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[59494f32-054a-4ec7-af59-74072c854a06]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f] added
Aug 16 23:17:11 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[119c1ac9-4635-42b7-b6f6-80cec8e7691c]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d420e5da-aa6c-4a93-866f-bc8e3cc55c1a]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CMLKrhbU {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CMLKrhbU" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8ab8d2-683d-43d2-8f62-dddcc2f1348b]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CMLKrhbU'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[614a4a0e-e767-4dfe-ac60-0f65664ce8c8]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41b5934-b234-430f-a6d8-c637b6fa0216]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 23:17:11 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 23:17:11 user nova-compute[72773]:  {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 23:17:11 user nova-compute[72773]: WARNING os_brick.initiator.connectors.iscsi [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 23:17:11 user nova-compute[72773]: 
Aug 16 23:17:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee5a46d-1f12-4c27-bfa4-94ee71701326]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f, portal: 172.16.0.220,3260]
Aug 16 23:17:11 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f, portal: 172.16.0.220,3260] successful.
Aug 16 23:17:11 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[688a191e-097e-417e-b9bb-45919403a5b2]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c95b3c2-fe63-4a8f-98fd-c08535367199]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f (non-flash)
Aug 16 23:17:11 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f (non-flash)
Aug 16 23:17:11 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1aff0f7-2257-42aa-8557-df7e82976e20]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 23:17:11 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CMLKrhbU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 23:17:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:17:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 23:17:12 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23036303037326336', 'path': '/dev/sdb'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 23:17:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036303037326336', 'path': '/dev/sdb'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 23:17:12 user nova-compute[72773]: DEBUG nova.objects.instance [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lazy-loading 'flavor' on Instance uuid 403e2d11-98ae-48e4-b7be-fc15c28e863e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:17:12 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 23:17:12 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 23:17:12 user nova-compute[72773]:   <source dev="/dev/sdb"/>
Aug 16 23:17:12 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 23:17:12 user nova-compute[72773]:   <serial>07672c4a-f444-4a61-a790-d25ecc75ed5f</serial>
Aug 16 23:17:12 user nova-compute[72773]: </disk>
Aug 16 23:17:12 user nova-compute[72773]:  {{(pid=72773) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 23:17:13 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 23:17:13 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 23:17:13 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] No VIF found with MAC fa:16:3e:64:14:98, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 23:17:13 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6ce6267d-074e-48d2-a9bf-b6ded27510af tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.834s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:17:16 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:17:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:17:21 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:17:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:17:25 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:17:26 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:17:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:17:30 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:17:31 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:17:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:17:32 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:17:33 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:17:34 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:17:34 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 23:17:34 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Rebuilding the list of instances to heal {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 23:17:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-403e2d11-98ae-48e4-b7be-fc15c28e863e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:17:34 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-403e2d11-98ae-48e4-b7be-fc15c28e863e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:17:34 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 23:17:34 user nova-compute[72773]: DEBUG nova.objects.instance [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lazy-loading 'info_cache' on Instance uuid 403e2d11-98ae-48e4-b7be-fc15c28e863e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:17:34 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Updating instance_info_cache with network_info: [{"id": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "address": "fa:16:3e:64:14:98", "network": {"id": "a81d5927-b817-4702-9d46-66e63046290b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-436011694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872cd11021f14ff7a9e68ee019da97f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d7f8c2-be", "ovs_interfaceid": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:17:35 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-403e2d11-98ae-48e4-b7be-fc15c28e863e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:17:35 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 23:17:36 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:17:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:17:37 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:17:37 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 23:17:38 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:17:40 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:17:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:17:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:17:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:17:40 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 23:17:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:17:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:17:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:17:40 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:17:40 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72773) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 23:17:41 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:17:41 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:17:41 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=8867MB free_disk=25.34170150756836GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 23:17:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:17:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:17:41 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 403e2d11-98ae-48e4-b7be-fc15c28e863e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 23:17:41 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 23:17:41 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 23:17:41 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:17:41 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:17:41 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 23:17:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:17:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:17:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8c60beb1-1746-480e-b6a9-87d5ffcbaeac tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Acquiring lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:17:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8c60beb1-1746-480e-b6a9-87d5ffcbaeac tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:17:42 user nova-compute[72773]: INFO nova.compute.manager [None req-8c60beb1-1746-480e-b6a9-87d5ffcbaeac tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Detaching volume 07672c4a-f444-4a61-a790-d25ecc75ed5f
Aug 16 23:17:42 user nova-compute[72773]: INFO nova.virt.block_device [None req-8c60beb1-1746-480e-b6a9-87d5ffcbaeac tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Attempting to driver detach volume 07672c4a-f444-4a61-a790-d25ecc75ed5f from mountpoint /dev/vdb
Aug 16 23:17:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-8c60beb1-1746-480e-b6a9-87d5ffcbaeac tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Attempting to detach device vdb from instance 403e2d11-98ae-48e4-b7be-fc15c28e863e from the persistent domain config. {{(pid=72773) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 23:17:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-8c60beb1-1746-480e-b6a9-87d5ffcbaeac tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 23:17:42 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 23:17:42 user nova-compute[72773]:   <source dev="/dev/sdb"/>
Aug 16 23:17:42 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 23:17:42 user nova-compute[72773]:   <serial>07672c4a-f444-4a61-a790-d25ecc75ed5f</serial>
Aug 16 23:17:42 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 23:17:42 user nova-compute[72773]: </disk>
Aug 16 23:17:42 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 23:17:42 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-8c60beb1-1746-480e-b6a9-87d5ffcbaeac tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Successfully detached device vdb from instance 403e2d11-98ae-48e4-b7be-fc15c28e863e from the persistent domain config.
Aug 16 23:17:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-8c60beb1-1746-480e-b6a9-87d5ffcbaeac tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 403e2d11-98ae-48e4-b7be-fc15c28e863e from the live domain config. {{(pid=72773) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 23:17:42 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-8c60beb1-1746-480e-b6a9-87d5ffcbaeac tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 23:17:42 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 23:17:42 user nova-compute[72773]:   <source dev="/dev/sdb"/>
Aug 16 23:17:42 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 23:17:42 user nova-compute[72773]:   <serial>07672c4a-f444-4a61-a790-d25ecc75ed5f</serial>
Aug 16 23:17:42 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 23:17:42 user nova-compute[72773]: </disk>
Aug 16 23:17:42 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Received event <DeviceRemovedEvent: 1692227863.1488373, 403e2d11-98ae-48e4-b7be-fc15c28e863e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72773) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-8c60beb1-1746-480e-b6a9-87d5ffcbaeac tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 403e2d11-98ae-48e4-b7be-fc15c28e863e {{(pid=72773) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 23:17:43 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-8c60beb1-1746-480e-b6a9-87d5ffcbaeac tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Successfully detached device vdb from instance 403e2d11-98ae-48e4-b7be-fc15c28e863e from the live domain config.
Aug 16 23:17:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c60beb1-1746-480e-b6a9-87d5ffcbaeac tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c60beb1-1746-480e-b6a9-87d5ffcbaeac tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CMLKrhbU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 23:17:43 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-8c60beb1-1746-480e-b6a9-87d5ffcbaeac tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 23:17:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-8c60beb1-1746-480e-b6a9-87d5ffcbaeac tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-8c60beb1-1746-480e-b6a9-87d5ffcbaeac tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c60beb1-1746-480e-b6a9-87d5ffcbaeac tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ece78c8-a554-48c3-961a-1f15b7dd41a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae074cd-0ee3-421f-9877-1617d4f5f3a4]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c60beb1-1746-480e-b6a9-87d5ffcbaeac tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f (non-flash)
Aug 16 23:17:43 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c60beb1-1746-480e-b6a9-87d5ffcbaeac tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f (non-flash)
Aug 16 23:17:43 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c60beb1-1746-480e-b6a9-87d5ffcbaeac tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef5c585d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f'): ({'sdb'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-8c60beb1-1746-480e-b6a9-87d5ffcbaeac tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Removing single pathed devices sdb {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c97c29-4717-43d6-9030-936c32a8d0ec]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4360e03-3272-4cce-bd50-8f2f428e9f40]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-8c60beb1-1746-480e-b6a9-87d5ffcbaeac tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Flushing IO for device /dev/sdb {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18d1266-0da9-40ec-b1f2-b7b24d103bc0]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-8c60beb1-1746-480e-b6a9-87d5ffcbaeac tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ecd2ec-d3e1-4f32-ad2e-093f73d877ed]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-8c60beb1-1746-480e-b6a9-87d5ffcbaeac tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-8c60beb1-1746-480e-b6a9-87d5ffcbaeac tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] SCSI volumes sdb have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c60beb1-1746-480e-b6a9-87d5ffcbaeac tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d7256c-0693-49dd-9c2b-a655e03ad853]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c60beb1-1746-480e-b6a9-87d5ffcbaeac tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c159cb-8245-4fc3-bec6-2302274d5c40]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c60beb1-1746-480e-b6a9-87d5ffcbaeac tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f, portal: 172.16.0.220,3260]
Aug 16 23:17:43 user nova-compute[72773]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f, portal: 172.16.0.220,3260] successful.
Aug 16 23:17:43 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07672c4a-f444-4a61-a790-d25ecc75ed5f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[5958520c-7176-4b5b-a9c5-323c91936b50]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c60beb1-1746-480e-b6a9-87d5ffcbaeac tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-8c60beb1-1746-480e-b6a9-87d5ffcbaeac tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c60beb1-1746-480e-b6a9-87d5ffcbaeac tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] <== disconnect_volume: return (263ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 23:17:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c60beb1-1746-480e-b6a9-87d5ffcbaeac tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 23:17:44 user nova-compute[72773]: DEBUG nova.objects.instance [None req-8c60beb1-1746-480e-b6a9-87d5ffcbaeac tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lazy-loading 'flavor' on Instance uuid 403e2d11-98ae-48e4-b7be-fc15c28e863e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:17:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-8c60beb1-1746-480e-b6a9-87d5ffcbaeac tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.605s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:17:44 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:17:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:17:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:17:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:18:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:18:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:18:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:18:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:18:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:18:25 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:18:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:18:30 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:18:31 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:18:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:18:33 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:18:34 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:18:36 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:18:36 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 23:18:36 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Rebuilding the list of instances to heal {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 23:18:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-403e2d11-98ae-48e4-b7be-fc15c28e863e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:18:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-403e2d11-98ae-48e4-b7be-fc15c28e863e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:18:36 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 23:18:36 user nova-compute[72773]: DEBUG nova.objects.instance [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lazy-loading 'info_cache' on Instance uuid 403e2d11-98ae-48e4-b7be-fc15c28e863e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:18:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Acquiring lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:18:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:18:36 user nova-compute[72773]: DEBUG nova.objects.instance [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lazy-loading 'flavor' on Instance uuid 403e2d11-98ae-48e4-b7be-fc15c28e863e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:18:36 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:18:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Acquiring lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:18:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:18:37 user nova-compute[72773]: INFO nova.compute.manager [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Attaching volume 7f2e2f95-7aaa-4a20-9936-f93ae929e8c5 to /dev/vdb
Aug 16 23:18:37 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Updating instance_info_cache with network_info: [{"id": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "address": "fa:16:3e:64:14:98", "network": {"id": "a81d5927-b817-4702-9d46-66e63046290b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-436011694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872cd11021f14ff7a9e68ee019da97f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d7f8c2-be", "ovs_interfaceid": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:18:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-403e2d11-98ae-48e4-b7be-fc15c28e863e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:18:37 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 23:18:37 user nova-compute[72773]: DEBUG os_brick.utils [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 23:18:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:18:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:18:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[61646c03-62f8-4d82-b404-db1410d7b06c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:18:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:18:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:18:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db51b2e-56fe-4c36-81bc-f23b3ccb0976]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:18:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:18:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:18:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ec0938-a0b0-4e81-b9bc-45541badae82]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:18:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8829e2c-0b97-4857-81a3-e3b3a92af99a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:18:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:18:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 23:18:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 23:18:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:18:37 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 23:18:37 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 23:18:37 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c088b8bd-66d6-4fe7-ac39-49d6104b4f9e]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:18:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 23:18:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 23:18:37 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 23:18:37 user nova-compute[72773]: DEBUG os_brick.utils [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 23:18:37 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Updating existing volume attachment record: a9130cfc-a1eb-43f8-b874-b88e012aa2e4 {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 23:18:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:18:39 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:18:39 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:18:39 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 23:18:41 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:18:41 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:18:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:18:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:18:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:18:41 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 23:18:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:18:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:18:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:18:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:18:42 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:18:42 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:18:42 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=8861MB free_disk=25.34088897705078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 23:18:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:18:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:18:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:18:42 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 403e2d11-98ae-48e4-b7be-fc15c28e863e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 23:18:42 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 23:18:42 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 23:18:42 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:18:42 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:18:42 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 23:18:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.367s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:18:46 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 23:18:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUOzLwAo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 23:18:46 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 23:18:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 23:18:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 23:18:46 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 23:18:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 23:18:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 23:18:46 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 23:18:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:18:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:18:46 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6548844e-222a-4d61-8bb7-dd59b17e6f11]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:18:46 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 23:18:46 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:18:46 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bdd384-e529-4df5-9100-e28e3f99b431]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5] added
Aug 16 23:18:47 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6859929b-ff48-4a1b-80cf-204b360e66b5]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dc5681-1b2e-4bac-ae6e-084e497e7684]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cUOzLwAo {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cUOzLwAo" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[392898cd-aa90-4c31-af85-092135869378]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cUOzLwAo'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9e2692-ca84-45a1-bad6-625681463512]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac958edb-81ac-4890-9df3-0bd3547e9b9b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 23:18:47 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 23:18:47 user nova-compute[72773]:  {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 23:18:47 user nova-compute[72773]: WARNING os_brick.initiator.connectors.iscsi [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 23:18:47 user nova-compute[72773]: 
Aug 16 23:18:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[374c6c8f-51d5-48b9-8811-348e4c6ec9cd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5, portal: 172.16.0.220,3260]
Aug 16 23:18:47 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5, portal: 172.16.0.220,3260] successful.
Aug 16 23:18:47 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcb94cb-07e6-4382-9535-181ada88baa7]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c3919a-7f5e-4905-ade7-31539788234f]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5 (non-flash)
Aug 16 23:18:47 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5 (non-flash)
Aug 16 23:18:47 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b96ca97-0c0d-43d2-9ef8-0269e21fadec]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUOzLwAo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:18:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:18:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 23:18:48 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26462393062316635', 'path': '/dev/sdb'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 23:18:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462393062316635', 'path': '/dev/sdb'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 23:18:48 user nova-compute[72773]: DEBUG nova.objects.instance [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lazy-loading 'flavor' on Instance uuid 403e2d11-98ae-48e4-b7be-fc15c28e863e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:18:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 23:18:48 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 23:18:48 user nova-compute[72773]:   <source dev="/dev/sdb"/>
Aug 16 23:18:48 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 23:18:48 user nova-compute[72773]:   <serial>7f2e2f95-7aaa-4a20-9936-f93ae929e8c5</serial>
Aug 16 23:18:48 user nova-compute[72773]: </disk>
Aug 16 23:18:48 user nova-compute[72773]:  {{(pid=72773) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 23:18:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 23:18:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 23:18:48 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] No VIF found with MAC fa:16:3e:64:14:98, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 23:18:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-908c4aa8-a529-49e9-879f-bc35745b8362 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.827s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-0d1861aa-c5f0-46f1-ad9a-21f4a2e802a6 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Acquiring lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-0d1861aa-c5f0-46f1-ad9a-21f4a2e802a6 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:18:51 user nova-compute[72773]: INFO nova.compute.manager [None req-0d1861aa-c5f0-46f1-ad9a-21f4a2e802a6 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Detaching volume 7f2e2f95-7aaa-4a20-9936-f93ae929e8c5
Aug 16 23:18:51 user nova-compute[72773]: INFO nova.virt.block_device [None req-0d1861aa-c5f0-46f1-ad9a-21f4a2e802a6 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Attempting to driver detach volume 7f2e2f95-7aaa-4a20-9936-f93ae929e8c5 from mountpoint /dev/vdb
Aug 16 23:18:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-0d1861aa-c5f0-46f1-ad9a-21f4a2e802a6 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Attempting to detach device vdb from instance 403e2d11-98ae-48e4-b7be-fc15c28e863e from the persistent domain config. {{(pid=72773) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-0d1861aa-c5f0-46f1-ad9a-21f4a2e802a6 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 23:18:51 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 23:18:51 user nova-compute[72773]:   <source dev="/dev/sdb"/>
Aug 16 23:18:51 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 23:18:51 user nova-compute[72773]:   <serial>7f2e2f95-7aaa-4a20-9936-f93ae929e8c5</serial>
Aug 16 23:18:51 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 23:18:51 user nova-compute[72773]: </disk>
Aug 16 23:18:51 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 23:18:51 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-0d1861aa-c5f0-46f1-ad9a-21f4a2e802a6 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Successfully detached device vdb from instance 403e2d11-98ae-48e4-b7be-fc15c28e863e from the persistent domain config.
Aug 16 23:18:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-0d1861aa-c5f0-46f1-ad9a-21f4a2e802a6 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 403e2d11-98ae-48e4-b7be-fc15c28e863e from the live domain config. {{(pid=72773) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-0d1861aa-c5f0-46f1-ad9a-21f4a2e802a6 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 23:18:51 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 23:18:51 user nova-compute[72773]:   <source dev="/dev/sdb"/>
Aug 16 23:18:51 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 23:18:51 user nova-compute[72773]:   <serial>7f2e2f95-7aaa-4a20-9936-f93ae929e8c5</serial>
Aug 16 23:18:51 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 23:18:51 user nova-compute[72773]: </disk>
Aug 16 23:18:51 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Received event <DeviceRemovedEvent: 1692227931.777118, 403e2d11-98ae-48e4-b7be-fc15c28e863e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72773) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-0d1861aa-c5f0-46f1-ad9a-21f4a2e802a6 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 403e2d11-98ae-48e4-b7be-fc15c28e863e {{(pid=72773) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 23:18:51 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-0d1861aa-c5f0-46f1-ad9a-21f4a2e802a6 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Successfully detached device vdb from instance 403e2d11-98ae-48e4-b7be-fc15c28e863e from the live domain config.
Aug 16 23:18:51 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d1861aa-c5f0-46f1-ad9a-21f4a2e802a6 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1861aa-c5f0-46f1-ad9a-21f4a2e802a6 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUOzLwAo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 23:18:51 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-0d1861aa-c5f0-46f1-ad9a-21f4a2e802a6 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 23:18:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-0d1861aa-c5f0-46f1-ad9a-21f4a2e802a6 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-0d1861aa-c5f0-46f1-ad9a-21f4a2e802a6 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1861aa-c5f0-46f1-ad9a-21f4a2e802a6 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[270e0ccd-1c70-4905-b381-46a6f39d532b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[500e8577-28f4-4d2b-a206-7a5097c2dad0]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1861aa-c5f0-46f1-ad9a-21f4a2e802a6 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5 (non-flash)
Aug 16 23:18:51 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1861aa-c5f0-46f1-ad9a-21f4a2e802a6 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5 (non-flash)
Aug 16 23:18:51 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1861aa-c5f0-46f1-ad9a-21f4a2e802a6 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef5c5868c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5'): ({'sdb'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-0d1861aa-c5f0-46f1-ad9a-21f4a2e802a6 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Removing single pathed devices sdb {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e15def1-31eb-492e-8d20-6204b319f04b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[17959f91-a768-453a-aaf8-9e3e81c607d0]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-0d1861aa-c5f0-46f1-ad9a-21f4a2e802a6 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Flushing IO for device /dev/sdb {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0e9037-381a-4978-aaa9-7622809e2817]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-0d1861aa-c5f0-46f1-ad9a-21f4a2e802a6 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.028s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f29b100-7490-4868-a5e7-291da6f267b4]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-0d1861aa-c5f0-46f1-ad9a-21f4a2e802a6 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-0d1861aa-c5f0-46f1-ad9a-21f4a2e802a6 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] SCSI volumes sdb have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1861aa-c5f0-46f1-ad9a-21f4a2e802a6 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[33259156-84b2-4f25-9e19-e26dfadedff9]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1861aa-c5f0-46f1-ad9a-21f4a2e802a6 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:18:51 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:18:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:18:52 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f873406-32ae-4704-953d-f9a2e9ecbfed]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:18:52 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1861aa-c5f0-46f1-ad9a-21f4a2e802a6 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5, portal: 172.16.0.220,3260]
Aug 16 23:18:52 user nova-compute[72773]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5, portal: 172.16.0.220,3260] successful.
Aug 16 23:18:52 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:18:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:18:52 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f2e2f95-7aaa-4a20-9936-f93ae929e8c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:18:52 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[20342585-71fc-4c07-92cb-276af6a9df52]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:18:52 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1861aa-c5f0-46f1-ad9a-21f4a2e802a6 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:18:52 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-0d1861aa-c5f0-46f1-ad9a-21f4a2e802a6 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.254s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 23:18:52 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1861aa-c5f0-46f1-ad9a-21f4a2e802a6 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] <== disconnect_volume: return (255ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 23:18:52 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d1861aa-c5f0-46f1-ad9a-21f4a2e802a6 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 23:18:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:18:52 user nova-compute[72773]: DEBUG nova.objects.instance [None req-0d1861aa-c5f0-46f1-ad9a-21f4a2e802a6 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lazy-loading 'flavor' on Instance uuid 403e2d11-98ae-48e4-b7be-fc15c28e863e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:18:52 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-0d1861aa-c5f0-46f1-ad9a-21f4a2e802a6 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.581s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:18:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:18:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:19:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:19:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:19:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:19:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:19:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:19:26 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:19:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:19:31 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:19:32 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:19:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:19:34 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:19:36 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:19:37 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:19:37 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 23:19:37 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Rebuilding the list of instances to heal {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 23:19:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:19:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-403e2d11-98ae-48e4-b7be-fc15c28e863e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:19:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-403e2d11-98ae-48e4-b7be-fc15c28e863e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:19:37 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 23:19:37 user nova-compute[72773]: DEBUG nova.objects.instance [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lazy-loading 'info_cache' on Instance uuid 403e2d11-98ae-48e4-b7be-fc15c28e863e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:19:37 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Updating instance_info_cache with network_info: [{"id": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "address": "fa:16:3e:64:14:98", "network": {"id": "a81d5927-b817-4702-9d46-66e63046290b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-436011694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872cd11021f14ff7a9e68ee019da97f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d7f8c2-be", "ovs_interfaceid": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:19:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-403e2d11-98ae-48e4-b7be-fc15c28e863e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:19:37 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 23:19:38 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:19:39 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:19:39 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 23:19:41 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:19:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:19:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:19:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:19:41 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 23:19:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:19:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:19:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:19:41 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:19:42 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:19:42 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:19:42 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=8856MB free_disk=25.340007781982422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 23:19:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:19:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:19:42 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 403e2d11-98ae-48e4-b7be-fc15c28e863e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 23:19:42 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 23:19:42 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 23:19:42 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:19:42 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:19:42 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 23:19:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:19:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:19:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Acquiring lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:19:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:19:45 user nova-compute[72773]: DEBUG nova.objects.instance [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lazy-loading 'flavor' on Instance uuid 403e2d11-98ae-48e4-b7be-fc15c28e863e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:19:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:19:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Acquiring lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:19:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:19:45 user nova-compute[72773]: INFO nova.compute.manager [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Attaching volume 96966f08-8e97-46d0-9fbf-fd07475fafc8 to /dev/vdb
Aug 16 23:19:45 user nova-compute[72773]: DEBUG os_brick.utils [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 23:19:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:19:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:19:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd597a6-0213-4654-b49d-5c709ecb917a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:19:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:19:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:19:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cd459a-a524-452f-9a27-55840c5030fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:19:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:19:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:19:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6ee0d4-e60e-47dd-bb18-0c9caf5ebf68]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:19:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ba32ce-f065-4f87-8ca8-f9cc49dbd2f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:19:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:19:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 23:19:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 23:19:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:19:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 23:19:45 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 23:19:45 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[733e0dda-8683-42ee-9f81-9511974b24ff]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:19:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 23:19:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 23:19:45 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 23:19:45 user nova-compute[72773]: DEBUG os_brick.utils [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 23:19:45 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Updating existing volume attachment record: e0367c2c-0270-4e5d-894c-da213c064085 {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 23:19:46 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:19:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:19:49 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:19:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IMbNSnQE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 23:19:55 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 23:19:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 23:19:55 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 23:19:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 23:19:55 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 23:19:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe5d5f4-2260-4b62-a973-5f8bad4649f2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 23:19:55 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb0d370-608d-4526-a224-3f55ae5f3cb2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8] added
Aug 16 23:19:55 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9599a0-445f-4bd0-abe0-bb78f33a0011]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fd2dec-cdff-4ba1-a3ac-34d4d10a5da0]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IMbNSnQE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IMbNSnQE" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbfaf4e-275b-4c7c-b7c8-0ce9c7ab5980]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IMbNSnQE'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30858f8-989b-42c1-babd-fd5bbe34fd6b]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[017e4864-12d4-4b66-92d1-fab1dc3bbfd3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 23:19:55 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 23:19:55 user nova-compute[72773]:  {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 23:19:55 user nova-compute[72773]: WARNING os_brick.initiator.connectors.iscsi [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 23:19:55 user nova-compute[72773]: 
Aug 16 23:19:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeeffb1a-f615-4883-8ac4-fb1bb4c678d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8, portal: 172.16.0.220,3260]
Aug 16 23:19:55 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8, portal: 172.16.0.220,3260] successful.
Aug 16 23:19:55 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[7236c7b2-f6e1-4b3c-9300-1ed9761d378b]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda8492b-7284-4779-8925-c863a86dfba6]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8 (non-flash)
Aug 16 23:19:55 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8 (non-flash)
Aug 16 23:19:55 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eeebebb-86a8-464f-a889-bba4583b42c5]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 23:19:55 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IMbNSnQE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 23:19:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 23:19:56 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '26136353135326561', 'path': '/dev/sdb'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 23:19:56 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136353135326561', 'path': '/dev/sdb'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 23:19:56 user nova-compute[72773]: DEBUG nova.objects.instance [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lazy-loading 'flavor' on Instance uuid 403e2d11-98ae-48e4-b7be-fc15c28e863e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:19:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 23:19:57 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 23:19:57 user nova-compute[72773]:   <source dev="/dev/sdb"/>
Aug 16 23:19:57 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 23:19:57 user nova-compute[72773]:   <serial>96966f08-8e97-46d0-9fbf-fd07475fafc8</serial>
Aug 16 23:19:57 user nova-compute[72773]: </disk>
Aug 16 23:19:57 user nova-compute[72773]:  {{(pid=72773) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 23:19:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 23:19:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 23:19:57 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] No VIF found with MAC fa:16:3e:64:14:98, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 23:19:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:19:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:19:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:19:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:19:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:19:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:19:57 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-e9a16c1a-759c-47da-92c3-af17bada5696 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.828s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-9acf1add-14cd-4153-8752-fb9a1b71b5d1 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Acquiring lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-9acf1add-14cd-4153-8752-fb9a1b71b5d1 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:19:59 user nova-compute[72773]: INFO nova.compute.manager [None req-9acf1add-14cd-4153-8752-fb9a1b71b5d1 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Detaching volume 96966f08-8e97-46d0-9fbf-fd07475fafc8
Aug 16 23:19:59 user nova-compute[72773]: INFO nova.virt.block_device [None req-9acf1add-14cd-4153-8752-fb9a1b71b5d1 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Attempting to driver detach volume 96966f08-8e97-46d0-9fbf-fd07475fafc8 from mountpoint /dev/vdb
Aug 16 23:19:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-9acf1add-14cd-4153-8752-fb9a1b71b5d1 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Attempting to detach device vdb from instance 403e2d11-98ae-48e4-b7be-fc15c28e863e from the persistent domain config. {{(pid=72773) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-9acf1add-14cd-4153-8752-fb9a1b71b5d1 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 23:19:59 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 23:19:59 user nova-compute[72773]:   <source dev="/dev/sdb"/>
Aug 16 23:19:59 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 23:19:59 user nova-compute[72773]:   <serial>96966f08-8e97-46d0-9fbf-fd07475fafc8</serial>
Aug 16 23:19:59 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 23:19:59 user nova-compute[72773]: </disk>
Aug 16 23:19:59 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 23:19:59 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-9acf1add-14cd-4153-8752-fb9a1b71b5d1 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Successfully detached device vdb from instance 403e2d11-98ae-48e4-b7be-fc15c28e863e from the persistent domain config.
Aug 16 23:19:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-9acf1add-14cd-4153-8752-fb9a1b71b5d1 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 403e2d11-98ae-48e4-b7be-fc15c28e863e from the live domain config. {{(pid=72773) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-9acf1add-14cd-4153-8752-fb9a1b71b5d1 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 23:19:59 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 23:19:59 user nova-compute[72773]:   <source dev="/dev/sdb"/>
Aug 16 23:19:59 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 23:19:59 user nova-compute[72773]:   <serial>96966f08-8e97-46d0-9fbf-fd07475fafc8</serial>
Aug 16 23:19:59 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 23:19:59 user nova-compute[72773]: </disk>
Aug 16 23:19:59 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Received event <DeviceRemovedEvent: 1692227999.818467, 403e2d11-98ae-48e4-b7be-fc15c28e863e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72773) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-9acf1add-14cd-4153-8752-fb9a1b71b5d1 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 403e2d11-98ae-48e4-b7be-fc15c28e863e {{(pid=72773) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 23:19:59 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-9acf1add-14cd-4153-8752-fb9a1b71b5d1 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Successfully detached device vdb from instance 403e2d11-98ae-48e4-b7be-fc15c28e863e from the live domain config.
Aug 16 23:19:59 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9acf1add-14cd-4153-8752-fb9a1b71b5d1 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acf1add-14cd-4153-8752-fb9a1b71b5d1 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IMbNSnQE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 23:19:59 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-9acf1add-14cd-4153-8752-fb9a1b71b5d1 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 23:19:59 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-9acf1add-14cd-4153-8752-fb9a1b71b5d1 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-9acf1add-14cd-4153-8752-fb9a1b71b5d1 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acf1add-14cd-4153-8752-fb9a1b71b5d1 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bd663b-b089-499a-b494-a2f9fcb0ae83]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cacdb8a-76a7-40cb-bce4-e6764ff8238f]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acf1add-14cd-4153-8752-fb9a1b71b5d1 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8 (non-flash)
Aug 16 23:19:59 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acf1add-14cd-4153-8752-fb9a1b71b5d1 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8 (non-flash)
Aug 16 23:19:59 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acf1add-14cd-4153-8752-fb9a1b71b5d1 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef80208b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8'): ({'sdb'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-9acf1add-14cd-4153-8752-fb9a1b71b5d1 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Removing single pathed devices sdb {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a4c250-6c33-4910-ad50-768540d503e7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[724225fb-eb4f-4193-b3f0-6d1b2dbdedb4]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-9acf1add-14cd-4153-8752-fb9a1b71b5d1 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Flushing IO for device /dev/sdb {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[465edbda-e1fe-42ff-9b2a-a980aa6b676a]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-9acf1add-14cd-4153-8752-fb9a1b71b5d1 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[6788bba0-ff03-4695-982e-542c026b6393]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-9acf1add-14cd-4153-8752-fb9a1b71b5d1 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-9acf1add-14cd-4153-8752-fb9a1b71b5d1 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] SCSI volumes sdb have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acf1add-14cd-4153-8752-fb9a1b71b5d1 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 23:19:59 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:20:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:20:00 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1630ba8e-feef-412e-93b4-cdc61bc99843]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:20:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acf1add-14cd-4153-8752-fb9a1b71b5d1 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:20:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:20:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:20:00 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61ffec2-567b-4818-8270-af7c7a7cc8fe]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:20:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acf1add-14cd-4153-8752-fb9a1b71b5d1 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8, portal: 172.16.0.220,3260]
Aug 16 23:20:00 user nova-compute[72773]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8, portal: 172.16.0.220,3260] successful.
Aug 16 23:20:00 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:20:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:20:00 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96966f08-8e97-46d0-9fbf-fd07475fafc8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:20:00 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b753a25b-59d3-4804-84d5-5c365e0d2bbf]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:20:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acf1add-14cd-4153-8752-fb9a1b71b5d1 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:20:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-9acf1add-14cd-4153-8752-fb9a1b71b5d1 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 23:20:00 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-9acf1add-14cd-4153-8752-fb9a1b71b5d1 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] <== disconnect_volume: return (265ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 23:20:00 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9acf1add-14cd-4153-8752-fb9a1b71b5d1 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 23:20:00 user nova-compute[72773]: DEBUG nova.objects.instance [None req-9acf1add-14cd-4153-8752-fb9a1b71b5d1 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lazy-loading 'flavor' on Instance uuid 403e2d11-98ae-48e4-b7be-fc15c28e863e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:20:00 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-9acf1add-14cd-4153-8752-fb9a1b71b5d1 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.656s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:20:01 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:20:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:20:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:20:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:20:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:20:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:20:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:20:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:20:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:20:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:20:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:20:26 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:20:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:20:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:20:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:20:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:20:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:20:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:20:32 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:20:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:20:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:20:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:20:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:20:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:20:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:20:33 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:20:35 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:20:37 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:20:37 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 23:20:37 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Rebuilding the list of instances to heal {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 23:20:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:20:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-403e2d11-98ae-48e4-b7be-fc15c28e863e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:20:37 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-403e2d11-98ae-48e4-b7be-fc15c28e863e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:20:37 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 23:20:37 user nova-compute[72773]: DEBUG nova.objects.instance [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lazy-loading 'info_cache' on Instance uuid 403e2d11-98ae-48e4-b7be-fc15c28e863e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:20:38 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Updating instance_info_cache with network_info: [{"id": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "address": "fa:16:3e:64:14:98", "network": {"id": "a81d5927-b817-4702-9d46-66e63046290b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-436011694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872cd11021f14ff7a9e68ee019da97f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d7f8c2-be", "ovs_interfaceid": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:20:38 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-403e2d11-98ae-48e4-b7be-fc15c28e863e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:20:38 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 23:20:38 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:20:39 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:20:39 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 23:20:40 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:20:40 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:20:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:20:43 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:20:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:20:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:20:43 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:20:43 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 23:20:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:20:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:20:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:20:43 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:20:44 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:20:44 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:20:44 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=8838MB free_disk=25.33901596069336GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 23:20:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:20:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:20:44 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 403e2d11-98ae-48e4-b7be-fc15c28e863e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 23:20:44 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 23:20:44 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 23:20:44 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:20:44 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:20:44 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 23:20:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:20:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:20:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:20:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:20:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:20:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:20:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:20:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:20:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Acquiring lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:20:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:20:53 user nova-compute[72773]: DEBUG nova.objects.instance [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lazy-loading 'flavor' on Instance uuid 403e2d11-98ae-48e4-b7be-fc15c28e863e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:20:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:20:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Acquiring lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:20:53 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:20:53 user nova-compute[72773]: INFO nova.compute.manager [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Attaching volume a453b14c-4c40-4e17-ac54-7350b314fe66 to /dev/vdb
Aug 16 23:20:53 user nova-compute[72773]: DEBUG os_brick.utils [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 23:20:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:20:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:20:53 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a7f32b-58da-4eed-b1b1-2cbe2e92f29d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9744c081ec92\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:20:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:20:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:20:53 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2f7a8d-cd83-4ffe-aef5-a0cebd6d9187]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:20:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:20:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:20:53 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ea5097-1c91-46a9-82a5-4e28aa1914e4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:20:53 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[b784e770-2fd6-4087-9d58-05b7eb3a4ceb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:20:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Running cmd (subprocess): nvme version {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:20:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] 'nvme version' failed. Not Retrying. {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 23:20:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.nvmeof [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] nvme not present on system {{(pid=72773) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 23:20:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:20:53 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 23:20:53 user nova-compute[72773]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 23:20:53 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1827c912-4e02-43ab-a16d-55027b0803db]: (4, '') {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:20:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72773) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 23:20:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 23:20:53 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.lightos [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] LIGHTOS: no hostnqn found. {{(pid=72773) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 23:20:53 user nova-compute[72773]: DEBUG os_brick.utils [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9744c081ec92', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 23:20:53 user nova-compute[72773]: DEBUG nova.virt.block_device [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Updating existing volume attachment record: f150b582-2b42-46db-8dc9-4529302b9d1a {{(pid=72773) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 23:20:56 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:20:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:21:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Calling os-brick to attach iSCSI Volume {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MWbqleUi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 23:21:03 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 23:21:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 23:21:03 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 23:21:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 23:21:03 user nova-compute[72773]: INFO os_brick.initiator.connectors.iscsi [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 23:21:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66 -p 172.16.0.220:3260 {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[616d31af-fdef-4d91-82f3-dbd9c6408811]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 23:21:03 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66 -p 172.16.0.220:3260 --interface default --op new {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f88555-fd55-46b3-8544-0587912f07e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66] added\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66] added
Aug 16 23:21:03 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b2d865-5aa7-4801-be38-d5f618a1c6f8]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c177ade-08bf-4cf4-b9ea-559586710a60]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MWbqleUi {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MWbqleUi" returned: 0 in 0.016s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c681f64-bfc1-4e10-aec3-6e672f611142]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MWbqleUi'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1a7968-f7b5-462d-8e77-d3dab723861a]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d60da5-fb01-4a9b-8f5d-0e77581576f8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 23:21:03 user nova-compute[72773]:  {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 23:21:03 user nova-compute[72773]:  {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 23:21:03 user nova-compute[72773]: WARNING os_brick.initiator.connectors.iscsi [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 23:21:03 user nova-compute[72773]: 
Aug 16 23:21:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66 -p 172.16.0.220:3260 --login {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[27232a2c-6640-4f7d-a257-3f576ce19af4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66, portal: 172.16.0.220,3260]
Aug 16 23:21:03 user nova-compute[72773]: Login to [iface: default, target: iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66, portal: 172.16.0.220,3260] successful.
Aug 16 23:21:03 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2ba984-7b7d-4447-995b-654d6935eef0]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec795617-061c-4bd6-bbc3-641a3cda41fc]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66 (non-flash)
Aug 16 23:21:03 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66 (non-flash)
Aug 16 23:21:03 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Connected to 172.16.0.220:3260 {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=72773) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72773) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7976c2-5500-4802-866d-19bb300f2301]: (4, ('- - 0', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72773) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 23:21:03 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MWbqleUi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72773) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 23:21:04 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 23:21:04 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26233626137346664', 'path': '/dev/sdb'} {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 23:21:04 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233626137346664', 'path': '/dev/sdb'} {{(pid=72773) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 23:21:04 user nova-compute[72773]: DEBUG nova.objects.instance [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lazy-loading 'flavor' on Instance uuid 403e2d11-98ae-48e4-b7be-fc15c28e863e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:21:04 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 23:21:04 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 23:21:04 user nova-compute[72773]:   <source dev="/dev/sdb"/>
Aug 16 23:21:04 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 23:21:04 user nova-compute[72773]:   <serial>a453b14c-4c40-4e17-ac54-7350b314fe66</serial>
Aug 16 23:21:04 user nova-compute[72773]: </disk>
Aug 16 23:21:04 user nova-compute[72773]:  {{(pid=72773) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 23:21:05 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] No BDM found with device name vda, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 23:21:05 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72773) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 23:21:05 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] No VIF found with MAC fa:16:3e:64:14:98, not building metadata {{(pid=72773) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 23:21:05 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-971362c3-f86f-46a0-8c5b-c5e89a5a4737 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.789s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:21:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6f7cd333-07c5-4148-a06c-c5ef675edff9 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Acquiring lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6f7cd333-07c5-4148-a06c-c5ef675edff9 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:21:08 user nova-compute[72773]: INFO nova.compute.manager [None req-6f7cd333-07c5-4148-a06c-c5ef675edff9 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Detaching volume a453b14c-4c40-4e17-ac54-7350b314fe66
Aug 16 23:21:08 user nova-compute[72773]: INFO nova.virt.block_device [None req-6f7cd333-07c5-4148-a06c-c5ef675edff9 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Attempting to driver detach volume a453b14c-4c40-4e17-ac54-7350b314fe66 from mountpoint /dev/vdb
Aug 16 23:21:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6f7cd333-07c5-4148-a06c-c5ef675edff9 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Attempting to detach device vdb from instance 403e2d11-98ae-48e4-b7be-fc15c28e863e from the persistent domain config. {{(pid=72773) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-6f7cd333-07c5-4148-a06c-c5ef675edff9 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 23:21:08 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 23:21:08 user nova-compute[72773]:   <source dev="/dev/sdb"/>
Aug 16 23:21:08 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 23:21:08 user nova-compute[72773]:   <serial>a453b14c-4c40-4e17-ac54-7350b314fe66</serial>
Aug 16 23:21:08 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 23:21:08 user nova-compute[72773]: </disk>
Aug 16 23:21:08 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 23:21:08 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-6f7cd333-07c5-4148-a06c-c5ef675edff9 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Successfully detached device vdb from instance 403e2d11-98ae-48e4-b7be-fc15c28e863e from the persistent domain config.
Aug 16 23:21:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6f7cd333-07c5-4148-a06c-c5ef675edff9 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 403e2d11-98ae-48e4-b7be-fc15c28e863e from the live domain config. {{(pid=72773) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.guest [None req-6f7cd333-07c5-4148-a06c-c5ef675edff9 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 23:21:08 user nova-compute[72773]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 23:21:08 user nova-compute[72773]:   <source dev="/dev/sdb"/>
Aug 16 23:21:08 user nova-compute[72773]:   <target dev="vdb" bus="virtio"/>
Aug 16 23:21:08 user nova-compute[72773]:   <serial>a453b14c-4c40-4e17-ac54-7350b314fe66</serial>
Aug 16 23:21:08 user nova-compute[72773]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 23:21:08 user nova-compute[72773]: </disk>
Aug 16 23:21:08 user nova-compute[72773]:  {{(pid=72773) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-87966913-7caf-487d-bc43-31432767e2ce None None] Received event <DeviceRemovedEvent: 1692228068.642516, 403e2d11-98ae-48e4-b7be-fc15c28e863e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72773) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.driver [None req-6f7cd333-07c5-4148-a06c-c5ef675edff9 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 403e2d11-98ae-48e4-b7be-fc15c28e863e {{(pid=72773) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 23:21:08 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-6f7cd333-07c5-4148-a06c-c5ef675edff9 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Successfully detached device vdb from instance 403e2d11-98ae-48e4-b7be-fc15c28e863e from the live domain config.
Aug 16 23:21:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f7cd333-07c5-4148-a06c-c5ef675edff9 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] calling os-brick to detach iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f7cd333-07c5-4148-a06c-c5ef675edff9 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef8040c700>, {'target_iqns': ['iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MWbqleUi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 23:21:08 user nova-compute[72773]: WARNING os_brick.initiator.connectors.base [None req-6f7cd333-07c5-4148-a06c-c5ef675edff9 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 23:21:08 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-6f7cd333-07c5-4148-a06c-c5ef675edff9 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-6f7cd333-07c5-4148-a06c-c5ef675edff9 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f7cd333-07c5-4148-a06c-c5ef675edff9 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66', 0)] {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3be3192-de22-46bc-9b7f-bfc0a43ecd78]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c30402-efd6-4918-aab7-abea720c7f1b]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66 (non-flash)\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f7cd333-07c5-4148-a06c-c5ef675edff9 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66 (non-flash)
Aug 16 23:21:08 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f7cd333-07c5-4148-a06c-c5ef675edff9 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66 (non-flash)
Aug 16 23:21:08 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f7cd333-07c5-4148-a06c-c5ef675edff9 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef805595a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66'): ({'sdb'}, set())}) {{(pid=72773) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-6f7cd333-07c5-4148-a06c-c5ef675edff9 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Removing single pathed devices sdb {{(pid=72773) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5411618-c64e-48c7-8150-ceadd7e7423d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c2789b-bceb-4406-b8b2-a3a7556a3a75]: (4, ('ok\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-6f7cd333-07c5-4148-a06c-c5ef675edff9 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Flushing IO for device /dev/sdb {{(pid=72773) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68f6604-5c6e-410c-b14e-dc6cdcb7e542]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-6f7cd333-07c5-4148-a06c-c5ef675edff9 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72773) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[c971448d-7021-4923-953b-c014419dc773]: (4, ('1', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-6f7cd333-07c5-4148-a06c-c5ef675edff9 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG os_brick.initiator.linuxscsi [None req-6f7cd333-07c5-4148-a06c-c5ef675edff9 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] SCSI volumes sdb have been removed. {{(pid=72773) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f7cd333-07c5-4148-a06c-c5ef675edff9 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66')] {{(pid=72773) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d79b54f-b456-4787-ad36-d038a41ae404]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f7cd333-07c5-4148-a06c-c5ef675edff9 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66 -p 172.16.0.220:3260 --logout {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[365059f5-d093-4e2f-b1cf-e8d91d243da1]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f7cd333-07c5-4148-a06c-c5ef675edff9 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66, portal: 172.16.0.220,3260]
Aug 16 23:21:08 user nova-compute[72773]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66, portal: 172.16.0.220,3260] successful.
Aug 16 23:21:08 user nova-compute[72773]:  stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66 -p 172.16.0.220:3260 --op delete {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a453b14c-4c40-4e17-ac54-7350b314fe66 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5f9224-b31e-4b6d-be7f-53dd4c6cc643]: (4, ('', '')) {{(pid=83955) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f7cd333-07c5-4148-a06c-c5ef675edff9 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72773) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.base [None req-6f7cd333-07c5-4148-a06c-c5ef675edff9 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.254s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f7cd333-07c5-4148-a06c-c5ef675edff9 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] <== disconnect_volume: return (255ms) None {{(pid=72773) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 23:21:08 user nova-compute[72773]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f7cd333-07c5-4148-a06c-c5ef675edff9 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Disconnected iSCSI Volume {{(pid=72773) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 23:21:09 user nova-compute[72773]: DEBUG nova.objects.instance [None req-6f7cd333-07c5-4148-a06c-c5ef675edff9 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lazy-loading 'flavor' on Instance uuid 403e2d11-98ae-48e4-b7be-fc15c28e863e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:21:09 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-6f7cd333-07c5-4148-a06c-c5ef675edff9 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.596s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:21:11 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:21:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:21:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:21:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:21:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:21:29 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:21:32 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:21:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:21:34 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:21:37 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:21:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:21:38 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:21:39 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:21:39 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 23:21:39 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Rebuilding the list of instances to heal {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 23:21:39 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-403e2d11-98ae-48e4-b7be-fc15c28e863e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:21:39 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-403e2d11-98ae-48e4-b7be-fc15c28e863e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:21:39 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 23:21:39 user nova-compute[72773]: DEBUG nova.objects.instance [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lazy-loading 'info_cache' on Instance uuid 403e2d11-98ae-48e4-b7be-fc15c28e863e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:21:40 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Updating instance_info_cache with network_info: [{"id": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "address": "fa:16:3e:64:14:98", "network": {"id": "a81d5927-b817-4702-9d46-66e63046290b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-436011694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872cd11021f14ff7a9e68ee019da97f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d7f8c2-be", "ovs_interfaceid": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:21:40 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-403e2d11-98ae-48e4-b7be-fc15c28e863e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:21:40 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 23:21:41 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:21:41 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 23:21:42 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:21:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:21:45 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:21:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:21:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:21:45 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:21:45 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 23:21:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:21:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:21:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk --force-share --output=json {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 23:21:45 user nova-compute[72773]: DEBUG oslo_concurrency.processutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72773) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 23:21:46 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:21:46 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:21:46 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=8849MB free_disk=25.3380126953125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 23:21:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:21:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:21:46 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Instance 403e2d11-98ae-48e4-b7be-fc15c28e863e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72773) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 23:21:46 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 23:21:46 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 23:21:46 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Refreshing inventories for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 23:21:46 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Updating ProviderTree inventory for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 23:21:46 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Updating inventory in ProviderTree for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 23:21:46 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Refreshing aggregate associations for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e, aggregates: None {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 23:21:46 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Refreshing trait associations for resource provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=72773) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 23:21:46 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:21:46 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:21:46 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 23:21:46 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:21:47 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:21:52 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:21:52 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:21:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:21:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:21:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:21:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:21:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:21:52 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:21:53 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:21:53 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Cleaning up deleted instances with incomplete migration  {{(pid=72773) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 23:21:57 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:22:02 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:22:07 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:22:12 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:22:15 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:22:15 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Cleaning up deleted instances {{(pid=72773) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 23:22:15 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] There are 0 instances to clean {{(pid=72773) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 23:22:17 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:22:22 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:22:27 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:22:30 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:22:32 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:22:33 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:22:36 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:22:37 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:22:39 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_power_states {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:22:39 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Triggering sync for uuid 403e2d11-98ae-48e4-b7be-fc15c28e863e {{(pid=72773) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 23:22:39 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:22:39 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:22:39 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:22:39 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:22:40 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:22:41 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:22:41 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:22:41 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 23:22:41 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Rebuilding the list of instances to heal {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 23:22:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "refresh_cache-403e2d11-98ae-48e4-b7be-fc15c28e863e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 23:22:41 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquired lock "refresh_cache-403e2d11-98ae-48e4-b7be-fc15c28e863e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 23:22:41 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Forcefully refreshing network info cache for instance {{(pid=72773) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 23:22:41 user nova-compute[72773]: DEBUG nova.objects.instance [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lazy-loading 'info_cache' on Instance uuid 403e2d11-98ae-48e4-b7be-fc15c28e863e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:22:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-722c0807-904e-49dd-b9a0-1329c90a5215 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Acquiring lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:22:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-722c0807-904e-49dd-b9a0-1329c90a5215 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:22:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-722c0807-904e-49dd-b9a0-1329c90a5215 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Acquiring lock "403e2d11-98ae-48e4-b7be-fc15c28e863e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:22:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-722c0807-904e-49dd-b9a0-1329c90a5215 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:22:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-722c0807-904e-49dd-b9a0-1329c90a5215 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:22:42 user nova-compute[72773]: INFO nova.compute.manager [None req-722c0807-904e-49dd-b9a0-1329c90a5215 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Terminating instance
Aug 16 23:22:42 user nova-compute[72773]: DEBUG nova.compute.manager [None req-722c0807-904e-49dd-b9a0-1329c90a5215 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Start destroying the instance on the hypervisor. {{(pid=72773) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 23:22:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:22:42 user nova-compute[72773]: DEBUG nova.network.neutron [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Updating instance_info_cache with network_info: [{"id": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "address": "fa:16:3e:64:14:98", "network": {"id": "a81d5927-b817-4702-9d46-66e63046290b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-436011694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872cd11021f14ff7a9e68ee019da97f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d7f8c2-be", "ovs_interfaceid": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:22:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Releasing lock "refresh_cache-403e2d11-98ae-48e4-b7be-fc15c28e863e" {{(pid=72773) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 23:22:42 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Updated the network info_cache for instance {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 23:22:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:22:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:22:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:22:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:22:42 user nova-compute[72773]: DEBUG nova.compute.manager [req-f6aa63d7-e8a6-4283-bdcc-f717e6a39dcb req-a6f56201-d1fe-4144-8616-e028829b8520 service nova] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Received event network-vif-unplugged-e1d7f8c2-be99-47fa-9444-31186eebe7d2 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:22:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f6aa63d7-e8a6-4283-bdcc-f717e6a39dcb req-a6f56201-d1fe-4144-8616-e028829b8520 service nova] Acquiring lock "403e2d11-98ae-48e4-b7be-fc15c28e863e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:22:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f6aa63d7-e8a6-4283-bdcc-f717e6a39dcb req-a6f56201-d1fe-4144-8616-e028829b8520 service nova] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:22:42 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-f6aa63d7-e8a6-4283-bdcc-f717e6a39dcb req-a6f56201-d1fe-4144-8616-e028829b8520 service nova] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:22:42 user nova-compute[72773]: DEBUG nova.compute.manager [req-f6aa63d7-e8a6-4283-bdcc-f717e6a39dcb req-a6f56201-d1fe-4144-8616-e028829b8520 service nova] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] No waiting events found dispatching network-vif-unplugged-e1d7f8c2-be99-47fa-9444-31186eebe7d2 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:22:42 user nova-compute[72773]: DEBUG nova.compute.manager [req-f6aa63d7-e8a6-4283-bdcc-f717e6a39dcb req-a6f56201-d1fe-4144-8616-e028829b8520 service nova] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Received event network-vif-unplugged-e1d7f8c2-be99-47fa-9444-31186eebe7d2 for instance with task_state deleting. {{(pid=72773) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 23:22:42 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:22:43 user nova-compute[72773]: INFO nova.virt.libvirt.driver [-] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Instance destroyed successfully.
Aug 16 23:22:43 user nova-compute[72773]: DEBUG nova.objects.instance [None req-722c0807-904e-49dd-b9a0-1329c90a5215 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lazy-loading 'resources' on Instance uuid 403e2d11-98ae-48e4-b7be-fc15c28e863e {{(pid=72773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 23:22:43 user nova-compute[72773]: DEBUG nova.virt.libvirt.vif [None req-722c0807-904e-49dd-b9a0-1329c90a5215 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T23:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-244184505',display_name='tempest-SnapshotDataIntegrityTests-server-244184505',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-244184505',id=53,image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxBK1MHTT8x74wNXck1X3F9Lv5xl1kOqRlWHRkM0kVSQFRG4z8h+IMk7YRByB8/DLUp94XTuWIo5HRr2QdPzC85ow/1AR7pA3gqmS4vXiNNz4Jmz5Y/KOd+0tPLhXqsHg==',key_name='tempest-keypair-333796332',keypairs=<?>,launch_index=0,launched_at=2023-08-16T23:15:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='872cd11021f14ff7a9e68ee019da97f4',ramdisk_id='',reservation_id='r-pn7j9z4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='370c21db-2a77-45c9-b1ac-4447fbc4f414',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-223046460',owner_user_name='tempest-SnapshotDataIntegrityTests-223046460-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T23:15:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62cdc961403d4bdba1d7fbebb42d4d88',uuid=403e2d11-98ae-48e4-b7be-fc15c28e863e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "address": "fa:16:3e:64:14:98", "network": {"id": "a81d5927-b817-4702-9d46-66e63046290b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-436011694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872cd11021f14ff7a9e68ee019da97f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d7f8c2-be", "ovs_interfaceid": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 23:22:43 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-722c0807-904e-49dd-b9a0-1329c90a5215 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Converting VIF {"id": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "address": "fa:16:3e:64:14:98", "network": {"id": "a81d5927-b817-4702-9d46-66e63046290b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-436011694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872cd11021f14ff7a9e68ee019da97f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d7f8c2-be", "ovs_interfaceid": "e1d7f8c2-be99-47fa-9444-31186eebe7d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 23:22:43 user nova-compute[72773]: DEBUG nova.network.os_vif_util [None req-722c0807-904e-49dd-b9a0-1329c90a5215 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:14:98,bridge_name='br-int',has_traffic_filtering=True,id=e1d7f8c2-be99-47fa-9444-31186eebe7d2,network=Network(a81d5927-b817-4702-9d46-66e63046290b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d7f8c2-be') {{(pid=72773) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 23:22:43 user nova-compute[72773]: DEBUG os_vif [None req-722c0807-904e-49dd-b9a0-1329c90a5215 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:14:98,bridge_name='br-int',has_traffic_filtering=True,id=e1d7f8c2-be99-47fa-9444-31186eebe7d2,network=Network(a81d5927-b817-4702-9d46-66e63046290b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d7f8c2-be') {{(pid=72773) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 23:22:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:22:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1d7f8c2-be, bridge=br-int, if_exists=True) {{(pid=72773) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 23:22:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:22:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:22:43 user nova-compute[72773]: INFO os_vif [None req-722c0807-904e-49dd-b9a0-1329c90a5215 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:14:98,bridge_name='br-int',has_traffic_filtering=True,id=e1d7f8c2-be99-47fa-9444-31186eebe7d2,network=Network(a81d5927-b817-4702-9d46-66e63046290b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d7f8c2-be')
Aug 16 23:22:43 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-722c0807-904e-49dd-b9a0-1329c90a5215 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Deleting instance files /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e_del
Aug 16 23:22:43 user nova-compute[72773]: INFO nova.virt.libvirt.driver [None req-722c0807-904e-49dd-b9a0-1329c90a5215 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Deletion of /opt/stack/data/nova/instances/403e2d11-98ae-48e4-b7be-fc15c28e863e_del complete
Aug 16 23:22:43 user nova-compute[72773]: INFO nova.compute.manager [None req-722c0807-904e-49dd-b9a0-1329c90a5215 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 16 23:22:43 user nova-compute[72773]: DEBUG oslo.service.loopingcall [None req-722c0807-904e-49dd-b9a0-1329c90a5215 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72773) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 23:22:43 user nova-compute[72773]: DEBUG nova.compute.manager [-] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Deallocating network for instance {{(pid=72773) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 23:22:43 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] deallocate_for_instance() {{(pid=72773) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 23:22:43 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:22:43 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:22:43 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 23:22:44 user nova-compute[72773]: DEBUG nova.network.neutron [-] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Updating instance_info_cache with network_info: [] {{(pid=72773) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 23:22:44 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Took 1.01 seconds to deallocate network for instance.
Aug 16 23:22:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-722c0807-904e-49dd-b9a0-1329c90a5215 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:22:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-722c0807-904e-49dd-b9a0-1329c90a5215 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:22:44 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-722c0807-904e-49dd-b9a0-1329c90a5215 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:22:44 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-722c0807-904e-49dd-b9a0-1329c90a5215 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:22:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-722c0807-904e-49dd-b9a0-1329c90a5215 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.115s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:22:44 user nova-compute[72773]: INFO nova.scheduler.client.report [None req-722c0807-904e-49dd-b9a0-1329c90a5215 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Deleted allocations for instance 403e2d11-98ae-48e4-b7be-fc15c28e863e
Aug 16 23:22:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-722c0807-904e-49dd-b9a0-1329c90a5215 tempest-SnapshotDataIntegrityTests-223046460 tempest-SnapshotDataIntegrityTests-223046460-project-member] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.205s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:22:44 user nova-compute[72773]: DEBUG nova.compute.manager [req-1b2fb316-6081-44b7-b8ee-4e460500fe1c req-e3daf544-21de-4bb1-8b5b-f3f1ae4c6bb8 service nova] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Received event network-vif-plugged-e1d7f8c2-be99-47fa-9444-31186eebe7d2 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:22:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-1b2fb316-6081-44b7-b8ee-4e460500fe1c req-e3daf544-21de-4bb1-8b5b-f3f1ae4c6bb8 service nova] Acquiring lock "403e2d11-98ae-48e4-b7be-fc15c28e863e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:22:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-1b2fb316-6081-44b7-b8ee-4e460500fe1c req-e3daf544-21de-4bb1-8b5b-f3f1ae4c6bb8 service nova] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:22:44 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [req-1b2fb316-6081-44b7-b8ee-4e460500fe1c req-e3daf544-21de-4bb1-8b5b-f3f1ae4c6bb8 service nova] Lock "403e2d11-98ae-48e4-b7be-fc15c28e863e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:22:44 user nova-compute[72773]: DEBUG nova.compute.manager [req-1b2fb316-6081-44b7-b8ee-4e460500fe1c req-e3daf544-21de-4bb1-8b5b-f3f1ae4c6bb8 service nova] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] No waiting events found dispatching network-vif-plugged-e1d7f8c2-be99-47fa-9444-31186eebe7d2 {{(pid=72773) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 23:22:44 user nova-compute[72773]: WARNING nova.compute.manager [req-1b2fb316-6081-44b7-b8ee-4e460500fe1c req-e3daf544-21de-4bb1-8b5b-f3f1ae4c6bb8 service nova] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Received unexpected event network-vif-plugged-e1d7f8c2-be99-47fa-9444-31186eebe7d2 for instance with vm_state deleted and task_state None.
Aug 16 23:22:44 user nova-compute[72773]: DEBUG nova.compute.manager [req-1b2fb316-6081-44b7-b8ee-4e460500fe1c req-e3daf544-21de-4bb1-8b5b-f3f1ae4c6bb8 service nova] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Received event network-vif-deleted-e1d7f8c2-be99-47fa-9444-31186eebe7d2 {{(pid=72773) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 23:22:47 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:22:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:22:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:22:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:22:47 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 23:22:47 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:22:47 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:22:47 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=8967MB free_disk=25.365070343017578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 23:22:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:22:47 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:22:47 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 23:22:47 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 23:22:47 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:22:47 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:22:48 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 23:22:48 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:22:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:22:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:22:58 user nova-compute[72773]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692228163.1492426, 403e2d11-98ae-48e4-b7be-fc15c28e863e => Stopped> {{(pid=72773) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 23:22:58 user nova-compute[72773]: INFO nova.compute.manager [-] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] VM Stopped (Lifecycle Event)
Aug 16 23:22:58 user nova-compute[72773]: DEBUG nova.compute.manager [None req-9be7dcb4-3b7c-47fc-82c0-e08a4f643782 None None] [instance: 403e2d11-98ae-48e4-b7be-fc15c28e863e] Checking state {{(pid=72773) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 23:22:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:23:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:23:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:23:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:23:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:23:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:23:03 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:23:08 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:23:13 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:23:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:23:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:23:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:23:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:23:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:23:18 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:23:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:23:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:23:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72773) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 23:23:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:23:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72773) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 23:23:23 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:23:28 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:23:31 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:23:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:23:33 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:23:35 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:23:36 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:23:37 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:23:38 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:23:39 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:23:40 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:23:40 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:23:41 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:23:41 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Starting heal instance info cache {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 23:23:41 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Rebuilding the list of instances to heal {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 23:23:41 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Didn't find any instances for network info cache update. {{(pid=72773) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 23:23:43 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:23:43 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:23:44 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:23:44 user nova-compute[72773]: DEBUG nova.compute.manager [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72773) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 23:23:48 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 23:23:49 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager.update_available_resource {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:23:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:23:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:23:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:23:49 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Auditing locally available compute resources for user (node: user) {{(pid=72773) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 23:23:49 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:23:49 user nova-compute[72773]: WARNING nova.virt.libvirt.driver [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 23:23:49 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Hypervisor/Node resource view: name=user free_ram=9106MB free_disk=25.36380386352539GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72773) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 23:23:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 23:23:49 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 23:23:50 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 23:23:50 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72773) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 23:23:50 user nova-compute[72773]: DEBUG nova.compute.provider_tree [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed in ProviderTree for provider: 03cd1900-3798-4f8f-b4d5-3eec5ac6735e {{(pid=72773) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 23:23:50 user nova-compute[72773]: DEBUG nova.scheduler.client.report [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Inventory has not changed for provider 03cd1900-3798-4f8f-b4d5-3eec5ac6735e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72773) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 23:23:50 user nova-compute[72773]: DEBUG nova.compute.resource_tracker [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Compute_service record updated for user:user {{(pid=72773) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 23:23:50 user nova-compute[72773]: DEBUG oslo_concurrency.lockutils [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.337s {{(pid=72773) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 23:23:52 user nova-compute[72773]: DEBUG oslo_service.periodic_task [None req-a14fd240-ecf2-4aca-b2f8-58d15251e11b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72773) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 23:23:53 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 23:23:58 user nova-compute[72773]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72773) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}